Max level shown:
12024-09-03T23:00:00.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8bea4a80-124e-4b4b-8dcd-da084dfb4a99 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
22024-09-03T23:00:00.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8bea4a80-124e-4b4b-8dcd-da084dfb4a99 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32024-09-03T23:00:00.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8bea4a80-124e-4b4b-8dcd-da084dfb4a99 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42024-09-03T23:00:01.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6bb352c5-a0fa-4884-8e7d-4a2a3aa0c0c7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
52024-09-03T23:00:01.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6bb352c5-a0fa-4884-8e7d-4a2a3aa0c0c7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
62024-09-03T23:00:01.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6bb352c5-a0fa-4884-8e7d-4a2a3aa0c0c7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
72024-09-03T23:00:02.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8ac8d267-1e20-4a83-bc49-f5009edc8997 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
82024-09-03T23:00:02.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8ac8d267-1e20-4a83-bc49-f5009edc8997 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
92024-09-03T23:00:02.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8ac8d267-1e20-4a83-bc49-f5009edc8997 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
102024-09-03T23:00:03.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d10664ff-ad8b-43cc-bb8d-d1ee1597ccbd roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
112024-09-03T23:00:03.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d10664ff-ad8b-43cc-bb8d-d1ee1597ccbd resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
122024-09-03T23:00:03.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d10664ff-ad8b-43cc-bb8d-d1ee1597ccbd response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
132024-09-03T23:00:04.064ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
142024-09-03T23:00:04.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
152024-09-03T23:00:04.064ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
162024-09-03T23:00:04.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
172024-09-03T23:00:04.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
182024-09-03T23:00:04.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-09-03T23:00:04.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
202024-09-03T23:00:04.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
212024-09-03T23:00:04.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
222024-09-03T23:00:04.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.023061ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
232024-09-03T23:00:04.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
242024-09-03T23:00:04.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
252024-09-03T23:00:04.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
262024-09-03T23:00:04.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
272024-09-03T23:00:04.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
282024-09-03T23:00:04.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
292024-09-03T23:00:04.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
302024-09-03T23:00:04.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
312024-09-03T23:00:04.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
322024-09-03T23:00:04.083ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
332024-09-03T23:00:04.083ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.086295ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
342024-09-03T23:00:04.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5d448558-1333-4a77-82d7-0ed7e1a210bd roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
352024-09-03T23:00:04.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5d448558-1333-4a77-82d7-0ed7e1a210bd resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
362024-09-03T23:00:04.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5d448558-1333-4a77-82d7-0ed7e1a210bd response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
372024-09-03T23:00:05.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbe564f9-cb8f-4b5b-bb69-06208379af20 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
382024-09-03T23:00:05.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbe564f9-cb8f-4b5b-bb69-06208379af20 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
392024-09-03T23:00:05.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbe564f9-cb8f-4b5b-bb69-06208379af20 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
402024-09-03T23:00:06.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ef68f270-b2de-415f-9035-99775f16fecf roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
412024-09-03T23:00:06.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ef68f270-b2de-415f-9035-99775f16fecf resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
422024-09-03T23:00:06.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ef68f270-b2de-415f-9035-99775f16fecf response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
432024-09-03T23:00:07.312ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1376 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = e9cb4b08-ad07-4873-bcff-c046754574d6 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
442024-09-03T23:00:07.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9ee75926-f772-4137-9a1d-588b2ae451b8 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
452024-09-03T23:00:07.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9ee75926-f772-4137-9a1d-588b2ae451b8 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
462024-09-03T23:00:07.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2164 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9ee75926-f772-4137-9a1d-588b2ae451b8 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
472024-09-03T23:00:08.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1cf90f35-ba44-4979-a4b5-20e7c4b31444 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
482024-09-03T23:00:08.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1cf90f35-ba44-4979-a4b5-20e7c4b31444 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
492024-09-03T23:00:08.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1cf90f35-ba44-4979-a4b5-20e7c4b31444 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
502024-09-03T23:00:09.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 57219f9b-b8d5-4229-b7b4-688c1795aae0 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
512024-09-03T23:00:09.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 57219f9b-b8d5-4229-b7b4-688c1795aae0 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
522024-09-03T23:00:09.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 57219f9b-b8d5-4229-b7b4-688c1795aae0 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
532024-09-03T23:00:10.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9d58cf6e-b774-41be-af6a-8bfec26b7125 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
542024-09-03T23:00:10.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9d58cf6e-b774-41be-af6a-8bfec26b7125 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
552024-09-03T23:00:10.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9d58cf6e-b774-41be-af6a-8bfec26b7125 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
562024-09-03T23:00:11.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4473377a-5f14-4a97-86b4-7e0a96ed8333 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
572024-09-03T23:00:11.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4473377a-5f14-4a97-86b4-7e0a96ed8333 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
582024-09-03T23:00:11.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4473377a-5f14-4a97-86b4-7e0a96ed8333 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
592024-09-03T23:00:12.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e7264afe-cb60-4eb9-8277-36cb09f6b9dd roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
602024-09-03T23:00:12.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e7264afe-cb60-4eb9-8277-36cb09f6b9dd resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
612024-09-03T23:00:12.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e7264afe-cb60-4eb9-8277-36cb09f6b9dd response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
622024-09-03T23:00:13.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e3cac443-e994-415b-872c-edaed824c641 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
632024-09-03T23:00:13.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e3cac443-e994-415b-872c-edaed824c641 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
642024-09-03T23:00:13.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e3cac443-e994-415b-872c-edaed824c641 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
652024-09-03T23:00:14.064ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
662024-09-03T23:00:14.064ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
672024-09-03T23:00:14.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
682024-09-03T23:00:14.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
692024-09-03T23:00:14.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
702024-09-03T23:00:14.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
712024-09-03T23:00:14.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
722024-09-03T23:00:14.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
732024-09-03T23:00:14.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
742024-09-03T23:00:14.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.720358ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
752024-09-03T23:00:14.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
762024-09-03T23:00:14.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
772024-09-03T23:00:14.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
782024-09-03T23:00:14.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
792024-09-03T23:00:14.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
802024-09-03T23:00:14.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
812024-09-03T23:00:14.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
822024-09-03T23:00:14.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
832024-09-03T23:00:14.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
842024-09-03T23:00:14.083ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
852024-09-03T23:00:14.083ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.982604ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
862024-09-03T23:00:14.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2f32fa2e-4760-4c6b-9fd0-b0acf8c7f3cc roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
872024-09-03T23:00:14.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2f32fa2e-4760-4c6b-9fd0-b0acf8c7f3cc resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
882024-09-03T23:00:14.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2f32fa2e-4760-4c6b-9fd0-b0acf8c7f3cc response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
892024-09-03T23:00:15.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 16e92992-a03e-4e22-9563-9e566993ded8 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
902024-09-03T23:00:15.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 16e92992-a03e-4e22-9563-9e566993ded8 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
912024-09-03T23:00:15.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 16e92992-a03e-4e22-9563-9e566993ded8 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
922024-09-03T23:00:16.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6ed8ad9c-de3e-4963-9296-e5ef747e819a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
932024-09-03T23:00:16.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6ed8ad9c-de3e-4963-9296-e5ef747e819a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
942024-09-03T23:00:16.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6ed8ad9c-de3e-4963-9296-e5ef747e819a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
952024-09-03T23:00:17.311ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1257 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 265108de-064e-4e85-bd61-78ab8c6ea652 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
962024-09-03T23:00:17.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0c25600a-f125-48c7-81ab-51c0ad2ff6ef roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
972024-09-03T23:00:17.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0c25600a-f125-48c7-81ab-51c0ad2ff6ef resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
982024-09-03T23:00:17.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0c25600a-f125-48c7-81ab-51c0ad2ff6ef response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
992024-09-03T23:00:18.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e512becd-b1a1-48b1-ae5f-7e77c5234628 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1002024-09-03T23:00:18.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e512becd-b1a1-48b1-ae5f-7e77c5234628 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1012024-09-03T23:00:18.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e512becd-b1a1-48b1-ae5f-7e77c5234628 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1022024-09-03T23:00:19.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 58ec71b4-06ce-454d-b42d-d902e3dd6e8d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1032024-09-03T23:00:19.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 58ec71b4-06ce-454d-b42d-d902e3dd6e8d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1042024-09-03T23:00:19.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 58ec71b4-06ce-454d-b42d-d902e3dd6e8d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1052024-09-03T23:00:20.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cd1a6c31-20c4-48f8-a59d-e224dddcdb11 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1062024-09-03T23:00:20.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cd1a6c31-20c4-48f8-a59d-e224dddcdb11 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1072024-09-03T23:00:20.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cd1a6c31-20c4-48f8-a59d-e224dddcdb11 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1082024-09-03T23:00:21.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 565ab788-d114-4e6e-af19-1747d9638c22 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1092024-09-03T23:00:21.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 565ab788-d114-4e6e-af19-1747d9638c22 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1102024-09-03T23:00:21.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 565ab788-d114-4e6e-af19-1747d9638c22 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1112024-09-03T23:00:23.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = eceb9763-e6f8-4cf8-81fa-8ad3fbc08f79 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1122024-09-03T23:00:23.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = eceb9763-e6f8-4cf8-81fa-8ad3fbc08f79 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1132024-09-03T23:00:23.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = eceb9763-e6f8-4cf8-81fa-8ad3fbc08f79 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1142024-09-03T23:00:23.364ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53552
1152024-09-03T23:00:23.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53552 req_id = 1f4a1af6-b706-4131-a9c3-0cf77ada83da roles = RoleSet { roles: {} } uri = /metrics/producers
1162024-09-03T23:00:23.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53552 req_id = 1f4a1af6-b706-4131-a9c3-0cf77ada83da resource = Database result = Ok(()) uri = /metrics/producers
1172024-09-03T23:00:23.397ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
1182024-09-03T23:00:23.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53552 req_id = 1f4a1af6-b706-4131-a9c3-0cf77ada83da roles = RoleSet { roles: {} } uri = /metrics/producers
1192024-09-03T23:00:23.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53552 req_id = 1f4a1af6-b706-4131-a9c3-0cf77ada83da resource = Database result = Ok(()) uri = /metrics/producers
1202024-09-03T23:00:23.430ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
1212024-09-03T23:00:23.430ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "244bc499-f6d4-4181-899f-cc5cffc2f31e", "date": "Tue, 03 Sep 2024 23:00:23 GMT"} })
1222024-09-03T23:00:23.430ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = a7982f14-99ae-4669-9eb0-479a503efbc4
1232024-09-03T23:00:23.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 68700 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53552 req_id = 1f4a1af6-b706-4131-a9c3-0cf77ada83da response_code = 201 uri = /metrics/producers
1242024-09-03T23:00:24.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 121dd37d-e97a-40af-a5ce-e65938fed8df roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1252024-09-03T23:00:24.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 121dd37d-e97a-40af-a5ce-e65938fed8df resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1262024-09-03T23:00:24.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 121dd37d-e97a-40af-a5ce-e65938fed8df response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
1272024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
1282024-09-03T23:00:24.064ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc
1292024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 28.44\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc"}
1302024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
1312024-09-03T23:00:24.064ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
1322024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
1332024-09-03T23:00:24.064ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
1342024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
1352024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
1362024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1372024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1382024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
1392024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1402024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
1412024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1422024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
1432024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1442024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
1452024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
1462024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1472024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1482024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
1492024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
1502024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
1512024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1522024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
1532024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1542024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
1552024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
1562024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1572024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1582024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1592024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1602024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
1612024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
1622024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1632024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1642024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
1652024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
1662024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1672024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1682024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
1692024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1702024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
1712024-09-03T23:00:24.064ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
1722024-09-03T23:00:24.064ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 22:50:24.064847632 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1732024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1742024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
1752024-09-03T23:00:24.065ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1762024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1772024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
1782024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1792024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
1802024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1812024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1822024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
1832024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
1842024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
1852024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
1862024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1872024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1882024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
1892024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1902024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1912024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1922024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1932024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
1942024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1952024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1962024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1972024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1982024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1992024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2002024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2012024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2022024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2032024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2042024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2052024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2062024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2072024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2082024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
2092024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2102024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2112024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2122024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2132024-09-03T23:00:24.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2142024-09-03T23:00:24.065ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d574b3d-97ce-4fc4-8255-27d61ab35e88.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9e590c60-1cc5-4f4c-8ae9-48abc39cb394.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1005, tv_nsec: 312598992 } })
2152024-09-03T23:00:24.065ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5278d774-fcf6-40b9-b896-4e3af31c54b8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1005, tv_nsec: 312648313 } })
2162024-09-03T23:00:24.066ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2172024-09-03T23:00:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.813559ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2182024-09-03T23:00:24.066ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
2192024-09-03T23:00:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.579096ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
2202024-09-03T23:00:24.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2212024-09-03T23:00:24.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2222024-09-03T23:00:24.074ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.745129ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2232024-09-03T23:00:24.075ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.948762ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
2242024-09-03T23:00:24.077ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2252024-09-03T23:00:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2262024-09-03T23:00:24.078ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1005, tv_nsec: 325288862 } })
2272024-09-03T23:00:24.078ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
2282024-09-03T23:00:24.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2292024-09-03T23:00:24.080ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1005, tv_nsec: 327875718 } })
2302024-09-03T23:00:24.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2312024-09-03T23:00:24.081ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
2322024-09-03T23:00:24.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2332024-09-03T23:00:24.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2342024-09-03T23:00:24.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2352024-09-03T23:00:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2362024-09-03T23:00:24.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2372024-09-03T23:00:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2382024-09-03T23:00:24.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2392024-09-03T23:00:24.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2402024-09-03T23:00:24.086ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2412024-09-03T23:00:24.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2422024-09-03T23:00:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2432024-09-03T23:00:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2442024-09-03T23:00:24.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2452024-09-03T23:00:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2462024-09-03T23:00:24.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2472024-09-03T23:00:24.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2482024-09-03T23:00:24.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2492024-09-03T23:00:24.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2502024-09-03T23:00:24.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2512024-09-03T23:00:24.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2522024-09-03T23:00:24.102ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 22:50:24.064847632 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2532024-09-03T23:00:24.102ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 37.994697ms iteration = 6 status = {"expiration":"2024-09-03T22:50:24.064847632Z","pruned":[]}
2542024-09-03T23:00:24.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2552024-09-03T23:00:24.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.10039ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2562024-09-03T23:00:24.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2572024-09-03T23:00:24.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2582024-09-03T23:00:24.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2592024-09-03T23:00:24.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2602024-09-03T23:00:24.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2612024-09-03T23:00:24.120ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2622024-09-03T23:00:24.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2632024-09-03T23:00:24.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2642024-09-03T23:00:24.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2652024-09-03T23:00:24.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2662024-09-03T23:00:24.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2672024-09-03T23:00:24.127ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2682024-09-03T23:00:24.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2692024-09-03T23:00:24.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2702024-09-03T23:00:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2712024-09-03T23:00:24.129ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1005, tv_nsec: 375901587 } })
2722024-09-03T23:00:24.129ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
2732024-09-03T23:00:24.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2742024-09-03T23:00:24.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2752024-09-03T23:00:24.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2762024-09-03T23:00:24.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2772024-09-03T23:00:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2782024-09-03T23:00:24.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2792024-09-03T23:00:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2802024-09-03T23:00:24.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2812024-09-03T23:00:24.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822024-09-03T23:00:24.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2832024-09-03T23:00:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2842024-09-03T23:00:24.146ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2852024-09-03T23:00:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2862024-09-03T23:00:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2872024-09-03T23:00:24.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2882024-09-03T23:00:24.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2892024-09-03T23:00:24.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 86.765224ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
2902024-09-03T23:00:24.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2912024-09-03T23:00:24.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2922024-09-03T23:00:24.163ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2932024-09-03T23:00:24.163ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
2942024-09-03T23:00:24.163ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
2952024-09-03T23:00:24.163ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 98.965248ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
2962024-09-03T23:00:24.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2972024-09-03T23:00:24.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2982024-09-03T23:00:24.164ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2992024-09-03T23:00:24.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3002024-09-03T23:00:24.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3012024-09-03T23:00:24.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3022024-09-03T23:00:24.164ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3032024-09-03T23:00:24.165ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3042024-09-03T23:00:24.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3052024-09-03T23:00:24.166ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3062024-09-03T23:00:24.166ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3072024-09-03T23:00:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3082024-09-03T23:00:24.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
3092024-09-03T23:00:24.167ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3102024-09-03T23:00:24.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3112024-09-03T23:00:24.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.872078ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
3122024-09-03T23:00:24.169ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
3132024-09-03T23:00:24.169ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
3142024-09-03T23:00:24.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3152024-09-03T23:00:24.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3162024-09-03T23:00:24.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3172024-09-03T23:00:24.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.747547ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
3182024-09-03T23:00:24.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3192024-09-03T23:00:24.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3202024-09-03T23:00:24.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3212024-09-03T23:00:24.178ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3222024-09-03T23:00:24.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3232024-09-03T23:00:24.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3242024-09-03T23:00:24.180ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3252024-09-03T23:00:24.181ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3262024-09-03T23:00:24.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3272024-09-03T23:00:24.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3282024-09-03T23:00:24.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3292024-09-03T23:00:24.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3302024-09-03T23:00:24.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3312024-09-03T23:00:24.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3322024-09-03T23:00:24.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3332024-09-03T23:00:24.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3342024-09-03T23:00:24.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3352024-09-03T23:00:24.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3362024-09-03T23:00:24.186ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3372024-09-03T23:00:24.186ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3382024-09-03T23:00:24.186ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3392024-09-03T23:00:24.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3402024-09-03T23:00:24.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3412024-09-03T23:00:24.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3422024-09-03T23:00:24.190ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3432024-09-03T23:00:24.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3442024-09-03T23:00:24.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3452024-09-03T23:00:24.199ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3462024-09-03T23:00:24.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
3472024-09-03T23:00:24.203ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3482024-09-03T23:00:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3492024-09-03T23:00:24.204ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3502024-09-03T23:00:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3512024-09-03T23:00:24.206ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3522024-09-03T23:00:24.206ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3532024-09-03T23:00:24.206ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3542024-09-03T23:00:24.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3552024-09-03T23:00:24.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3562024-09-03T23:00:24.215ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3572024-09-03T23:00:24.215ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3582024-09-03T23:00:24.215ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 150.342241ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3592024-09-03T23:00:24.215ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 150.849456ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3602024-09-03T23:00:24.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3612024-09-03T23:00:24.217ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
3622024-09-03T23:00:24.217ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3632024-09-03T23:00:24.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3642024-09-03T23:00:24.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3652024-09-03T23:00:24.221ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3662024-09-03T23:00:24.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3672024-09-03T23:00:24.236ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
3682024-09-03T23:00:24.236ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3692024-09-03T23:00:24.236ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "55a82422-cc7a-434e-8408-c3510dd0f2f2", "content-length": "26", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
3702024-09-03T23:00:24.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3712024-09-03T23:00:24.239ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3722024-09-03T23:00:24.252ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
3732024-09-03T23:00:24.252ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3742024-09-03T23:00:24.253ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2239e832-d156-446c-a71f-e63aba3ef36b", "content-length": "26", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
3752024-09-03T23:00:24.253ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3762024-09-03T23:00:24.255ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3772024-09-03T23:00:24.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3782024-09-03T23:00:24.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3792024-09-03T23:00:24.268ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3802024-09-03T23:00:24.268ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 204.049868ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3812024-09-03T23:00:24.278ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 213.618176ms iteration = 14 status = {"physical_disks_added":0}
3822024-09-03T23:00:24.281ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
3832024-09-03T23:00:24.281ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3842024-09-03T23:00:24.282ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "473aea7a-9feb-49ae-ac50-58e2b10c3862", "content-length": "26", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
3852024-09-03T23:00:24.282ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3862024-09-03T23:00:24.284ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
3872024-09-03T23:00:24.366ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3882024-09-03T23:00:24.411ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3892024-09-03T23:00:24.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7176f508-decd-4c09-bea0-c0a10b41f087", "content-length": "372", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
3902024-09-03T23:00:24.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3912024-09-03T23:00:24.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3922024-09-03T23:00:24.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3932024-09-03T23:00:24.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3942024-09-03T23:00:24.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3952024-09-03T23:00:24.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3962024-09-03T23:00:24.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3972024-09-03T23:00:24.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3982024-09-03T23:00:24.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3992024-09-03T23:00:24.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4002024-09-03T23:00:24.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4012024-09-03T23:00:24.419ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4022024-09-03T23:00:24.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4032024-09-03T23:00:24.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4042024-09-03T23:00:24.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4052024-09-03T23:00:24.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4062024-09-03T23:00:24.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4072024-09-03T23:00:24.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4082024-09-03T23:00:24.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4092024-09-03T23:00:24.422ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
4102024-09-03T23:00:24.422ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 358.083126ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
4112024-09-03T23:00:24.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4122024-09-03T23:00:24.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4132024-09-03T23:00:24.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4142024-09-03T23:00:24.426ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
4152024-09-03T23:00:24.426ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
4162024-09-03T23:00:24.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4172024-09-03T23:00:24.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4182024-09-03T23:00:24.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4192024-09-03T23:00:24.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4202024-09-03T23:00:24.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4212024-09-03T23:00:24.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4222024-09-03T23:00:24.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4232024-09-03T23:00:24.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4242024-09-03T23:00:24.431ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4252024-09-03T23:00:24.432ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3e781e5f-a83c-40ed-bdd8-22d5f3f87430", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
4262024-09-03T23:00:24.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4272024-09-03T23:00:24.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4282024-09-03T23:00:24.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4292024-09-03T23:00:24.434ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 369.620193ms iteration = 12 status = {}
4302024-09-03T23:00:24.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
4312024-09-03T23:00:24.436ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4322024-09-03T23:00:24.436ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
4332024-09-03T23:00:24.436ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4342024-09-03T23:00:24.436ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 22:55:54.269593 UTC dns_group = internal generation = 1
4352024-09-03T23:00:24.436ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 371.634644ms iteration = 7 status = {"generation":1}
4362024-09-03T23:00:24.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4372024-09-03T23:00:24.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4382024-09-03T23:00:24.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4392024-09-03T23:00:24.440ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4402024-09-03T23:00:24.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4412024-09-03T23:00:24.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4422024-09-03T23:00:24.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4432024-09-03T23:00:24.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4442024-09-03T23:00:24.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4452024-09-03T23:00:24.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 385.753639ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4462024-09-03T23:00:24.464ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
4472024-09-03T23:00:24.464ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4482024-09-03T23:00:24.465ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 400.212945ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
4492024-09-03T23:00:24.472ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
4502024-09-03T23:00:24.472ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
4512024-09-03T23:00:24.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4522024-09-03T23:00:24.472ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35171
4532024-09-03T23:00:24.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35171 req_id = 7faf9ac0-edab-45a2-91d6-3c8323759c00 roles = RoleSet { roles: {} } uri = /metrics/producers
4542024-09-03T23:00:24.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4552024-09-03T23:00:24.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35171 req_id = 7faf9ac0-edab-45a2-91d6-3c8323759c00 resource = Database result = Ok(()) uri = /metrics/producers
4562024-09-03T23:00:24.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4572024-09-03T23:00:24.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
4582024-09-03T23:00:24.476ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4592024-09-03T23:00:24.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4602024-09-03T23:00:24.477ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T22:55:21.166044Z, time_modified: 2024-09-03T22:55:21.166044Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }) }
4612024-09-03T23:00:24.477ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 412.560701ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]}},"default_endpoint":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4622024-09-03T23:00:24.479ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 414.823534ms iteration = 11 status = 0
4632024-09-03T23:00:24.480ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 416.297169ms iteration = 11 status = {}
4642024-09-03T23:00:24.486ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4652024-09-03T23:00:24.486ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "89a6ea9a-1a5a-479d-97ed-1769f89485cb", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4662024-09-03T23:00:24.486ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4672024-09-03T23:00:24.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "62e8c5a6-4615-4d7e-806c-15c62cdfab6b", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4682024-09-03T23:00:24.490ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4692024-09-03T23:00:24.491ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4702024-09-03T23:00:24.491ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 426.876557ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4712024-09-03T23:00:24.497ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4722024-09-03T23:00:24.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4732024-09-03T23:00:24.499ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4742024-09-03T23:00:24.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4752024-09-03T23:00:24.507ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4762024-09-03T23:00:24.507ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8328ff61-d6c9-4963-8fad-4d86b360edcb", "content-length": "1", "date": "Tue, 03 Sep 2024 23:00:23 GMT"} })
4772024-09-03T23:00:24.509ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4782024-09-03T23:00:24.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4792024-09-03T23:00:24.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4802024-09-03T23:00:24.513ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4812024-09-03T23:00:24.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dd1c3da5-6728-4939-96cf-b14037c7dd76", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4822024-09-03T23:00:24.514ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4832024-09-03T23:00:24.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4842024-09-03T23:00:24.514ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4852024-09-03T23:00:24.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4862024-09-03T23:00:24.516ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9e173f3c-70ba-489a-b906-b965e3603f20", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4872024-09-03T23:00:24.516ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4882024-09-03T23:00:24.519ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3513a187-04bf-4414-97c2-a72b7bbb8801", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4892024-09-03T23:00:24.519ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4902024-09-03T23:00:24.521ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
4912024-09-03T23:00:24.521ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 457.172385ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4922024-09-03T23:00:24.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4932024-09-03T23:00:24.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4942024-09-03T23:00:24.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4952024-09-03T23:00:24.545ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
4962024-09-03T23:00:24.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4972024-09-03T23:00:24.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4982024-09-03T23:00:24.557ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
4992024-09-03T23:00:24.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35171 req_id = 7faf9ac0-edab-45a2-91d6-3c8323759c00 roles = RoleSet { roles: {} } uri = /metrics/producers
5002024-09-03T23:00:24.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35171 req_id = 7faf9ac0-edab-45a2-91d6-3c8323759c00 resource = Database result = Ok(()) uri = /metrics/producers
5012024-09-03T23:00:24.560ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 495.451655ms iteration = 11 status = null
5022024-09-03T23:00:24.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5032024-09-03T23:00:24.560ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
5042024-09-03T23:00:24.560ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
5052024-09-03T23:00:24.560ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 22:55:55.157084 UTC dns_group = external generation = 2
5062024-09-03T23:00:24.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 496.041541ms iteration = 7 status = {"generation":2}
5072024-09-03T23:00:24.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5082024-09-03T23:00:24.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5092024-09-03T23:00:24.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5102024-09-03T23:00:24.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5112024-09-03T23:00:24.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
5122024-09-03T23:00:24.566ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5132024-09-03T23:00:24.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5142024-09-03T23:00:24.593ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5152024-09-03T23:00:24.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5162024-09-03T23:00:24.595ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5172024-09-03T23:00:24.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5182024-09-03T23:00:24.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5192024-09-03T23:00:24.599ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
5202024-09-03T23:00:24.600ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "edafa6c8-dd53-4cec-9708-69cba83f2660", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
5212024-09-03T23:00:24.600ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = d2df786c-b519-4bd8-beec-40bdc5ddeeaa
5222024-09-03T23:00:24.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5232024-09-03T23:00:24.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 128950 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35171 req_id = 7faf9ac0-edab-45a2-91d6-3c8323759c00 response_code = 201 uri = /metrics/producers
5242024-09-03T23:00:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5252024-09-03T23:00:24.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
5262024-09-03T23:00:24.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5272024-09-03T23:00:24.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5282024-09-03T23:00:24.603ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 4a162852-b7fb-453d-8700-c28c90ceea1a, rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cfbbc591-5a71-4824-b45b-c64ca1770cd0) } rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
5292024-09-03T23:00:24.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5302024-09-03T23:00:24.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5312024-09-03T23:00:24.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5322024-09-03T23:00:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5332024-09-03T23:00:24.609ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:49360
5342024-09-03T23:00:24.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49360 req_id = f912cf0f-4055-41fa-964c-1a5feb7fe712 roles = RoleSet { roles: {} } uri = /metrics/producers
5352024-09-03T23:00:24.610ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5362024-09-03T23:00:24.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49360 req_id = f912cf0f-4055-41fa-964c-1a5feb7fe712 resource = Database result = Ok(()) uri = /metrics/producers
5372024-09-03T23:00:24.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5382024-09-03T23:00:24.612ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5392024-09-03T23:00:24.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5402024-09-03T23:00:24.614ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5412024-09-03T23:00:24.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5422024-09-03T23:00:24.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5432024-09-03T23:00:24.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9a3e27d0-6af6-48de-a2fc-1a8bd16c92ac", "content-length": "121", "date": "Tue, 03 Sep 2024 23:00:23 GMT"} })
5442024-09-03T23:00:24.614ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
5452024-09-03T23:00:24.614ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cfbbc591-5a71-4824-b45b-c64ca1770cd0
5462024-09-03T23:00:24.615ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5472024-09-03T23:00:24.615ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5482024-09-03T23:00:24.615ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
5492024-09-03T23:00:24.615ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
5502024-09-03T23:00:24.615ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
5512024-09-03T23:00:24.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5522024-09-03T23:00:24.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5532024-09-03T23:00:24.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5542024-09-03T23:00:24.616ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ec846b32-93aa-4570-b3bb-c333427832f0", "content-length": "2", "date": "Tue, 03 Sep 2024 23:00:23 GMT"} })
5552024-09-03T23:00:24.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5562024-09-03T23:00:24.617ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4268e315-6b5f-40af-8ef2-e535314d9137", "content-length": "52", "date": "Tue, 03 Sep 2024 23:00:23 GMT"} })
5572024-09-03T23:00:24.617ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
5582024-09-03T23:00:24.617ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5592024-09-03T23:00:24.617ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5602024-09-03T23:00:24.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5612024-09-03T23:00:24.618ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5622024-09-03T23:00:24.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5632024-09-03T23:00:24.620ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5642024-09-03T23:00:24.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5652024-09-03T23:00:24.622ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662024-09-03T23:00:24.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
5672024-09-03T23:00:24.626ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5682024-09-03T23:00:24.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5692024-09-03T23:00:24.628ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5702024-09-03T23:00:24.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5712024-09-03T23:00:24.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5722024-09-03T23:00:24.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5732024-09-03T23:00:24.661ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
5742024-09-03T23:00:24.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49360 req_id = f912cf0f-4055-41fa-964c-1a5feb7fe712 roles = RoleSet { roles: {} } uri = /metrics/producers
5752024-09-03T23:00:24.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49360 req_id = f912cf0f-4055-41fa-964c-1a5feb7fe712 resource = Database result = Ok(()) uri = /metrics/producers
5762024-09-03T23:00:24.664ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772024-09-03T23:00:24.667ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
5782024-09-03T23:00:24.668ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5c5b1f66-a83c-44f3-ace2-e8fdacb292df", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
5792024-09-03T23:00:24.668ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = 03fe690d-d383-493d-857f-957a03d9553b
5802024-09-03T23:00:24.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
5812024-09-03T23:00:24.668ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5822024-09-03T23:00:24.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5832024-09-03T23:00:24.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 60936 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49360 req_id = f912cf0f-4055-41fa-964c-1a5feb7fe712 response_code = 201 uri = /metrics/producers
5842024-09-03T23:00:24.692ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5852024-09-03T23:00:24.692ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "21339ed3-f09e-4bb7-8d25-959316eeb3cd", "content-length": "691", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
5862024-09-03T23:00:24.692ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
5872024-09-03T23:00:24.692ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
5882024-09-03T23:00:24.692ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
5892024-09-03T23:00:24.693ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 629.185697ms iteration = 11 status = {}
5902024-09-03T23:00:24.695ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 7522b9fd-8974-4190-9e2e-10793ce4e154, kind: Service { id: 8278b46a-dde4-45b0-b69b-d4ee6312c201 }, name: Name("nexus-8278b46a-dde4-45b0-b69b-d4ee6312c201"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 116])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c86b806d-eb7e-43ed-80e7-4c49b81bf5f0, kind: Service { id: b61e0b12-8522-4051-af32-e12709e2be62 }, name: Name("nexus-b61e0b12-8522-4051-af32-e12709e2be62"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e54d8978-3051-4772-a0cf-fab46617cd1d, kind: Service { id: 233bc5db-e41f-4898-a8d6-3cba2818c0c4 }, name: Name("nexus-233bc5db-e41f-4898-a8d6-3cba2818c0c4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 442190a6-43b7-4a9d-8c82-086aa698d6d2, kind: Service { id: 5278d774-fcf6-40b9-b896-4e3af31c54b8 }, name: Name("external-dns-5278d774-fcf6-40b9-b896-4e3af31c54b8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e81b6110-e677-4681-9a52-1a259854d103, kind: Service { id: d2a18455-e4a4-4775-b583-fa895e235cf8 }, name: Name("external-dns-d2a18455-e4a4-4775-b583-fa895e235cf8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
5912024-09-03T23:00:24.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5922024-09-03T23:00:24.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5932024-09-03T23:00:24.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942024-09-03T23:00:24.700ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
5952024-09-03T23:00:24.700ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5962024-09-03T23:00:24.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5972024-09-03T23:00:24.703ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
5982024-09-03T23:00:24.703ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 442190a6-43b7-4a9d-8c82-086aa698d6d2, kind: Service { id: 5278d774-fcf6-40b9-b896-4e3af31c54b8 }, name: Name("external-dns-5278d774-fcf6-40b9-b896-4e3af31c54b8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 5])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e81b6110-e677-4681-9a52-1a259854d103, kind: Service { id: d2a18455-e4a4-4775-b583-fa895e235cf8 }, name: Name("external-dns-d2a18455-e4a4-4775-b583-fa895e235cf8"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 219, 173])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7522b9fd-8974-4190-9e2e-10793ce4e154, kind: Service { id: 8278b46a-dde4-45b0-b69b-d4ee6312c201 }, name: Name("nexus-8278b46a-dde4-45b0-b69b-d4ee6312c201"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 116])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c86b806d-eb7e-43ed-80e7-4c49b81bf5f0, kind: Service { id: b61e0b12-8522-4051-af32-e12709e2be62 }, name: Name("nexus-b61e0b12-8522-4051-af32-e12709e2be62"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e54d8978-3051-4772-a0cf-fab46617cd1d, kind: Service { id: 233bc5db-e41f-4898-a8d6-3cba2818c0c4 }, name: Name("nexus-233bc5db-e41f-4898-a8d6-3cba2818c0c4"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 14])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
5992024-09-03T23:00:24.703ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
6002024-09-03T23:00:24.773ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 03fe690d-d383-493d-857f-957a03d9553b, time_created: 2024-09-03T22:55:52.998526Z, time_modified: 2024-09-03T22:55:52.998526Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
6012024-09-03T23:00:24.773ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
6022024-09-03T23:00:24.773ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6032024-09-03T23:00:24.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6042024-09-03T23:00:24.777ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6052024-09-03T23:00:24.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6062024-09-03T23:00:24.780ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6072024-09-03T23:00:24.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
6082024-09-03T23:00:24.814ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "20aaa51e-9cd8-4a88-a324-12b0e66edc9a", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
6092024-09-03T23:00:24.814ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch = Switch0
6102024-09-03T23:00:24.814ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
6112024-09-03T23:00:24.819ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5485ed4f-3aa0-46bc-8e89-9484c31d6447", "content-length": "667", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
6122024-09-03T23:00:24.819ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6132024-09-03T23:00:24.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6142024-09-03T23:00:24.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6152024-09-03T23:00:24.823ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
6162024-09-03T23:00:24.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6172024-09-03T23:00:24.824ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9749b1ea-a751-4d2f-85bf-34988fd2a584", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
6182024-09-03T23:00:24.825ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
6192024-09-03T23:00:24.825ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 760.742397ms
6202024-09-03T23:00:24.825ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 760.757697ms iteration = 2 status = {}
6212024-09-03T23:00:24.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6222024-09-03T23:00:24.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6232024-09-03T23:00:24.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6242024-09-03T23:00:24.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6252024-09-03T23:00:24.836ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 771.783479ms iteration = 11 status = {}
6262024-09-03T23:00:24.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 52c9321f-d769-4093-a487-51e12123d531 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
6272024-09-03T23:00:24.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 52c9321f-d769-4093-a487-51e12123d531 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
6282024-09-03T23:00:24.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 52c9321f-d769-4093-a487-51e12123d531 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
6292024-09-03T23:00:25.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 473e697e-0c07-44d0-b96e-56999c2927b0 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6302024-09-03T23:00:25.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 473e697e-0c07-44d0-b96e-56999c2927b0 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6312024-09-03T23:00:25.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 473e697e-0c07-44d0-b96e-56999c2927b0 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6322024-09-03T23:00:25.575ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55358
6332024-09-03T23:00:25.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55358 req_id = 27b70b53-78cf-4cfb-a654-6b218c2fa95c roles = RoleSet { roles: {} } uri = /metrics/producers
6342024-09-03T23:00:25.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55358 req_id = 27b70b53-78cf-4cfb-a654-6b218c2fa95c resource = Database result = Ok(()) uri = /metrics/producers
6352024-09-03T23:00:25.609ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
6362024-09-03T23:00:25.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55358 req_id = 27b70b53-78cf-4cfb-a654-6b218c2fa95c roles = RoleSet { roles: {} } uri = /metrics/producers
6372024-09-03T23:00:25.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55358 req_id = 27b70b53-78cf-4cfb-a654-6b218c2fa95c resource = Database result = Ok(()) uri = /metrics/producers
6382024-09-03T23:00:25.614ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
6392024-09-03T23:00:25.614ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7dedfb4f-f796-4a4d-bee7-29c02b7f64d9", "date": "Tue, 03 Sep 2024 23:00:24 GMT"} })
6402024-09-03T23:00:25.614ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = 89f5495b-6ef3-4e29-8cc7-26837304b70a
6412024-09-03T23:00:25.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 40472 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55358 req_id = 27b70b53-78cf-4cfb-a654-6b218c2fa95c response_code = 201 uri = /metrics/producers
6422024-09-03T23:00:26.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d373d4f4-f665-4fa6-b6fa-6a60e05d95a7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6432024-09-03T23:00:26.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d373d4f4-f665-4fa6-b6fa-6a60e05d95a7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6442024-09-03T23:00:26.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d373d4f4-f665-4fa6-b6fa-6a60e05d95a7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6452024-09-03T23:00:27.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6a3581b2-ab09-4c9e-8a5f-35d5750991a6 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6462024-09-03T23:00:27.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6a3581b2-ab09-4c9e-8a5f-35d5750991a6 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6472024-09-03T23:00:27.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6a3581b2-ab09-4c9e-8a5f-35d5750991a6 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6482024-09-03T23:00:27.311ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1329 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = cbac9558-63aa-4c2b-8b5f-5e404ad355f9 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
6492024-09-03T23:00:28.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8ac4b938-0882-4baf-9dbc-19d89b6ed03d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6502024-09-03T23:00:28.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8ac4b938-0882-4baf-9dbc-19d89b6ed03d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6512024-09-03T23:00:28.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8ac4b938-0882-4baf-9dbc-19d89b6ed03d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6522024-09-03T23:00:29.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a350f082-0f41-4af1-b488-4e9336411133 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6532024-09-03T23:00:29.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a350f082-0f41-4af1-b488-4e9336411133 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6542024-09-03T23:00:29.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a350f082-0f41-4af1-b488-4e9336411133 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6552024-09-03T23:00:29.741ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40135
6562024-09-03T23:00:29.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40135 req_id = 6e7fd253-ccad-4e46-9398-48cc95a88ccf roles = RoleSet { roles: {} } uri = /metrics/producers
6572024-09-03T23:00:29.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40135 req_id = 6e7fd253-ccad-4e46-9398-48cc95a88ccf resource = Database result = Ok(()) uri = /metrics/producers
6582024-09-03T23:00:29.774ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
6592024-09-03T23:00:29.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40135 req_id = 6e7fd253-ccad-4e46-9398-48cc95a88ccf roles = RoleSet { roles: {} } uri = /metrics/producers
6602024-09-03T23:00:29.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40135 req_id = 6e7fd253-ccad-4e46-9398-48cc95a88ccf resource = Database result = Ok(()) uri = /metrics/producers
6612024-09-03T23:00:29.806ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
6622024-09-03T23:00:29.806ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3ab9c26f-665d-4cd6-b53e-dc410ebadaa6", "date": "Tue, 03 Sep 2024 23:00:29 GMT"} })
6632024-09-03T23:00:29.806ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = 41260b76-4f8a-476c-bd42-eab3a900da1f
6642024-09-03T23:00:29.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 66115 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40135 req_id = 6e7fd253-ccad-4e46-9398-48cc95a88ccf response_code = 201 uri = /metrics/producers
6652024-09-03T23:00:30.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2bc8ba95-a673-4725-81b1-49ff6f14dd53 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6662024-09-03T23:00:30.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2bc8ba95-a673-4725-81b1-49ff6f14dd53 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6672024-09-03T23:00:30.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2bc8ba95-a673-4725-81b1-49ff6f14dd53 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6682024-09-03T23:00:31.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 39674fcf-9601-439a-91da-884baecca3b7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6692024-09-03T23:00:31.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 39674fcf-9601-439a-91da-884baecca3b7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6702024-09-03T23:00:31.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 39674fcf-9601-439a-91da-884baecca3b7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6712024-09-03T23:00:32.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9ef26574-1f67-41e7-8e1f-355be89772ac roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6722024-09-03T23:00:32.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9ef26574-1f67-41e7-8e1f-355be89772ac resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6732024-09-03T23:00:32.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9ef26574-1f67-41e7-8e1f-355be89772ac response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6742024-09-03T23:00:33.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48e8b325-2b2b-4411-a21e-02bf393898c8 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6752024-09-03T23:00:33.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48e8b325-2b2b-4411-a21e-02bf393898c8 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6762024-09-03T23:00:33.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48e8b325-2b2b-4411-a21e-02bf393898c8 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
6772024-09-03T23:00:33.440ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40761
6782024-09-03T23:00:33.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40761 req_id = b77191ca-6df1-4959-b3bb-0bf53fd6b1f9 roles = RoleSet { roles: {} } uri = /metrics/producers
6792024-09-03T23:00:33.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40761 req_id = b77191ca-6df1-4959-b3bb-0bf53fd6b1f9 resource = Database result = Ok(()) uri = /metrics/producers
6802024-09-03T23:00:33.473ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
6812024-09-03T23:00:33.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40761 req_id = b77191ca-6df1-4959-b3bb-0bf53fd6b1f9 roles = RoleSet { roles: {} } uri = /metrics/producers
6822024-09-03T23:00:33.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40761 req_id = b77191ca-6df1-4959-b3bb-0bf53fd6b1f9 resource = Database result = Ok(()) uri = /metrics/producers
6832024-09-03T23:00:33.507ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
6842024-09-03T23:00:33.507ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d3188bbc-4c04-4506-b1b9-056620acc767", "date": "Tue, 03 Sep 2024 23:00:33 GMT"} })
6852024-09-03T23:00:33.507ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = a1a183ab-e40f-43f9-9004-475f15db5d85
6862024-09-03T23:00:33.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 70028 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40761 req_id = b77191ca-6df1-4959-b3bb-0bf53fd6b1f9 response_code = 201 uri = /metrics/producers
6872024-09-03T23:00:34.065ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
6882024-09-03T23:00:34.065ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
6892024-09-03T23:00:34.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6902024-09-03T23:00:34.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6912024-09-03T23:00:34.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6922024-09-03T23:00:34.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6932024-09-03T23:00:34.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6942024-09-03T23:00:34.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6952024-09-03T23:00:34.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6962024-09-03T23:00:34.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6972024-09-03T23:00:34.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6982024-09-03T23:00:34.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6992024-09-03T23:00:34.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7002024-09-03T23:00:34.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
7012024-09-03T23:00:34.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7022024-09-03T23:00:34.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7032024-09-03T23:00:34.084ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
7042024-09-03T23:00:34.084ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.014393ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
7052024-09-03T23:00:34.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7062024-09-03T23:00:34.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7072024-09-03T23:00:34.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.563565ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7082024-09-03T23:00:34.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0f25acc1-1e5e-4f28-b54e-e0bedcdf09f4 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7092024-09-03T23:00:34.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0f25acc1-1e5e-4f28-b54e-e0bedcdf09f4 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7102024-09-03T23:00:34.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0f25acc1-1e5e-4f28-b54e-e0bedcdf09f4 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7112024-09-03T23:00:35.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 835038b1-9faf-4b04-8491-5d34cfb1ec7d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7122024-09-03T23:00:35.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 835038b1-9faf-4b04-8491-5d34cfb1ec7d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7132024-09-03T23:00:35.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 835038b1-9faf-4b04-8491-5d34cfb1ec7d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7142024-09-03T23:00:36.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b1ba9223-a145-41c3-82ae-2ecb42792df6 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7152024-09-03T23:00:36.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b1ba9223-a145-41c3-82ae-2ecb42792df6 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7162024-09-03T23:00:36.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b1ba9223-a145-41c3-82ae-2ecb42792df6 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7172024-09-03T23:00:37.312ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1382 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 9813f9e0-19ff-45bd-bd57-ffd56cafd49b response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
7182024-09-03T23:00:37.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4f4e8292-53a3-4499-a10b-66dfb4885149 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7192024-09-03T23:00:37.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4f4e8292-53a3-4499-a10b-66dfb4885149 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7202024-09-03T23:00:37.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4f4e8292-53a3-4499-a10b-66dfb4885149 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7212024-09-03T23:00:38.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 38b7e4c7-b9f8-44cd-9d95-146fba3c02a3 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7222024-09-03T23:00:38.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 38b7e4c7-b9f8-44cd-9d95-146fba3c02a3 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7232024-09-03T23:00:38.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 38b7e4c7-b9f8-44cd-9d95-146fba3c02a3 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7242024-09-03T23:00:39.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7390f452-475f-425f-a5a4-536948c8fe52 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7252024-09-03T23:00:39.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7390f452-475f-425f-a5a4-536948c8fe52 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7262024-09-03T23:00:39.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7390f452-475f-425f-a5a4-536948c8fe52 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7272024-09-03T23:00:40.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 71581685-0a20-4cfb-8737-04a633f2a55e roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7282024-09-03T23:00:40.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 71581685-0a20-4cfb-8737-04a633f2a55e resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7292024-09-03T23:00:40.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 71581685-0a20-4cfb-8737-04a633f2a55e response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7302024-09-03T23:00:41.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ded5a38c-2eb4-409e-921a-ae21ed3364a9 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7312024-09-03T23:00:41.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ded5a38c-2eb4-409e-921a-ae21ed3364a9 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7322024-09-03T23:00:41.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ded5a38c-2eb4-409e-921a-ae21ed3364a9 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7332024-09-03T23:00:42.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c2cdb3a6-05fb-46f0-8891-8d93eb77d073 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7342024-09-03T23:00:42.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c2cdb3a6-05fb-46f0-8891-8d93eb77d073 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7352024-09-03T23:00:42.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c2cdb3a6-05fb-46f0-8891-8d93eb77d073 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7362024-09-03T23:00:43.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5be5b08f-9c90-452d-bdb2-6bdd8f7baeb2 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7372024-09-03T23:00:43.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5be5b08f-9c90-452d-bdb2-6bdd8f7baeb2 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7382024-09-03T23:00:43.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5be5b08f-9c90-452d-bdb2-6bdd8f7baeb2 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7392024-09-03T23:00:44.065ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
7402024-09-03T23:00:44.065ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
7412024-09-03T23:00:44.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7422024-09-03T23:00:44.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7432024-09-03T23:00:44.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7442024-09-03T23:00:44.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7452024-09-03T23:00:44.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7462024-09-03T23:00:44.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7472024-09-03T23:00:44.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482024-09-03T23:00:44.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7492024-09-03T23:00:44.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7502024-09-03T23:00:44.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7512024-09-03T23:00:44.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7522024-09-03T23:00:44.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7532024-09-03T23:00:44.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542024-09-03T23:00:44.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
7552024-09-03T23:00:44.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7562024-09-03T23:00:44.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7572024-09-03T23:00:44.084ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
7582024-09-03T23:00:44.084ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.507739ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
7592024-09-03T23:00:44.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.997036ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7602024-09-03T23:00:44.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c6531780-53f6-448d-9a43-5b326ab77638 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7612024-09-03T23:00:44.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c6531780-53f6-448d-9a43-5b326ab77638 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7622024-09-03T23:00:44.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c6531780-53f6-448d-9a43-5b326ab77638 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7632024-09-03T23:00:45.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 709b2c47-7c6c-4850-885d-7dcc45adbc52 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7642024-09-03T23:00:45.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 709b2c47-7c6c-4850-885d-7dcc45adbc52 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7652024-09-03T23:00:45.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 709b2c47-7c6c-4850-885d-7dcc45adbc52 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7662024-09-03T23:00:46.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbbcada6-c9c2-4824-90cc-4a1c857a2faa roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7672024-09-03T23:00:46.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbbcada6-c9c2-4824-90cc-4a1c857a2faa resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7682024-09-03T23:00:46.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbbcada6-c9c2-4824-90cc-4a1c857a2faa response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7692024-09-03T23:00:47.312ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1710 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 5bc96017-650d-4122-822a-d76366472b8e response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
7702024-09-03T23:00:47.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fb9a558c-1f86-49f2-a139-74d720c9f9be roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7712024-09-03T23:00:47.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fb9a558c-1f86-49f2-a139-74d720c9f9be resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7722024-09-03T23:00:47.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fb9a558c-1f86-49f2-a139-74d720c9f9be response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7732024-09-03T23:00:48.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c5dad5f5-e1f1-49bd-8610-e03f0961b6f6 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7742024-09-03T23:00:48.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c5dad5f5-e1f1-49bd-8610-e03f0961b6f6 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7752024-09-03T23:00:48.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c5dad5f5-e1f1-49bd-8610-e03f0961b6f6 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7762024-09-03T23:00:49.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c343a6d3-9d4f-4bd7-a2b6-7b44b7a61982 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7772024-09-03T23:00:49.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c343a6d3-9d4f-4bd7-a2b6-7b44b7a61982 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7782024-09-03T23:00:49.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c343a6d3-9d4f-4bd7-a2b6-7b44b7a61982 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7792024-09-03T23:00:50.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08cfe16d-3235-4073-ae04-a5afc0582366 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7802024-09-03T23:00:50.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08cfe16d-3235-4073-ae04-a5afc0582366 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7812024-09-03T23:00:50.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08cfe16d-3235-4073-ae04-a5afc0582366 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7822024-09-03T23:00:51.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d8b4905e-2770-4b54-872a-911b436361e2 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7832024-09-03T23:00:51.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d8b4905e-2770-4b54-872a-911b436361e2 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7842024-09-03T23:00:51.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d8b4905e-2770-4b54-872a-911b436361e2 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7852024-09-03T23:00:52.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 29268d8d-8b41-4525-9e0a-4c75e31fc25d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7862024-09-03T23:00:52.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 29268d8d-8b41-4525-9e0a-4c75e31fc25d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7872024-09-03T23:00:52.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 29268d8d-8b41-4525-9e0a-4c75e31fc25d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7882024-09-03T23:00:53.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6a4832aa-47e7-40d5-b3a5-738d77acb977 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7892024-09-03T23:00:53.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6a4832aa-47e7-40d5-b3a5-738d77acb977 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7902024-09-03T23:00:53.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6a4832aa-47e7-40d5-b3a5-738d77acb977 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
7912024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
7922024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
7932024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7942024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7952024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
7962024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
7972024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
7982024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
7992024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8002024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
8012024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8022024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
8032024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8042024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8052024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8062024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
8072024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
8082024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8092024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8102024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
8112024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8122024-09-03T23:00:54.064ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
8132024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8142024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
8152024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8162024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
8172024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8182024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8192024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
8202024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
8212024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
8222024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
8232024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8242024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8252024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8262024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8272024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8282024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8292024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8302024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8312024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8322024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8332024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8342024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
8352024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8362024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
8372024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8382024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8392024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8402024-09-03T23:00:54.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8412024-09-03T23:00:54.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8422024-09-03T23:00:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8432024-09-03T23:00:54.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8442024-09-03T23:00:54.068ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.592176ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8452024-09-03T23:00:54.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8462024-09-03T23:00:54.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8472024-09-03T23:00:54.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
8482024-09-03T23:00:54.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8492024-09-03T23:00:54.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8502024-09-03T23:00:54.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
8512024-09-03T23:00:54.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8522024-09-03T23:00:54.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8532024-09-03T23:00:54.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8542024-09-03T23:00:54.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8552024-09-03T23:00:54.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8562024-09-03T23:00:54.075ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1035, tv_nsec: 322453849 } })
8572024-09-03T23:00:54.076ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
8582024-09-03T23:00:54.076ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
8592024-09-03T23:00:54.076ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8602024-09-03T23:00:54.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8612024-09-03T23:00:54.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8622024-09-03T23:00:54.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.832011ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
8632024-09-03T23:00:54.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8642024-09-03T23:00:54.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8652024-09-03T23:00:54.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8662024-09-03T23:00:54.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8672024-09-03T23:00:54.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8682024-09-03T23:00:54.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
8692024-09-03T23:00:54.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8702024-09-03T23:00:54.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8712024-09-03T23:00:54.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1035, tv_nsec: 332301700 } })
8722024-09-03T23:00:54.086ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
8732024-09-03T23:00:54.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8742024-09-03T23:00:54.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8752024-09-03T23:00:54.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8762024-09-03T23:00:54.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8772024-09-03T23:00:54.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8782024-09-03T23:00:54.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8792024-09-03T23:00:54.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8802024-09-03T23:00:54.089ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8812024-09-03T23:00:54.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.698041ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8822024-09-03T23:00:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8832024-09-03T23:00:54.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8842024-09-03T23:00:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8852024-09-03T23:00:54.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8862024-09-03T23:00:54.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8872024-09-03T23:00:54.113ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8882024-09-03T23:00:54.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8892024-09-03T23:00:54.114ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.548104ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
8902024-09-03T23:00:54.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8912024-09-03T23:00:54.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8922024-09-03T23:00:54.115ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 50.911148ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
8932024-09-03T23:00:54.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8942024-09-03T23:00:54.118ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
8952024-09-03T23:00:54.118ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8962024-09-03T23:00:54.118ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8972024-09-03T23:00:54.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8982024-09-03T23:00:54.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
8992024-09-03T23:00:54.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9002024-09-03T23:00:54.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9012024-09-03T23:00:54.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9022024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9032024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.475676ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9042024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9052024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9062024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9072024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9082024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9092024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9102024-09-03T23:00:54.121ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.819699ms iteration = 12 status = 0
9112024-09-03T23:00:54.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9122024-09-03T23:00:54.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9132024-09-03T23:00:54.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9142024-09-03T23:00:54.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9152024-09-03T23:00:54.125ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
9162024-09-03T23:00:54.125ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9172024-09-03T23:00:54.125ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a7917601-6f7a-429b-9659-3b3a166522ae", "content-length": "26", "date": "Tue, 03 Sep 2024 23:00:54 GMT"} })
9182024-09-03T23:00:54.125ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9192024-09-03T23:00:54.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9202024-09-03T23:00:54.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9212024-09-03T23:00:54.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9222024-09-03T23:00:54.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
9232024-09-03T23:00:54.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9242024-09-03T23:00:54.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9252024-09-03T23:00:54.127ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9262024-09-03T23:00:54.130ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
9272024-09-03T23:00:54.130ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9282024-09-03T23:00:54.130ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cf24ec7a-3782-4144-aa22-5f206069fc95", "content-length": "26", "date": "Tue, 03 Sep 2024 23:00:54 GMT"} })
9292024-09-03T23:00:54.130ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9302024-09-03T23:00:54.131ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
9312024-09-03T23:00:54.135ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
9322024-09-03T23:00:54.135ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.289106ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
9332024-09-03T23:00:54.150ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9342024-09-03T23:00:54.150ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
9352024-09-03T23:00:54.150ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
9362024-09-03T23:00:54.150ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.609912ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
9372024-09-03T23:00:54.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9382024-09-03T23:00:54.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.520401ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
9392024-09-03T23:00:54.169ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 104.209962ms iteration = 12 status = {}
9402024-09-03T23:00:54.181ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1035, tv_nsec: 428607821 } })
9412024-09-03T23:00:54.182ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
9422024-09-03T23:00:54.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.147563ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
9432024-09-03T23:00:54.194ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.343067ms iteration = 15 status = {"physical_disks_added":0}
9442024-09-03T23:00:54.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9452024-09-03T23:00:54.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9462024-09-03T23:00:54.231ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9472024-09-03T23:00:54.233ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9482024-09-03T23:00:54.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9492024-09-03T23:00:54.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9502024-09-03T23:00:54.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9512024-09-03T23:00:54.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9522024-09-03T23:00:54.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9532024-09-03T23:00:54.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9542024-09-03T23:00:54.254ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
9552024-09-03T23:00:54.254ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9562024-09-03T23:00:54.255ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3a6c2fc5-cfeb-4ff1-9870-51644dcaa0cd", "content-length": "26", "date": "Tue, 03 Sep 2024 23:00:54 GMT"} })
9572024-09-03T23:00:54.255ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9582024-09-03T23:00:54.256ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9592024-09-03T23:00:54.276ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9602024-09-03T23:00:54.276ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ead143bd-3afb-497f-b0b6-4d04cadcd8a4", "content-length": "372", "date": "Tue, 03 Sep 2024 23:00:54 GMT"} })
9612024-09-03T23:00:54.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9622024-09-03T23:00:54.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9632024-09-03T23:00:54.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9642024-09-03T23:00:54.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9652024-09-03T23:00:54.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9662024-09-03T23:00:54.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9672024-09-03T23:00:54.284ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9682024-09-03T23:00:54.285ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7319ffeb-830a-4051-a421-b3617c4c28f4", "date": "Tue, 03 Sep 2024 23:00:54 GMT"} })
9692024-09-03T23:00:54.286ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 221.531626ms iteration = 13 status = {}
9702024-09-03T23:00:54.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9712024-09-03T23:00:54.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9722024-09-03T23:00:54.296ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 4a162852-b7fb-453d-8700-c28c90ceea1a, rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cfbbc591-5a71-4824-b45b-c64ca1770cd0) } rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
9732024-09-03T23:00:54.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9742024-09-03T23:00:54.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9752024-09-03T23:00:54.302ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
9762024-09-03T23:00:54.302ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2bb8bf51-5e6a-446b-956e-53930358b759", "content-length": "1", "date": "Tue, 03 Sep 2024 23:00:53 GMT"} })
9772024-09-03T23:00:54.303ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9782024-09-03T23:00:54.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9792024-09-03T23:00:54.305ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 240.508629ms iteration = 12 status = null
9802024-09-03T23:00:54.305ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
9812024-09-03T23:00:54.306ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ae09faf0-f788-4c82-a518-fa2790ef32c3", "content-length": "121", "date": "Tue, 03 Sep 2024 23:00:53 GMT"} })
9822024-09-03T23:00:54.306ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
9832024-09-03T23:00:54.306ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cfbbc591-5a71-4824-b45b-c64ca1770cd0
9842024-09-03T23:00:54.306ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9852024-09-03T23:00:54.306ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9862024-09-03T23:00:54.306ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
9872024-09-03T23:00:54.306ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
9882024-09-03T23:00:54.306ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
9892024-09-03T23:00:54.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9902024-09-03T23:00:54.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9912024-09-03T23:00:54.308ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9922024-09-03T23:00:54.308ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "293db45d-7eb5-4641-ad1a-49bc12a5b385", "content-length": "2", "date": "Tue, 03 Sep 2024 23:00:53 GMT"} })
9932024-09-03T23:00:54.308ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9942024-09-03T23:00:54.309ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "19232ba5-823f-4532-a6c6-9946e8543ccb", "content-length": "52", "date": "Tue, 03 Sep 2024 23:00:53 GMT"} })
9952024-09-03T23:00:54.309ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
9962024-09-03T23:00:54.309ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9972024-09-03T23:00:54.330ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9982024-09-03T23:00:54.410ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "360d4385-65a5-4453-913b-cd0c5f40a8b7", "date": "Tue, 03 Sep 2024 23:00:54 GMT"} })
9992024-09-03T23:00:54.410ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch = Switch0
10002024-09-03T23:00:54.410ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
10012024-09-03T23:00:54.410ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "88ab2448-aadc-4d39-8efd-392e94c9c91a", "content-length": "667", "date": "Tue, 03 Sep 2024 23:00:54 GMT"} })
10022024-09-03T23:00:54.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10032024-09-03T23:00:54.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10042024-09-03T23:00:54.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b865136-cdd5-41fb-90c7-cbe9448e64b0", "content-length": "691", "date": "Tue, 03 Sep 2024 23:00:54 GMT"} })
10052024-09-03T23:00:54.411ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
10062024-09-03T23:00:54.411ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
10072024-09-03T23:00:54.411ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
10082024-09-03T23:00:54.413ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 348.357747ms iteration = 12 status = {}
10092024-09-03T23:00:54.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10102024-09-03T23:00:54.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10112024-09-03T23:00:54.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10122024-09-03T23:00:54.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10132024-09-03T23:00:54.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10142024-09-03T23:00:54.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10152024-09-03T23:00:54.426ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 361.522682ms iteration = 12 status = {}
10162024-09-03T23:00:54.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f79a3c67-08dd-44a0-a8a9-b06a97c4b4ab roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10172024-09-03T23:00:54.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f79a3c67-08dd-44a0-a8a9-b06a97c4b4ab resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10182024-09-03T23:00:54.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f79a3c67-08dd-44a0-a8a9-b06a97c4b4ab response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10192024-09-03T23:00:54.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 4d998642-1537-478f-bbec-774970a2abf3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
10202024-09-03T23:00:54.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 4d998642-1537-478f-bbec-774970a2abf3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
10212024-09-03T23:00:55.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 4d998642-1537-478f-bbec-774970a2abf3 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
10222024-09-03T23:00:55.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 526f9537-baa4-4027-990c-4263d236b672 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10232024-09-03T23:00:55.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 526f9537-baa4-4027-990c-4263d236b672 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10242024-09-03T23:00:55.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 526f9537-baa4-4027-990c-4263d236b672 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10252024-09-03T23:00:56.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08153778-46c4-462d-b757-7b9a5289c942 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10262024-09-03T23:00:56.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08153778-46c4-462d-b757-7b9a5289c942 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10272024-09-03T23:00:56.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08153778-46c4-462d-b757-7b9a5289c942 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10282024-09-03T23:00:57.313ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1355 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = b080f713-4704-4612-afb0-cf9c7311fc30 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
10292024-09-03T23:00:57.316ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
10302024-09-03T23:00:57.316ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
10312024-09-03T23:00:57.346ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
10322024-09-03T23:00:57.346ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:61491
10332024-09-03T23:00:57.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61491 req_id = f1a82db5-de5d-44db-b8cf-9cdcabea411a roles = RoleSet { roles: {} } uri = /metrics/producers
10342024-09-03T23:00:57.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61491 req_id = f1a82db5-de5d-44db-b8cf-9cdcabea411a resource = Database result = Ok(()) uri = /metrics/producers
10352024-09-03T23:00:57.379ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
10362024-09-03T23:00:57.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61491 req_id = f1a82db5-de5d-44db-b8cf-9cdcabea411a roles = RoleSet { roles: {} } uri = /metrics/producers
10372024-09-03T23:00:57.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61491 req_id = f1a82db5-de5d-44db-b8cf-9cdcabea411a resource = Database result = Ok(()) uri = /metrics/producers
10382024-09-03T23:00:57.386ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
10392024-09-03T23:00:57.387ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9576873b-e6e0-4084-ab66-90a25b0cfa63", "date": "Tue, 03 Sep 2024 23:00:57 GMT"} })
10402024-09-03T23:00:57.387ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
10412024-09-03T23:00:57.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 41643 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61491 req_id = f1a82db5-de5d-44db-b8cf-9cdcabea411a response_code = 201 uri = /metrics/producers
10422024-09-03T23:00:57.388ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "f1a82db5-de5d-44db-b8cf-9cdcabea411a", "content-length": "41", "date": "Tue, 03 Sep 2024 23:00:56 GMT"} })
10432024-09-03T23:00:57.389ZDEBGnexus (producer-registration-task): registered with nexus successfully
10442024-09-03T23:00:57.389ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
10452024-09-03T23:00:57.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2d1ba61a-7137-4609-af7d-7924ec4f201c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10462024-09-03T23:00:57.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2d1ba61a-7137-4609-af7d-7924ec4f201c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10472024-09-03T23:00:57.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2d1ba61a-7137-4609-af7d-7924ec4f201c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10482024-09-03T23:00:58.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = aa3578fd-7f6a-4300-823f-04b6cfcdc7b7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10492024-09-03T23:00:58.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = aa3578fd-7f6a-4300-823f-04b6cfcdc7b7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10502024-09-03T23:00:58.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = aa3578fd-7f6a-4300-823f-04b6cfcdc7b7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10512024-09-03T23:00:59.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08ef6887-f9e0-4d7a-ba4f-cc10790b3d2c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10522024-09-03T23:00:59.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08ef6887-f9e0-4d7a-ba4f-cc10790b3d2c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10532024-09-03T23:00:59.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 08ef6887-f9e0-4d7a-ba4f-cc10790b3d2c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10542024-09-03T23:01:00.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 544c8f16-da1f-4abf-9d08-22c297626bc7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10552024-09-03T23:01:00.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 544c8f16-da1f-4abf-9d08-22c297626bc7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10562024-09-03T23:01:00.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 544c8f16-da1f-4abf-9d08-22c297626bc7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10572024-09-03T23:01:01.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cb968724-86d9-4f18-b16f-f40a16a65cf5 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10582024-09-03T23:01:01.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cb968724-86d9-4f18-b16f-f40a16a65cf5 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10592024-09-03T23:01:01.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1687 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cb968724-86d9-4f18-b16f-f40a16a65cf5 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10602024-09-03T23:01:02.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0c0bca3d-c008-4700-8105-49e7829f6c88 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10612024-09-03T23:01:02.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0c0bca3d-c008-4700-8105-49e7829f6c88 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10622024-09-03T23:01:02.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0c0bca3d-c008-4700-8105-49e7829f6c88 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10632024-09-03T23:01:03.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9da9ed2f-ea52-4d36-b9e2-83698aab2d5c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10642024-09-03T23:01:03.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9da9ed2f-ea52-4d36-b9e2-83698aab2d5c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10652024-09-03T23:01:03.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9da9ed2f-ea52-4d36-b9e2-83698aab2d5c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10662024-09-03T23:01:04.064ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
10672024-09-03T23:01:04.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10682024-09-03T23:01:04.064ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
10692024-09-03T23:01:04.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10702024-09-03T23:01:04.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10712024-09-03T23:01:04.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10722024-09-03T23:01:04.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10732024-09-03T23:01:04.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10742024-09-03T23:01:04.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10752024-09-03T23:01:04.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10762024-09-03T23:01:04.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10772024-09-03T23:01:04.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10782024-09-03T23:01:04.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10792024-09-03T23:01:04.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
10802024-09-03T23:01:04.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10812024-09-03T23:01:04.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10822024-09-03T23:01:04.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
10832024-09-03T23:01:04.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.030765ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
10842024-09-03T23:01:04.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10852024-09-03T23:01:04.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10862024-09-03T23:01:04.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.855239ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10872024-09-03T23:01:04.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 11dcc680-c925-4c38-854f-04587f5c196a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10882024-09-03T23:01:04.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 11dcc680-c925-4c38-854f-04587f5c196a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10892024-09-03T23:01:04.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 11dcc680-c925-4c38-854f-04587f5c196a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10902024-09-03T23:01:05.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8af4db53-9935-4448-b6e1-139992588638 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10912024-09-03T23:01:05.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8af4db53-9935-4448-b6e1-139992588638 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10922024-09-03T23:01:05.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8af4db53-9935-4448-b6e1-139992588638 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10932024-09-03T23:01:06.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fdb7e8c7-d75f-4ff2-90c7-ea46567fda9d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10942024-09-03T23:01:06.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fdb7e8c7-d75f-4ff2-90c7-ea46567fda9d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10952024-09-03T23:01:06.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fdb7e8c7-d75f-4ff2-90c7-ea46567fda9d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10962024-09-03T23:01:07.390ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1533 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 9c4d3514-be86-48d4-94d0-162b339661ed response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
10972024-09-03T23:01:07.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4e01217d-93f8-48b5-b510-9e889c2aa380 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10982024-09-03T23:01:07.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4e01217d-93f8-48b5-b510-9e889c2aa380 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
10992024-09-03T23:01:07.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4e01217d-93f8-48b5-b510-9e889c2aa380 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11002024-09-03T23:01:08.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 44625a53-99d4-438c-aa2d-4d37ee6e03a7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11012024-09-03T23:01:08.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 44625a53-99d4-438c-aa2d-4d37ee6e03a7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11022024-09-03T23:01:08.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 44625a53-99d4-438c-aa2d-4d37ee6e03a7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11032024-09-03T23:01:10.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fcc762cf-1f1c-4306-a6f7-6974403f1d47 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11042024-09-03T23:01:10.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fcc762cf-1f1c-4306-a6f7-6974403f1d47 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11052024-09-03T23:01:10.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1722 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fcc762cf-1f1c-4306-a6f7-6974403f1d47 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11062024-09-03T23:01:11.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f9a6f168-0436-4361-ad7a-661f9c0a60f4 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11072024-09-03T23:01:11.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f9a6f168-0436-4361-ad7a-661f9c0a60f4 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11082024-09-03T23:01:11.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f9a6f168-0436-4361-ad7a-661f9c0a60f4 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11092024-09-03T23:01:12.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d370996a-f155-45c8-a691-fde4d22162ab roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11102024-09-03T23:01:12.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d370996a-f155-45c8-a691-fde4d22162ab resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11112024-09-03T23:01:12.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d370996a-f155-45c8-a691-fde4d22162ab response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11122024-09-03T23:01:13.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5bc8460b-5ebf-4693-8cdf-b22cf4489ffb roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11132024-09-03T23:01:13.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5bc8460b-5ebf-4693-8cdf-b22cf4489ffb resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11142024-09-03T23:01:13.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5bc8460b-5ebf-4693-8cdf-b22cf4489ffb response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11152024-09-03T23:01:14.065ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
11162024-09-03T23:01:14.065ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11172024-09-03T23:01:14.065ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
11182024-09-03T23:01:14.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11192024-09-03T23:01:14.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11202024-09-03T23:01:14.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11212024-09-03T23:01:14.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11222024-09-03T23:01:14.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11232024-09-03T23:01:14.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242024-09-03T23:01:14.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.434715ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11252024-09-03T23:01:14.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11262024-09-03T23:01:14.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11272024-09-03T23:01:14.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11282024-09-03T23:01:14.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11292024-09-03T23:01:14.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11302024-09-03T23:01:14.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312024-09-03T23:01:14.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
11322024-09-03T23:01:14.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11332024-09-03T23:01:14.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11342024-09-03T23:01:14.082ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
11352024-09-03T23:01:14.082ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.440558ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
11362024-09-03T23:01:14.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc928ffa-6057-4c46-9d77-4d93ebe4b95d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11372024-09-03T23:01:14.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc928ffa-6057-4c46-9d77-4d93ebe4b95d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11382024-09-03T23:01:14.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc928ffa-6057-4c46-9d77-4d93ebe4b95d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11392024-09-03T23:01:15.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 26409fa0-0712-4833-9364-3fcbca7b8242 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11402024-09-03T23:01:15.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 26409fa0-0712-4833-9364-3fcbca7b8242 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11412024-09-03T23:01:15.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 26409fa0-0712-4833-9364-3fcbca7b8242 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11422024-09-03T23:01:16.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 568e88af-cae7-427e-9056-ec20261b2495 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11432024-09-03T23:01:16.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 568e88af-cae7-427e-9056-ec20261b2495 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11442024-09-03T23:01:16.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 568e88af-cae7-427e-9056-ec20261b2495 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11452024-09-03T23:01:17.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9732ac24-e609-46d9-ac73-01ef715677ab roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11462024-09-03T23:01:17.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9732ac24-e609-46d9-ac73-01ef715677ab resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11472024-09-03T23:01:17.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9732ac24-e609-46d9-ac73-01ef715677ab response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11482024-09-03T23:01:17.390ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 44aca5d7-a8dd-49e0-ab7e-5aedfc18125d response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
11492024-09-03T23:01:18.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7e7cb2de-6be8-4ac6-ab3b-451b3f799701 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11502024-09-03T23:01:18.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7e7cb2de-6be8-4ac6-ab3b-451b3f799701 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11512024-09-03T23:01:18.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7e7cb2de-6be8-4ac6-ab3b-451b3f799701 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11522024-09-03T23:01:19.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0097e956-2de8-4fb0-936e-de9ea51b7396 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11532024-09-03T23:01:19.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0097e956-2de8-4fb0-936e-de9ea51b7396 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11542024-09-03T23:01:19.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0097e956-2de8-4fb0-936e-de9ea51b7396 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11552024-09-03T23:01:20.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 17666b3e-1bf7-4c4e-ad4a-1d5d4e8e8981 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11562024-09-03T23:01:20.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 17666b3e-1bf7-4c4e-ad4a-1d5d4e8e8981 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11572024-09-03T23:01:20.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 17666b3e-1bf7-4c4e-ad4a-1d5d4e8e8981 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11582024-09-03T23:01:21.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ec939449-a8c8-48ba-be4a-7c93ccc8feda roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11592024-09-03T23:01:21.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ec939449-a8c8-48ba-be4a-7c93ccc8feda resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11602024-09-03T23:01:21.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ec939449-a8c8-48ba-be4a-7c93ccc8feda response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11612024-09-03T23:01:22.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ff792f2c-6fb4-41b5-bbd2-3b455d87295f roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11622024-09-03T23:01:22.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ff792f2c-6fb4-41b5-bbd2-3b455d87295f resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11632024-09-03T23:01:22.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ff792f2c-6fb4-41b5-bbd2-3b455d87295f response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11642024-09-03T23:01:23.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6541ca50-7370-46b2-8bf0-839569881dc9 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11652024-09-03T23:01:23.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6541ca50-7370-46b2-8bf0-839569881dc9 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11662024-09-03T23:01:23.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6541ca50-7370-46b2-8bf0-839569881dc9 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
11672024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
11682024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
11692024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11702024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11712024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
11722024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11732024-09-03T23:01:24.066ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 22:51:24.066124595 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11742024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11752024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
11762024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
11772024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
11782024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11792024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11802024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
11812024-09-03T23:01:24.066ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
11822024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
11832024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11842024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11852024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
11862024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11872024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11882024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
11892024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
11902024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11912024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
11922024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
11932024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
11942024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11952024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
11962024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11972024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11982024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
11992024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
12002024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12012024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
12022024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
12032024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12042024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
12052024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
12062024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
12072024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12082024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
12092024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12102024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
12112024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
12122024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12132024-09-03T23:01:24.066ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc
12142024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.36\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc"}
12152024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
12162024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12172024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
12182024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12192024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
12202024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
12212024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12222024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
12232024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
12242024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12252024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12262024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
12272024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
12282024-09-03T23:01:24.066ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
12292024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
12302024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12312024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
12322024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12332024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12342024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12352024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12362024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12372024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12382024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12392024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
12402024-09-03T23:01:24.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12412024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12422024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12432024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12442024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12452024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12462024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12472024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12482024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12492024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12502024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12512024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
12522024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12532024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12542024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12552024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12562024-09-03T23:01:24.067ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d574b3d-97ce-4fc4-8255-27d61ab35e88.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9e590c60-1cc5-4f4c-8ae9-48abc39cb394.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 312819318 } })
12572024-09-03T23:01:24.067ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5278d774-fcf6-40b9-b896-4e3af31c54b8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 312930090 } })
12582024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12592024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12602024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12612024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12622024-09-03T23:01:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12632024-09-03T23:01:24.068ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
12642024-09-03T23:01:24.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.397714ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
12652024-09-03T23:01:24.068ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
12662024-09-03T23:01:24.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.674857ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
12672024-09-03T23:01:24.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12682024-09-03T23:01:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12692024-09-03T23:01:24.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12702024-09-03T23:01:24.070ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 22:51:24.066124595 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
12712024-09-03T23:01:24.070ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.272974ms iteration = 7 status = {"expiration":"2024-09-03T22:51:24.066124595Z","pruned":[]}
12722024-09-03T23:01:24.070ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.157092ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12732024-09-03T23:01:24.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.489945ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
12742024-09-03T23:01:24.071ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12752024-09-03T23:01:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12762024-09-03T23:01:24.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12772024-09-03T23:01:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12782024-09-03T23:01:24.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
12792024-09-03T23:01:24.074ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12802024-09-03T23:01:24.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12812024-09-03T23:01:24.075ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822024-09-03T23:01:24.075ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12832024-09-03T23:01:24.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12842024-09-03T23:01:24.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12852024-09-03T23:01:24.076ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
12862024-09-03T23:01:24.076ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12872024-09-03T23:01:24.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12882024-09-03T23:01:24.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12892024-09-03T23:01:24.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12902024-09-03T23:01:24.078ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12912024-09-03T23:01:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12922024-09-03T23:01:24.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12932024-09-03T23:01:24.079ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12942024-09-03T23:01:24.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12952024-09-03T23:01:24.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12962024-09-03T23:01:24.080ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12972024-09-03T23:01:24.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12982024-09-03T23:01:24.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12992024-09-03T23:01:24.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13002024-09-03T23:01:24.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13012024-09-03T23:01:24.080ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.542718ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
13022024-09-03T23:01:24.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13032024-09-03T23:01:24.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13042024-09-03T23:01:24.083ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 328866582 } })
13052024-09-03T23:01:24.083ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13062024-09-03T23:01:24.083ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
13072024-09-03T23:01:24.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082024-09-03T23:01:24.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13092024-09-03T23:01:24.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 330609890 } })
13102024-09-03T23:01:24.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
13112024-09-03T23:01:24.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13122024-09-03T23:01:24.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13132024-09-03T23:01:24.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13142024-09-03T23:01:24.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13152024-09-03T23:01:24.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13162024-09-03T23:01:24.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13172024-09-03T23:01:24.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13182024-09-03T23:01:24.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13192024-09-03T23:01:24.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13202024-09-03T23:01:24.092ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13212024-09-03T23:01:24.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13222024-09-03T23:01:24.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13232024-09-03T23:01:24.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13242024-09-03T23:01:24.094ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13252024-09-03T23:01:24.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13262024-09-03T23:01:24.094ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13272024-09-03T23:01:24.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13282024-09-03T23:01:24.096ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13292024-09-03T23:01:24.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13302024-09-03T23:01:24.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13312024-09-03T23:01:24.102ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1065, tv_nsec: 347959186 } })
13322024-09-03T23:01:24.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13332024-09-03T23:01:24.102ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
13342024-09-03T23:01:24.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13352024-09-03T23:01:24.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13362024-09-03T23:01:24.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13372024-09-03T23:01:24.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13382024-09-03T23:01:24.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13392024-09-03T23:01:24.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13402024-09-03T23:01:24.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13412024-09-03T23:01:24.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13422024-09-03T23:01:24.113ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13432024-09-03T23:01:24.113ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13442024-09-03T23:01:24.113ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13452024-09-03T23:01:24.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13462024-09-03T23:01:24.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13472024-09-03T23:01:24.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13482024-09-03T23:01:24.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13492024-09-03T23:01:24.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13502024-09-03T23:01:24.119ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13512024-09-03T23:01:24.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13522024-09-03T23:01:24.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
13532024-09-03T23:01:24.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13542024-09-03T23:01:24.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13552024-09-03T23:01:24.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13562024-09-03T23:01:24.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13572024-09-03T23:01:24.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13582024-09-03T23:01:24.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13592024-09-03T23:01:24.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13602024-09-03T23:01:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13612024-09-03T23:01:24.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13622024-09-03T23:01:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13632024-09-03T23:01:24.129ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13642024-09-03T23:01:24.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13652024-09-03T23:01:24.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13662024-09-03T23:01:24.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13672024-09-03T23:01:24.142ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13682024-09-03T23:01:24.143ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.472519ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
13692024-09-03T23:01:24.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13702024-09-03T23:01:24.144ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13712024-09-03T23:01:24.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13722024-09-03T23:01:24.144ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
13732024-09-03T23:01:24.144ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
13742024-09-03T23:01:24.144ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.512109ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
13752024-09-03T23:01:24.145ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
13762024-09-03T23:01:24.145ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.444738ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
13772024-09-03T23:01:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13782024-09-03T23:01:24.146ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13792024-09-03T23:01:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13802024-09-03T23:01:24.146ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13812024-09-03T23:01:24.147ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13822024-09-03T23:01:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13832024-09-03T23:01:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13842024-09-03T23:01:24.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13852024-09-03T23:01:24.149ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13862024-09-03T23:01:24.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13872024-09-03T23:01:24.149ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
13882024-09-03T23:01:24.149ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
13892024-09-03T23:01:24.149ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 82.834174ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
13902024-09-03T23:01:24.150ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13912024-09-03T23:01:24.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13922024-09-03T23:01:24.150ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.151997ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13932024-09-03T23:01:24.152ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 85.791414ms iteration = 4 status = {"nsuccess":5}
13942024-09-03T23:01:24.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13952024-09-03T23:01:24.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13962024-09-03T23:01:24.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13972024-09-03T23:01:24.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13982024-09-03T23:01:24.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13992024-09-03T23:01:24.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14002024-09-03T23:01:24.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012024-09-03T23:01:24.157ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
14022024-09-03T23:01:24.157ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14032024-09-03T23:01:24.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14042024-09-03T23:01:24.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14052024-09-03T23:01:24.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14062024-09-03T23:01:24.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14072024-09-03T23:01:24.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
14082024-09-03T23:01:24.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14092024-09-03T23:01:24.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14102024-09-03T23:01:24.164ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.238451ms iteration = 13 status = 0
14112024-09-03T23:01:24.175ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
14122024-09-03T23:01:24.175ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
14132024-09-03T23:01:24.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14142024-09-03T23:01:24.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14152024-09-03T23:01:24.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14162024-09-03T23:01:24.178ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14172024-09-03T23:01:24.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14182024-09-03T23:01:24.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14192024-09-03T23:01:24.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14202024-09-03T23:01:24.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14212024-09-03T23:01:24.182ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
14222024-09-03T23:01:24.182ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14232024-09-03T23:01:24.182ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 22:55:55.157084 UTC dns_group = external generation = 2
14242024-09-03T23:01:24.182ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 116.589377ms iteration = 8 status = {"generation":2}
14252024-09-03T23:01:24.190ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
14262024-09-03T23:01:24.190ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14272024-09-03T23:01:24.190ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.617399ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
14282024-09-03T23:01:24.192ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.485348ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
14292024-09-03T23:01:24.194ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.870382ms iteration = 16 status = {"physical_disks_added":0}
14302024-09-03T23:01:24.198ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
14312024-09-03T23:01:24.198ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
14322024-09-03T23:01:24.198ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
14332024-09-03T23:01:24.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14342024-09-03T23:01:24.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14352024-09-03T23:01:24.200ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 134.327068ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14362024-09-03T23:01:24.201ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-09-03T23:01:24.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.52963ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14382024-09-03T23:01:24.203ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14392024-09-03T23:01:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14402024-09-03T23:01:24.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14412024-09-03T23:01:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14422024-09-03T23:01:24.218ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14432024-09-03T23:01:24.220ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14442024-09-03T23:01:24.220ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14452024-09-03T23:01:24.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14462024-09-03T23:01:24.225ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14472024-09-03T23:01:24.225ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14482024-09-03T23:01:24.225ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f6f63ea7-841d-49d3-8401-9f3baed26cf2", "content-length": "26", "date": "Tue, 03 Sep 2024 23:01:23 GMT"} })
14492024-09-03T23:01:24.225ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14502024-09-03T23:01:24.227ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14512024-09-03T23:01:24.241ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14522024-09-03T23:01:24.241ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14532024-09-03T23:01:24.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14542024-09-03T23:01:24.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14552024-09-03T23:01:24.242ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14562024-09-03T23:01:24.242ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 175.82789ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14572024-09-03T23:01:24.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14582024-09-03T23:01:24.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14592024-09-03T23:01:24.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14602024-09-03T23:01:24.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14612024-09-03T23:01:24.246ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
14622024-09-03T23:01:24.246ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14632024-09-03T23:01:24.247ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b2df67fb-3ea4-4c62-8c83-97588c5148e2", "content-length": "26", "date": "Tue, 03 Sep 2024 23:01:23 GMT"} })
14642024-09-03T23:01:24.247ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14652024-09-03T23:01:24.248ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
14662024-09-03T23:01:24.248ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14672024-09-03T23:01:24.248ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 22:55:54.269593 UTC dns_group = internal generation = 1
14682024-09-03T23:01:24.248ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 182.514918ms iteration = 8 status = {"generation":1}
14692024-09-03T23:01:24.249ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14702024-09-03T23:01:24.253ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T22:55:21.166044Z, time_modified: 2024-09-03T22:55:21.166044Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }) }
14712024-09-03T23:01:24.253ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 186.949514ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]}},"default_endpoint":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14722024-09-03T23:01:24.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14732024-09-03T23:01:24.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14742024-09-03T23:01:24.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14752024-09-03T23:01:24.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14762024-09-03T23:01:24.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14772024-09-03T23:01:24.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14782024-09-03T23:01:24.287ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
14792024-09-03T23:01:24.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = aac9ef4b-6dae-40ea-9d3f-612125c55d96 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
14802024-09-03T23:01:24.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = aac9ef4b-6dae-40ea-9d3f-612125c55d96 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
14812024-09-03T23:01:24.407ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 341.145754ms iteration = 13 status = {}
14822024-09-03T23:01:24.436ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
14832024-09-03T23:01:24.436ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14842024-09-03T23:01:24.437ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e82c1d8e-5d58-4e5c-bbea-74f4056e3f63", "content-length": "26", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
14852024-09-03T23:01:24.437ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14862024-09-03T23:01:24.439ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
14872024-09-03T23:01:24.492ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
14882024-09-03T23:01:24.547ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14892024-09-03T23:01:24.548ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902024-09-03T23:01:24.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 219442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = aac9ef4b-6dae-40ea-9d3f-612125c55d96 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
14912024-09-03T23:01:24.550ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14922024-09-03T23:01:24.550ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14932024-09-03T23:01:24.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14942024-09-03T23:01:24.555ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8ca733ac-9db4-46bf-9f8c-bdea5c6e5faa", "content-length": "372", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
14952024-09-03T23:01:24.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14962024-09-03T23:01:24.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14972024-09-03T23:01:24.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14982024-09-03T23:01:24.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14992024-09-03T23:01:24.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15002024-09-03T23:01:24.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15012024-09-03T23:01:24.564ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15022024-09-03T23:01:24.565ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c4184727-4e7d-4db5-b09e-5014c5fc925b", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
15032024-09-03T23:01:24.566ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 500.036202ms iteration = 14 status = {}
15042024-09-03T23:01:24.606ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15052024-09-03T23:01:24.606ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e19fe1c7-167b-4da4-80e6-52312c9bb139", "content-length": "1", "date": "Tue, 03 Sep 2024 23:01:23 GMT"} })
15062024-09-03T23:01:24.608ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15072024-09-03T23:01:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15082024-09-03T23:01:24.609ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15092024-09-03T23:01:24.609ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "55837ad5-b06d-4a97-ad50-b5e7cdb065e8", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15102024-09-03T23:01:24.609ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15112024-09-03T23:01:24.611ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ae53b641-c2d9-42c5-8f06-818adffc66e1", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15122024-09-03T23:01:24.611ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15132024-09-03T23:01:24.613ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
15142024-09-03T23:01:24.613ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 547.108211ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
15152024-09-03T23:01:24.638ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15162024-09-03T23:01:24.638ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1655e5ed-086b-44ba-bb8f-4d6e942a71b2", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
15172024-09-03T23:01:24.638ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
15182024-09-03T23:01:24.640ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e441b559-53b3-41c4-bd11-47363157b350", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
15192024-09-03T23:01:24.640ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
15202024-09-03T23:01:24.642ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "67c2bb20-2258-4de4-b3f0-1eb901b1dd07", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
15212024-09-03T23:01:24.642ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
15222024-09-03T23:01:24.644ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
15232024-09-03T23:01:24.644ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 578.235208ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
15242024-09-03T23:01:24.648ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15252024-09-03T23:01:24.649ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4d0b6821-cbd7-4675-b978-9a87b414e217", "content-length": "691", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
15262024-09-03T23:01:24.649ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15272024-09-03T23:01:24.649ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15282024-09-03T23:01:24.649ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15292024-09-03T23:01:24.650ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 583.763194ms iteration = 13 status = {}
15302024-09-03T23:01:24.651ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 584.555612ms iteration = 13 status = null
15312024-09-03T23:01:24.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15322024-09-03T23:01:24.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15332024-09-03T23:01:24.688ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 4a162852-b7fb-453d-8700-c28c90ceea1a, rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cfbbc591-5a71-4824-b45b-c64ca1770cd0) } rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
15342024-09-03T23:01:24.688ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15352024-09-03T23:01:24.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15362024-09-03T23:01:24.694ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15372024-09-03T23:01:24.695ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b98c57da-97ea-46e9-bc63-62e3ccd3c3c0", "content-length": "121", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
15382024-09-03T23:01:24.695ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
15392024-09-03T23:01:24.695ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cfbbc591-5a71-4824-b45b-c64ca1770cd0
15402024-09-03T23:01:24.695ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15412024-09-03T23:01:24.695ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15422024-09-03T23:01:24.695ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
15432024-09-03T23:01:24.695ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
15442024-09-03T23:01:24.695ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
15452024-09-03T23:01:24.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15462024-09-03T23:01:24.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15472024-09-03T23:01:24.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15482024-09-03T23:01:24.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d8098c65-950e-4e80-a890-4da406172270", "content-length": "2", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
15492024-09-03T23:01:24.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15502024-09-03T23:01:24.697ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ee1101b1-82bc-4823-939d-7a90d07cef28", "content-length": "52", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
15512024-09-03T23:01:24.697ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
15522024-09-03T23:01:24.697ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15532024-09-03T23:01:24.791ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2b4baaf2-daf9-4b45-9b41-7401de0109ea", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
15542024-09-03T23:01:24.791ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch = Switch0
15552024-09-03T23:01:24.791ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15562024-09-03T23:01:24.792ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f115dd92-34d1-4029-9ab4-d25348440e51", "content-length": "667", "date": "Tue, 03 Sep 2024 23:01:24 GMT"} })
15572024-09-03T23:01:24.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15582024-09-03T23:01:24.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15592024-09-03T23:01:24.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15602024-09-03T23:01:24.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15612024-09-03T23:01:24.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15622024-09-03T23:01:24.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15632024-09-03T23:01:24.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15642024-09-03T23:01:24.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15652024-09-03T23:01:24.809ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 743.494671ms iteration = 13 status = {}
15662024-09-03T23:01:25.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = db599633-1fa1-4c8d-8e76-687cf9c9b2b7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
15672024-09-03T23:01:25.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = db599633-1fa1-4c8d-8e76-687cf9c9b2b7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
15682024-09-03T23:01:25.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = db599633-1fa1-4c8d-8e76-687cf9c9b2b7 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
15692024-09-03T23:01:25.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2df1ad81-45ed-413f-9a4a-f89b1e8bf273 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15702024-09-03T23:01:25.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2df1ad81-45ed-413f-9a4a-f89b1e8bf273 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15712024-09-03T23:01:25.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2df1ad81-45ed-413f-9a4a-f89b1e8bf273 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15722024-09-03T23:01:26.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 414e0314-8d4b-4c5d-9fd5-d8f830073431 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15732024-09-03T23:01:26.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 414e0314-8d4b-4c5d-9fd5-d8f830073431 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15742024-09-03T23:01:26.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 414e0314-8d4b-4c5d-9fd5-d8f830073431 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15752024-09-03T23:01:27.390ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1324 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = bf023711-198a-4443-8c51-3e0e7f9fe196 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
15762024-09-03T23:01:27.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f68895f3-6d83-4f9f-8580-f7038b95880f roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15772024-09-03T23:01:27.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f68895f3-6d83-4f9f-8580-f7038b95880f resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15782024-09-03T23:01:27.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f68895f3-6d83-4f9f-8580-f7038b95880f response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15792024-09-03T23:01:28.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3c1b159c-9d0b-41f3-bd46-13beb5250370 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15802024-09-03T23:01:28.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3c1b159c-9d0b-41f3-bd46-13beb5250370 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15812024-09-03T23:01:28.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3c1b159c-9d0b-41f3-bd46-13beb5250370 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15822024-09-03T23:01:29.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a8eb77b7-4ec3-4eb2-a216-d8aebf3bd296 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15832024-09-03T23:01:29.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a8eb77b7-4ec3-4eb2-a216-d8aebf3bd296 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15842024-09-03T23:01:29.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a8eb77b7-4ec3-4eb2-a216-d8aebf3bd296 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15852024-09-03T23:01:30.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 72a5e7ba-da48-46c1-b6ab-1e6bfabb37e1 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15862024-09-03T23:01:30.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 72a5e7ba-da48-46c1-b6ab-1e6bfabb37e1 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15872024-09-03T23:01:30.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 72a5e7ba-da48-46c1-b6ab-1e6bfabb37e1 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15882024-09-03T23:01:31.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cff20e52-1420-41b3-b7b7-8f16503d1af1 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15892024-09-03T23:01:31.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cff20e52-1420-41b3-b7b7-8f16503d1af1 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15902024-09-03T23:01:31.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cff20e52-1420-41b3-b7b7-8f16503d1af1 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15912024-09-03T23:01:32.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 227f06ca-423a-42f1-a9f4-29b088355aad roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15922024-09-03T23:01:32.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 227f06ca-423a-42f1-a9f4-29b088355aad resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15932024-09-03T23:01:32.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 227f06ca-423a-42f1-a9f4-29b088355aad response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15942024-09-03T23:01:33.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b69d5d42-3174-41a5-a3b3-8e815ebb0a19 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15952024-09-03T23:01:33.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b69d5d42-3174-41a5-a3b3-8e815ebb0a19 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15962024-09-03T23:01:33.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b69d5d42-3174-41a5-a3b3-8e815ebb0a19 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
15972024-09-03T23:01:34.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
15982024-09-03T23:01:34.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15992024-09-03T23:01:34.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
16002024-09-03T23:01:34.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16012024-09-03T23:01:34.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16022024-09-03T23:01:34.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16032024-09-03T23:01:34.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16042024-09-03T23:01:34.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16052024-09-03T23:01:34.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16062024-09-03T23:01:34.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16072024-09-03T23:01:34.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16082024-09-03T23:01:34.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16092024-09-03T23:01:34.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16102024-09-03T23:01:34.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
16112024-09-03T23:01:34.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16122024-09-03T23:01:34.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16132024-09-03T23:01:34.085ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
16142024-09-03T23:01:34.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.837932ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
16152024-09-03T23:01:34.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16162024-09-03T23:01:34.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16172024-09-03T23:01:34.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.460495ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16182024-09-03T23:01:34.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 35f2353b-0095-41be-b28e-6c7bb09c7e13 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16192024-09-03T23:01:34.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 35f2353b-0095-41be-b28e-6c7bb09c7e13 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16202024-09-03T23:01:34.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 35f2353b-0095-41be-b28e-6c7bb09c7e13 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16212024-09-03T23:01:35.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0beed654-9970-4f81-a5f2-3edbc69cb905 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16222024-09-03T23:01:35.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0beed654-9970-4f81-a5f2-3edbc69cb905 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16232024-09-03T23:01:35.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0beed654-9970-4f81-a5f2-3edbc69cb905 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16242024-09-03T23:01:36.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8d17b678-33b7-4287-9b37-9032229bf992 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16252024-09-03T23:01:36.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8d17b678-33b7-4287-9b37-9032229bf992 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16262024-09-03T23:01:36.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1464 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8d17b678-33b7-4287-9b37-9032229bf992 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16272024-09-03T23:01:37.391ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 50a2e1ae-6938-4004-881e-2aa57d457447 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
16282024-09-03T23:01:37.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 22284f69-bddf-4b63-8a5b-447bcd34a7ea roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16292024-09-03T23:01:37.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 22284f69-bddf-4b63-8a5b-447bcd34a7ea resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16302024-09-03T23:01:37.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 22284f69-bddf-4b63-8a5b-447bcd34a7ea response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16312024-09-03T23:01:38.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3ee7a538-1ac2-4210-9aa9-8869912ea1d7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16322024-09-03T23:01:38.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3ee7a538-1ac2-4210-9aa9-8869912ea1d7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16332024-09-03T23:01:38.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3ee7a538-1ac2-4210-9aa9-8869912ea1d7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16342024-09-03T23:01:39.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0467f098-d816-440e-a179-fce80ac6771f roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16352024-09-03T23:01:39.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0467f098-d816-440e-a179-fce80ac6771f resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16362024-09-03T23:01:39.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0467f098-d816-440e-a179-fce80ac6771f response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16372024-09-03T23:01:40.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e4c2c886-0aa3-4a2c-a052-7496bf9ceb5a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16382024-09-03T23:01:40.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e4c2c886-0aa3-4a2c-a052-7496bf9ceb5a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16392024-09-03T23:01:40.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e4c2c886-0aa3-4a2c-a052-7496bf9ceb5a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16402024-09-03T23:01:41.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5dc3a398-1911-4bfd-b465-d2434027767b roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16412024-09-03T23:01:41.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5dc3a398-1911-4bfd-b465-d2434027767b resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16422024-09-03T23:01:41.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5dc3a398-1911-4bfd-b465-d2434027767b response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16432024-09-03T23:01:42.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 783312f4-98ab-4fe4-ac7e-751602b38985 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16442024-09-03T23:01:42.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 783312f4-98ab-4fe4-ac7e-751602b38985 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16452024-09-03T23:01:42.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 783312f4-98ab-4fe4-ac7e-751602b38985 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16462024-09-03T23:01:43.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 73406f3a-af7b-4d41-aa86-33d21f47461c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16472024-09-03T23:01:43.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 73406f3a-af7b-4d41-aa86-33d21f47461c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16482024-09-03T23:01:43.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 73406f3a-af7b-4d41-aa86-33d21f47461c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16492024-09-03T23:01:44.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
16502024-09-03T23:01:44.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16512024-09-03T23:01:44.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
16522024-09-03T23:01:44.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16532024-09-03T23:01:44.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16542024-09-03T23:01:44.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16552024-09-03T23:01:44.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16562024-09-03T23:01:44.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16572024-09-03T23:01:44.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16582024-09-03T23:01:44.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.283603ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16592024-09-03T23:01:44.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16602024-09-03T23:01:44.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16612024-09-03T23:01:44.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16622024-09-03T23:01:44.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16632024-09-03T23:01:44.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16642024-09-03T23:01:44.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652024-09-03T23:01:44.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
16662024-09-03T23:01:44.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16672024-09-03T23:01:44.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16682024-09-03T23:01:44.081ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
16692024-09-03T23:01:44.081ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.394956ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
16702024-09-03T23:01:45.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 586838c1-41d2-4eff-9ab2-63f4ddbc22ab roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16712024-09-03T23:01:45.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 586838c1-41d2-4eff-9ab2-63f4ddbc22ab resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16722024-09-03T23:01:45.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 586838c1-41d2-4eff-9ab2-63f4ddbc22ab response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16732024-09-03T23:01:46.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7fc0a162-8530-47be-bb34-136382da729d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16742024-09-03T23:01:46.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7fc0a162-8530-47be-bb34-136382da729d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16752024-09-03T23:01:46.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7fc0a162-8530-47be-bb34-136382da729d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16762024-09-03T23:01:47.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d8b3ad7b-40e2-4050-a7de-7685d38ced58 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16772024-09-03T23:01:47.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d8b3ad7b-40e2-4050-a7de-7685d38ced58 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16782024-09-03T23:01:47.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d8b3ad7b-40e2-4050-a7de-7685d38ced58 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16792024-09-03T23:01:47.390ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1299 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = cb4fd57a-3ed2-487a-ae53-8e239a74cbf9 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
16802024-09-03T23:01:48.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2859db16-b2c8-4db6-88a6-5af537c46c64 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16812024-09-03T23:01:48.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2859db16-b2c8-4db6-88a6-5af537c46c64 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16822024-09-03T23:01:48.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2859db16-b2c8-4db6-88a6-5af537c46c64 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16832024-09-03T23:01:49.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 32ba7768-2ed7-46d2-adff-06b5d93fcfa7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16842024-09-03T23:01:49.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 32ba7768-2ed7-46d2-adff-06b5d93fcfa7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16852024-09-03T23:01:49.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 32ba7768-2ed7-46d2-adff-06b5d93fcfa7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16862024-09-03T23:01:50.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 316c65cb-25eb-43c8-9dc9-a3bc9c68a489 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16872024-09-03T23:01:50.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 316c65cb-25eb-43c8-9dc9-a3bc9c68a489 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16882024-09-03T23:01:50.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2004 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 316c65cb-25eb-43c8-9dc9-a3bc9c68a489 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16892024-09-03T23:01:51.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0ec3d95b-8a3f-4008-8cb7-d98582f39d6b roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16902024-09-03T23:01:51.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0ec3d95b-8a3f-4008-8cb7-d98582f39d6b resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16912024-09-03T23:01:51.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0ec3d95b-8a3f-4008-8cb7-d98582f39d6b response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16922024-09-03T23:01:52.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d74abb97-54a0-40de-a0eb-82fb07a6a7f2 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16932024-09-03T23:01:52.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d74abb97-54a0-40de-a0eb-82fb07a6a7f2 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16942024-09-03T23:01:52.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d74abb97-54a0-40de-a0eb-82fb07a6a7f2 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16952024-09-03T23:01:53.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 17d427ce-574b-4730-a4b6-a3bd497dca6b roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16962024-09-03T23:01:53.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 17d427ce-574b-4730-a4b6-a3bd497dca6b resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16972024-09-03T23:01:53.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 17d427ce-574b-4730-a4b6-a3bd497dca6b response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
16982024-09-03T23:01:54.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 1043002d-6290-476d-a9a2-cd400ee8b448 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
16992024-09-03T23:01:54.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 1043002d-6290-476d-a9a2-cd400ee8b448 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
17002024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
17012024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
17022024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17032024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17042024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
17052024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17062024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
17072024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17082024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
17092024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17102024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
17112024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17122024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
17132024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
17142024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17152024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
17162024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17172024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17182024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
17192024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
17202024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17212024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
17222024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
17232024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17242024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
17252024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17262024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17272024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17282024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
17292024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17302024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
17312024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
17322024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17332024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17342024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17352024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17362024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17372024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17382024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17392024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17402024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17412024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17422024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17432024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17442024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17452024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17462024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17472024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17482024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17492024-09-03T23:01:54.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17502024-09-03T23:01:54.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 4290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 1043002d-6290-476d-a9a2-cd400ee8b448 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
17512024-09-03T23:01:54.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 6b1a23e9-8baf-448e-8981-85d5638b8b31 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
17522024-09-03T23:01:54.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532024-09-03T23:01:54.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 6b1a23e9-8baf-448e-8981-85d5638b8b31 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
17542024-09-03T23:01:54.070ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.226393ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17552024-09-03T23:01:54.071ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17562024-09-03T23:01:54.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17572024-09-03T23:01:54.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17582024-09-03T23:01:54.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17592024-09-03T23:01:54.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17602024-09-03T23:01:54.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17612024-09-03T23:01:54.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17622024-09-03T23:01:54.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17632024-09-03T23:01:54.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17642024-09-03T23:01:54.075ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 320514042 } })
17652024-09-03T23:01:54.076ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
17662024-09-03T23:01:54.077ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17672024-09-03T23:01:54.078ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17682024-09-03T23:01:54.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17692024-09-03T23:01:54.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17702024-09-03T23:01:54.079ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 324483322 } })
17712024-09-03T23:01:54.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
17722024-09-03T23:01:54.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17732024-09-03T23:01:54.081ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17742024-09-03T23:01:54.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17752024-09-03T23:01:54.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17762024-09-03T23:01:54.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17772024-09-03T23:01:54.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17782024-09-03T23:01:54.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17792024-09-03T23:01:54.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17802024-09-03T23:01:54.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 19182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 6b1a23e9-8baf-448e-8981-85d5638b8b31 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
17812024-09-03T23:01:54.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17822024-09-03T23:01:54.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17832024-09-03T23:01:54.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1095, tv_nsec: 334656666 } })
17842024-09-03T23:01:54.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
17852024-09-03T23:01:54.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17862024-09-03T23:01:54.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17872024-09-03T23:01:54.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17882024-09-03T23:01:54.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17892024-09-03T23:01:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17902024-09-03T23:01:54.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17912024-09-03T23:01:54.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17922024-09-03T23:01:54.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17932024-09-03T23:01:54.095ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 28.45712ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
17942024-09-03T23:01:54.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952024-09-03T23:01:54.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17962024-09-03T23:01:54.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17972024-09-03T23:01:54.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17982024-09-03T23:01:54.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17992024-09-03T23:01:54.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18002024-09-03T23:01:54.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18012024-09-03T23:01:54.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18022024-09-03T23:01:54.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18032024-09-03T23:01:54.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
18042024-09-03T23:01:54.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18052024-09-03T23:01:54.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18062024-09-03T23:01:54.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.477525ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
18072024-09-03T23:01:54.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18082024-09-03T23:01:54.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18092024-09-03T23:01:54.122ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
18102024-09-03T23:01:54.122ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.391844ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
18112024-09-03T23:01:54.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 55.721597ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18122024-09-03T23:01:54.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.701068ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
18132024-09-03T23:01:54.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18142024-09-03T23:01:54.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18152024-09-03T23:01:54.141ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18162024-09-03T23:01:54.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18172024-09-03T23:01:54.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18182024-09-03T23:01:54.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18192024-09-03T23:01:54.143ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
18202024-09-03T23:01:54.143ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18212024-09-03T23:01:54.143ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18222024-09-03T23:01:54.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18232024-09-03T23:01:54.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18242024-09-03T23:01:54.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18252024-09-03T23:01:54.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18262024-09-03T23:01:54.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18272024-09-03T23:01:54.150ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 83.298928ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18282024-09-03T23:01:54.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18292024-09-03T23:01:54.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18302024-09-03T23:01:54.177ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
18312024-09-03T23:01:54.177ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18322024-09-03T23:01:54.178ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c29484b8-3b98-4a3b-bbe7-61a247579aaf", "content-length": "26", "date": "Tue, 03 Sep 2024 23:01:54 GMT"} })
18332024-09-03T23:01:54.178ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18342024-09-03T23:01:54.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352024-09-03T23:01:54.179ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18362024-09-03T23:01:54.181ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
18372024-09-03T23:01:54.181ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18382024-09-03T23:01:54.181ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "03225d1c-a4ed-40ef-8c5d-b0dfc996f00f", "content-length": "26", "date": "Tue, 03 Sep 2024 23:01:54 GMT"} })
18392024-09-03T23:01:54.181ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18402024-09-03T23:01:54.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
18412024-09-03T23:01:54.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18422024-09-03T23:01:54.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18432024-09-03T23:01:54.183ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
18442024-09-03T23:01:54.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.463097ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18452024-09-03T23:01:54.188ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
18462024-09-03T23:01:54.188ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18472024-09-03T23:01:54.188ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.279255ms iteration = 14 status = 0
18482024-09-03T23:01:54.188ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c4ab27bc-f062-4ae4-81fb-6399865e5638", "content-length": "26", "date": "Tue, 03 Sep 2024 23:01:54 GMT"} })
18492024-09-03T23:01:54.188ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18502024-09-03T23:01:54.190ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
18512024-09-03T23:01:54.190ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18522024-09-03T23:01:54.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18532024-09-03T23:01:54.190ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18542024-09-03T23:01:54.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18552024-09-03T23:01:54.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a23c517f-6cce-42eb-881f-3d77c6a8257a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
18562024-09-03T23:01:54.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a23c517f-6cce-42eb-881f-3d77c6a8257a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
18572024-09-03T23:01:54.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a23c517f-6cce-42eb-881f-3d77c6a8257a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
18582024-09-03T23:01:54.223ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.339952ms iteration = 17 status = {"physical_disks_added":0}
18592024-09-03T23:01:54.235ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
18602024-09-03T23:01:54.235ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18612024-09-03T23:01:54.236ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.720508ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
18622024-09-03T23:01:54.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18632024-09-03T23:01:54.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18642024-09-03T23:01:54.291ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 224.717408ms iteration = 14 status = {}
18652024-09-03T23:01:54.325ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/f6f586be-1214-4a27-8e47-8ba502c26240/state
18662024-09-03T23:01:54.330ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18672024-09-03T23:01:54.330ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "93c800fa-e364-4241-bbec-5fb3f941280b", "content-length": "2", "date": "Tue, 03 Sep 2024 23:01:53 GMT"} })
18682024-09-03T23:01:54.332ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18692024-09-03T23:01:54.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18702024-09-03T23:01:54.334ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 267.366963ms iteration = 14 status = null
18712024-09-03T23:01:54.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18722024-09-03T23:01:54.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18732024-09-03T23:01:54.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18742024-09-03T23:01:54.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18752024-09-03T23:01:54.356ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18762024-09-03T23:01:54.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18772024-09-03T23:01:54.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18782024-09-03T23:01:54.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18792024-09-03T23:01:54.402ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18802024-09-03T23:01:54.414ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06737dbf-5876-4e04-9a76-db85add50931", "content-length": "523", "date": "Tue, 03 Sep 2024 23:01:53 GMT"} })
18812024-09-03T23:01:54.414ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18822024-09-03T23:01:54.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18832024-09-03T23:01:54.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18842024-09-03T23:01:54.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18852024-09-03T23:01:54.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18862024-09-03T23:01:54.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18872024-09-03T23:01:54.449ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18882024-09-03T23:01:54.450ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "621eb86d-ceef-4c24-9ff7-5124ee3a8a77", "content-length": "810", "date": "Tue, 03 Sep 2024 23:01:54 GMT"} })
18892024-09-03T23:01:54.450ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 252, 22, 16])), vni: Vni(8431258) }} sled = sock
18902024-09-03T23:01:54.450ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18912024-09-03T23:01:54.450ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18922024-09-03T23:01:54.451ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 384.628416ms iteration = 14 status = {}
18932024-09-03T23:01:54.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18942024-09-03T23:01:54.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18952024-09-03T23:01:54.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18962024-09-03T23:01:54.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18972024-09-03T23:01:54.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18982024-09-03T23:01:54.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18992024-09-03T23:01:54.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19002024-09-03T23:01:54.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19012024-09-03T23:01:54.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19022024-09-03T23:01:54.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19032024-09-03T23:01:54.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19042024-09-03T23:01:54.462ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 4a162852-b7fb-453d-8700-c28c90ceea1a, rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cfbbc591-5a71-4824-b45b-c64ca1770cd0) } rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
19052024-09-03T23:01:54.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19062024-09-03T23:01:54.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19072024-09-03T23:01:54.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19082024-09-03T23:01:54.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19092024-09-03T23:01:54.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19102024-09-03T23:01:54.468ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19112024-09-03T23:01:54.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19122024-09-03T23:01:54.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19132024-09-03T23:01:54.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19142024-09-03T23:01:54.473ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19152024-09-03T23:01:54.473ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fcfdee22-0971-4bc7-8549-4b35cb157c39", "content-length": "121", "date": "Tue, 03 Sep 2024 23:01:53 GMT"} })
19162024-09-03T23:01:54.473ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
19172024-09-03T23:01:54.473ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cfbbc591-5a71-4824-b45b-c64ca1770cd0
19182024-09-03T23:01:54.473ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19192024-09-03T23:01:54.473ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19202024-09-03T23:01:54.473ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
19212024-09-03T23:01:54.473ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
19222024-09-03T23:01:54.473ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
19232024-09-03T23:01:54.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19242024-09-03T23:01:54.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19252024-09-03T23:01:54.475ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
19262024-09-03T23:01:54.475ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b3ef4c2d-d177-4505-9861-43af091a6a6e", "content-length": "2", "date": "Tue, 03 Sep 2024 23:01:53 GMT"} })
19272024-09-03T23:01:54.475ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
19282024-09-03T23:01:54.476ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6719a72f-bef7-4a86-b876-f9284a6dfb70", "content-length": "52", "date": "Tue, 03 Sep 2024 23:01:53 GMT"} })
19292024-09-03T23:01:54.476ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
19302024-09-03T23:01:54.476ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19312024-09-03T23:01:54.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19322024-09-03T23:01:54.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19332024-09-03T23:01:54.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19342024-09-03T23:01:54.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19352024-09-03T23:01:54.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362024-09-03T23:01:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2111640e-ec0f-4296-81a6-157dccba7ad6, lookup_type: ById(2111640e-ec0f-4296-81a6-157dccba7ad6) }, key: 65df19a3-101b-46cc-807d-9bec4d6f9d65, lookup_type: ById(65df19a3-101b-46cc-807d-9bec4d6f9d65) }, key: 526a5d18-4d59-4591-9534-40900307ce83, lookup_type: ById(526a5d18-4d59-4591-9534-40900307ce83) }, key: 9f60ce26-d3dd-4df4-8911-4c7e406f8edc, lookup_type: ById(9f60ce26-d3dd-4df4-8911-4c7e406f8edc) } result = Ok(())
19372024-09-03T23:01:54.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19382024-09-03T23:01:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19392024-09-03T23:01:54.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19402024-09-03T23:01:54.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19412024-09-03T23:01:54.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19422024-09-03T23:01:54.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19432024-09-03T23:01:54.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19442024-09-03T23:01:54.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2111640e-ec0f-4296-81a6-157dccba7ad6, lookup_type: ById(2111640e-ec0f-4296-81a6-157dccba7ad6) }, key: 65df19a3-101b-46cc-807d-9bec4d6f9d65, lookup_type: ById(65df19a3-101b-46cc-807d-9bec4d6f9d65) }, key: 526a5d18-4d59-4591-9534-40900307ce83, lookup_type: ById(526a5d18-4d59-4591-9534-40900307ce83) }, key: 9f60ce26-d3dd-4df4-8911-4c7e406f8edc, lookup_type: ById(9f60ce26-d3dd-4df4-8911-4c7e406f8edc) } result = Ok(())
19452024-09-03T23:01:54.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19462024-09-03T23:01:54.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19472024-09-03T23:01:54.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19482024-09-03T23:01:54.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19492024-09-03T23:01:54.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19502024-09-03T23:01:54.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19512024-09-03T23:01:54.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19522024-09-03T23:01:54.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19532024-09-03T23:01:54.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19542024-09-03T23:01:54.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19552024-09-03T23:01:54.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19562024-09-03T23:01:54.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19572024-09-03T23:01:54.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19582024-09-03T23:01:54.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19592024-09-03T23:01:54.603ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d4ec80ca-c27c-4850-9724-442174e51951", "date": "Tue, 03 Sep 2024 23:01:54 GMT"} })
19602024-09-03T23:01:54.603ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch = Switch0
19612024-09-03T23:01:54.603ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19622024-09-03T23:01:54.603ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2c4bfe39-b18f-4eab-8c80-031e38892e9b", "content-length": "667", "date": "Tue, 03 Sep 2024 23:01:54 GMT"} })
19632024-09-03T23:01:54.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19642024-09-03T23:01:54.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19652024-09-03T23:01:54.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19662024-09-03T23:01:54.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19672024-09-03T23:01:54.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19682024-09-03T23:01:54.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19692024-09-03T23:01:54.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702024-09-03T23:01:54.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19712024-09-03T23:01:54.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19722024-09-03T23:01:54.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19732024-09-03T23:01:54.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19742024-09-03T23:01:54.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 2111640e-ec0f-4296-81a6-157dccba7ad6, lookup_type: ById(2111640e-ec0f-4296-81a6-157dccba7ad6) }, key: 65df19a3-101b-46cc-807d-9bec4d6f9d65, lookup_type: ById(65df19a3-101b-46cc-807d-9bec4d6f9d65) }, key: 526a5d18-4d59-4591-9534-40900307ce83, lookup_type: ById(526a5d18-4d59-4591-9534-40900307ce83) }, key: 80d4d9a3-d713-4cf8-9fce-f6409890f135, lookup_type: ByName("default") } result = Ok(())
19752024-09-03T23:01:54.613ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19762024-09-03T23:01:54.613ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "db9577bc-b102-4499-943b-15bc180e31aa", "date": "Tue, 03 Sep 2024 23:01:54 GMT"} })
19772024-09-03T23:01:54.615ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 548.175832ms iteration = 15 status = {}
19782024-09-03T23:01:54.620ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 553.257564ms iteration = 14 status = {}
19792024-09-03T23:01:55.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0922d4d6-7dd8-43b4-aa88-0ca4e4e5cf22 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19802024-09-03T23:01:55.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0922d4d6-7dd8-43b4-aa88-0ca4e4e5cf22 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19812024-09-03T23:01:55.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 5125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0922d4d6-7dd8-43b4-aa88-0ca4e4e5cf22 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19822024-09-03T23:01:56.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 67c15286-acd6-402c-97d6-ce1744785a1f roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19832024-09-03T23:01:56.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 67c15286-acd6-402c-97d6-ce1744785a1f resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19842024-09-03T23:01:56.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 67c15286-acd6-402c-97d6-ce1744785a1f response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19852024-09-03T23:01:57.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3e4e8249-7c8e-468e-ad78-0eb141e3d60c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19862024-09-03T23:01:57.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3e4e8249-7c8e-468e-ad78-0eb141e3d60c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19872024-09-03T23:01:57.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3e4e8249-7c8e-468e-ad78-0eb141e3d60c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19882024-09-03T23:01:57.391ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1616 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = dba77ac6-f17d-4f74-82c9-4053373d8d3f response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
19892024-09-03T23:01:58.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3a818efa-1954-4a33-bdd7-61b75338c95c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19902024-09-03T23:01:58.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3a818efa-1954-4a33-bdd7-61b75338c95c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19912024-09-03T23:01:58.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3a818efa-1954-4a33-bdd7-61b75338c95c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19922024-09-03T23:01:59.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4c505273-7e44-4737-ac65-d5cda04c8a43 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19932024-09-03T23:01:59.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4c505273-7e44-4737-ac65-d5cda04c8a43 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19942024-09-03T23:01:59.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2715 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4c505273-7e44-4737-ac65-d5cda04c8a43 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19952024-09-03T23:02:00.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f9f87dfa-e3d6-4ca9-822f-65cbd6379102 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19962024-09-03T23:02:00.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f9f87dfa-e3d6-4ca9-822f-65cbd6379102 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19972024-09-03T23:02:00.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f9f87dfa-e3d6-4ca9-822f-65cbd6379102 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
19982024-09-03T23:02:00.983ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/f6f586be-1214-4a27-8e47-8ba502c26240/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7b767fdf-8ea4-42ed-887a-30ab080721ff", "content-length": "131", "date": "Tue, 03 Sep 2024 23:02:00 GMT"} })
19992024-09-03T23:02:00.988ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-03T23:01:53.681037874Z }, migration_in: None, migration_out: None } vmm_id = f6f586be-1214-4a27-8e47-8ba502c26240
20002024-09-03T23:02:00.988ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1984 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 vmm_id = f6f586be-1214-4a27-8e47-8ba502c26240 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-09-03T23:01:53.681037874Z }
20012024-09-03T23:02:00.988ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 roles = RoleSet { roles: {} } vmm_id = f6f586be-1214-4a27-8e47-8ba502c26240
20022024-09-03T23:02:00.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 resource = Database result = Ok(()) vmm_id = f6f586be-1214-4a27-8e47-8ba502c26240
20032024-09-03T23:02:00.991ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 522fea92-ccd8-403a-9da5-ec4f9aea8870 uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-03T23:02:00.986033574Z }
20042024-09-03T23:02:00.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 522fea92-ccd8-403a-9da5-ec4f9aea8870 roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20052024-09-03T23:02:00.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 522fea92-ccd8-403a-9da5-ec4f9aea8870 resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20062024-09-03T23:02:01.020ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:39194
20072024-09-03T23:02:01.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39194 req_id = e55295b9-0c1e-48ae-aa81-9a4173c06d0d roles = RoleSet { roles: {} } uri = /metrics/producers
20082024-09-03T23:02:01.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39194 req_id = e55295b9-0c1e-48ae-aa81-9a4173c06d0d resource = Database result = Ok(()) uri = /metrics/producers
20092024-09-03T23:02:01.024ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
20102024-09-03T23:02:01.024ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 6.956992369s iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
20112024-09-03T23:02:01.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 53845 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 522fea92-ccd8-403a-9da5-ec4f9aea8870 response_code = 204 uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20122024-09-03T23:02:01.040ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 524ed812-8b58-46ab-8acd-c24b9bf3e3d4 uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-03T23:02:01.040455759Z }
20132024-09-03T23:02:01.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 524ed812-8b58-46ab-8acd-c24b9bf3e3d4 roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20142024-09-03T23:02:01.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 524ed812-8b58-46ab-8acd-c24b9bf3e3d4 resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20152024-09-03T23:02:01.054ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
20162024-09-03T23:02:01.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39194 req_id = e55295b9-0c1e-48ae-aa81-9a4173c06d0d roles = RoleSet { roles: {} } uri = /metrics/producers
20172024-09-03T23:02:01.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 14189 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 524ed812-8b58-46ab-8acd-c24b9bf3e3d4 response_code = 204 uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20182024-09-03T23:02:01.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39194 req_id = e55295b9-0c1e-48ae-aa81-9a4173c06d0d resource = Database result = Ok(()) uri = /metrics/producers
20192024-09-03T23:02:01.087ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
20202024-09-03T23:02:01.087ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1b547f67-97c7-4080-bf80-4414b722712a", "date": "Tue, 03 Sep 2024 23:02:01 GMT"} })
20212024-09-03T23:02:01.087ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41
20222024-09-03T23:02:01.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 68341 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39194 req_id = e55295b9-0c1e-48ae-aa81-9a4173c06d0d response_code = 201 uri = /metrics/producers
20232024-09-03T23:02:01.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e9cb7524-814a-4333-9dde-79735a0d3c08 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20242024-09-03T23:02:01.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e9cb7524-814a-4333-9dde-79735a0d3c08 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20252024-09-03T23:02:01.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e9cb7524-814a-4333-9dde-79735a0d3c08 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20262024-09-03T23:02:02.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fc82609a-157e-485e-b5be-6598ef0bddba roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20272024-09-03T23:02:02.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fc82609a-157e-485e-b5be-6598ef0bddba resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20282024-09-03T23:02:02.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 7638 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fc82609a-157e-485e-b5be-6598ef0bddba response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20292024-09-03T23:02:03.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 94bdeb5c-882d-43e3-883c-ab9758de3b84 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20302024-09-03T23:02:03.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 94bdeb5c-882d-43e3-883c-ab9758de3b84 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20312024-09-03T23:02:03.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 94bdeb5c-882d-43e3-883c-ab9758de3b84 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20322024-09-03T23:02:04.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
20332024-09-03T23:02:04.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20342024-09-03T23:02:04.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
20352024-09-03T23:02:04.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20362024-09-03T23:02:04.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20372024-09-03T23:02:04.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20382024-09-03T23:02:04.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20392024-09-03T23:02:04.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20402024-09-03T23:02:04.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20412024-09-03T23:02:04.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20422024-09-03T23:02:04.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20432024-09-03T23:02:04.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20442024-09-03T23:02:04.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20452024-09-03T23:02:04.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
20462024-09-03T23:02:04.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20472024-09-03T23:02:04.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20482024-09-03T23:02:04.084ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
20492024-09-03T23:02:04.084ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.184655ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
20502024-09-03T23:02:04.095ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20512024-09-03T23:02:04.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20522024-09-03T23:02:04.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.027141ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20532024-09-03T23:02:04.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6ef20a05-e062-43ed-ae24-8842119b471c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20542024-09-03T23:02:04.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6ef20a05-e062-43ed-ae24-8842119b471c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20552024-09-03T23:02:04.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6ef20a05-e062-43ed-ae24-8842119b471c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20562024-09-03T23:02:05.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 381d415a-e954-491e-8d87-690f231f4208 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20572024-09-03T23:02:05.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 381d415a-e954-491e-8d87-690f231f4208 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20582024-09-03T23:02:05.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 381d415a-e954-491e-8d87-690f231f4208 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20592024-09-03T23:02:06.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc08c549-1971-4eec-a93d-d0ed6f84a966 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20602024-09-03T23:02:06.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc08c549-1971-4eec-a93d-d0ed6f84a966 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20612024-09-03T23:02:06.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc08c549-1971-4eec-a93d-d0ed6f84a966 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20622024-09-03T23:02:07.392ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 8e890a43-3a44-42f6-be8c-5774ae9def73 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
20632024-09-03T23:02:07.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8a9405d6-e651-4900-87eb-0773bb7b5406 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20642024-09-03T23:02:07.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8a9405d6-e651-4900-87eb-0773bb7b5406 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20652024-09-03T23:02:07.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8a9405d6-e651-4900-87eb-0773bb7b5406 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20662024-09-03T23:02:08.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 057d32ce-1375-48a9-85d3-345c995f592e roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20672024-09-03T23:02:08.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 057d32ce-1375-48a9-85d3-345c995f592e resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20682024-09-03T23:02:08.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 057d32ce-1375-48a9-85d3-345c995f592e response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20692024-09-03T23:02:09.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5a903075-77f4-4c38-8482-77f5d2273a70 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20702024-09-03T23:02:09.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5a903075-77f4-4c38-8482-77f5d2273a70 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20712024-09-03T23:02:09.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5a903075-77f4-4c38-8482-77f5d2273a70 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20722024-09-03T23:02:10.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e0e079a2-d1ce-415a-bc28-3c184e9a9849 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20732024-09-03T23:02:10.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e0e079a2-d1ce-415a-bc28-3c184e9a9849 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20742024-09-03T23:02:10.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e0e079a2-d1ce-415a-bc28-3c184e9a9849 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20752024-09-03T23:02:11.458ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2e2d0bfc-cc24-442d-9475-26f24797bb11 uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-03T23:02:11.457671748Z }
20762024-09-03T23:02:11.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2e2d0bfc-cc24-442d-9475-26f24797bb11 roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20772024-09-03T23:02:11.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2e2d0bfc-cc24-442d-9475-26f24797bb11 resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20782024-09-03T23:02:11.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 13732 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2e2d0bfc-cc24-442d-9475-26f24797bb11 response_code = 204 uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20792024-09-03T23:02:11.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0492baaa-80c7-4cdb-9c5f-538968249888 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20802024-09-03T23:02:11.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0492baaa-80c7-4cdb-9c5f-538968249888 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20812024-09-03T23:02:11.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0492baaa-80c7-4cdb-9c5f-538968249888 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20822024-09-03T23:02:12.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = ae4c3b81-4582-438f-9eac-b4980cdcf7f5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
20832024-09-03T23:02:12.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = ae4c3b81-4582-438f-9eac-b4980cdcf7f5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
20842024-09-03T23:02:12.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = ae4c3b81-4582-438f-9eac-b4980cdcf7f5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
20852024-09-03T23:02:12.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = d8bfae5f-87bc-40d2-b274-61f18bf7ca3d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
20862024-09-03T23:02:12.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = d8bfae5f-87bc-40d2-b274-61f18bf7ca3d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
20872024-09-03T23:02:12.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = d8bfae5f-87bc-40d2-b274-61f18bf7ca3d response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
20882024-09-03T23:02:12.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d81fef9f-82e5-4155-8121-66f01d660caa roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20892024-09-03T23:02:12.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d81fef9f-82e5-4155-8121-66f01d660caa resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20902024-09-03T23:02:12.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d81fef9f-82e5-4155-8121-66f01d660caa response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20912024-09-03T23:02:13.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 32be3d66-9415-4e50-85b7-d3b939dec8bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
20922024-09-03T23:02:13.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 32be3d66-9415-4e50-85b7-d3b939dec8bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
20932024-09-03T23:02:13.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 32be3d66-9415-4e50-85b7-d3b939dec8bf response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
20942024-09-03T23:02:13.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 56ac319d-4dad-4cd7-b259-aaf17bba20ba roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20952024-09-03T23:02:13.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 56ac319d-4dad-4cd7-b259-aaf17bba20ba resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20962024-09-03T23:02:13.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 56ac319d-4dad-4cd7-b259-aaf17bba20ba response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
20972024-09-03T23:02:13.887ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-03T23:02:13.886688130Z }
20982024-09-03T23:02:13.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
20992024-09-03T23:02:13.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21002024-09-03T23:02:13.897ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240 vmm_needs_update = true
21012024-09-03T23:02:13.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21022024-09-03T23:02:13.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21032024-09-03T23:02:13.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21042024-09-03T23:02:13.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21052024-09-03T23:02:13.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21062024-09-03T23:02:13.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21072024-09-03T23:02:13.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21082024-09-03T23:02:13.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21092024-09-03T23:02:13.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21102024-09-03T23:02:13.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21112024-09-03T23:02:13.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21122024-09-03T23:02:13.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21132024-09-03T23:02:13.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21142024-09-03T23:02:13.913ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2111640e-ec0f-4296-81a6-157dccba7ad6, lookup_type: ById(2111640e-ec0f-4296-81a6-157dccba7ad6) }, key: 65df19a3-101b-46cc-807d-9bec4d6f9d65, lookup_type: ById(65df19a3-101b-46cc-807d-9bec4d6f9d65) }, key: f195a0fd-21b8-4aec-a28d-13ac902f5b41, lookup_type: ById(f195a0fd-21b8-4aec-a28d-13ac902f5b41) } result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21152024-09-03T23:02:13.913ZINFOnexus (dropshot_internal): starting update saga for f195a0fd-21b8-4aec-a28d-13ac902f5b41 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1459 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-03T23:02:13.886688130Z }
21162024-09-03T23:02:13.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 26457 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e response_code = 204 uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21172024-09-03T23:02:13.913ZDEBGnexus (dropshot_internal): preparing instance-update saga for f195a0fd-21b8-4aec-a28d-13ac902f5b41... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 30d72782-57c6-4171-b092-82b83295e29e uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21182024-09-03T23:02:13.913ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1984 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d407efaa-8e39-4e80-a994-1b0bb64e632f uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-03T23:02:13.886688130Z }
21192024-09-03T23:02:13.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d407efaa-8e39-4e80-a994-1b0bb64e632f roles = RoleSet { roles: {} } uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21202024-09-03T23:02:13.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d407efaa-8e39-4e80-a994-1b0bb64e632f resource = Database result = Ok(()) uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21212024-09-03T23:02:13.915ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update
21222024-09-03T23:02:13.916ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f195a0fd-21b8-4aec-a28d-13ac902f5b41","lookup_type":{"ById":"f195a0fd-21b8-4aec-a28d-13ac902f5b41"},"parent":{"key":"65df19a3-101b-46cc-807d-9bec4d6f9d65","lookup_type":{"ById":"65df19a3-101b-46cc-807d-9bec4d6f9d65"},"parent":{"key":"2111640e-ec0f-4296-81a6-157dccba7ad6","lookup_type":{"ById":"2111640e-ec0f-4296-81a6-157dccba7ad6"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21232024-09-03T23:02:13.916ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update
21242024-09-03T23:02:13.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 4532 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d407efaa-8e39-4e80-a994-1b0bb64e632f response_code = 204 uri = /vmms/f6f586be-1214-4a27-8e47-8ba502c26240
21252024-09-03T23:02:13.946ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update
21262024-09-03T23:02:13.946ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21272024-09-03T23:02:13.946ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21282024-09-03T23:02:13.946ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
21292024-09-03T23:02:13.956ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21302024-09-03T23:02:13.956ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
21312024-09-03T23:02:13.960ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21322024-09-03T23:02:13.960ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
21332024-09-03T23:02:13.964ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21342024-09-03T23:02:13.964ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ebbbc43e-bc7e-4492-9573-7ba358f50bdb")) node_id = 0 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
21352024-09-03T23:02:13.967ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21362024-09-03T23:02:13.967ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
21372024-09-03T23:02:13.974ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update
21382024-09-03T23:02:13.974ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21392024-09-03T23:02:13.974ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21402024-09-03T23:02:13.976ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21412024-09-03T23:02:13.976ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21422024-09-03T23:02:13.978ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21432024-09-03T23:02:13.978ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21442024-09-03T23:02:13.980ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21452024-09-03T23:02:13.980ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21462024-09-03T23:02:13.982ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21472024-09-03T23:02:13.982ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21482024-09-03T23:02:13.983ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21492024-09-03T23:02:13.983ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21502024-09-03T23:02:13.984ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21512024-09-03T23:02:13.987ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2111640e-ec0f-4296-81a6-157dccba7ad6, lookup_type: ById(2111640e-ec0f-4296-81a6-157dccba7ad6) }, key: 65df19a3-101b-46cc-807d-9bec4d6f9d65, lookup_type: ById(65df19a3-101b-46cc-807d-9bec4d6f9d65) }, key: f195a0fd-21b8-4aec-a28d-13ac902f5b41, lookup_type: ById(f195a0fd-21b8-4aec-a28d-13ac902f5b41) } result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21522024-09-03T23:02:13.987ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance updater_id = ebbbc43e-bc7e-4492-9573-7ba358f50bdb
21532024-09-03T23:02:13.987ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21542024-09-03T23:02:13.987ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21552024-09-03T23:02:13.996ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance updater_id = ebbbc43e-bc7e-4492-9573-7ba358f50bdb
21562024-09-03T23:02:13.996ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21572024-09-03T23:02:13.996ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance
21582024-09-03T23:02:14.000ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 locked_gen = Generation(Generation(2)) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = LockInstance updater_id = ebbbc43e-bc7e-4492-9573-7ba358f50bdb
21592024-09-03T23:02:14.001ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21602024-09-03T23:02:14.001ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("ebbbc43e-bc7e-4492-9573-7ba358f50bdb")}) node_id = 1 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
21612024-09-03T23:02:14.004ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21622024-09-03T23:02:14.004ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
21632024-09-03T23:02:14.010ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21642024-09-03T23:02:14.011ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21652024-09-03T23:02:14.012ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21662024-09-03T23:02:14.012ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21672024-09-03T23:02:14.014ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21682024-09-03T23:02:14.014ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21692024-09-03T23:02:14.015ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21702024-09-03T23:02:14.018ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2111640e-ec0f-4296-81a6-157dccba7ad6, lookup_type: ById(2111640e-ec0f-4296-81a6-157dccba7ad6) }, key: 65df19a3-101b-46cc-807d-9bec4d6f9d65, lookup_type: ById(65df19a3-101b-46cc-807d-9bec4d6f9d65) }, key: f195a0fd-21b8-4aec-a28d-13ac902f5b41, lookup_type: ById(f195a0fd-21b8-4aec-a28d-13ac902f5b41) } result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21712024-09-03T23:02:14.018ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21722024-09-03T23:02:14.018ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
21732024-09-03T23:02:14.028ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: f6f586be-1214-4a27-8e47-8ba502c26240, time_created: 2024-09-03T23:01:53.229559Z, time_deleted: None, instance_id: f195a0fd-21b8-4aec-a28d-13ac902f5b41, sled_id: 03fe690d-d383-493d-857f-957a03d9553b, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-09-03T23:02:13.886688Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-09-03T23:01:53.282284Z, gen: Generation(Generation(3)), propolis_id: Some(f6f586be-1214-4a27-8e47-8ba502c26240), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(f6f586be-1214-4a27-8e47-8ba502c26240 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-09-03T23:02:14.023883087Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
21742024-09-03T23:02:14.028ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
21752024-09-03T23:02:14.028ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f195a0fd-21b8-4aec-a28d-13ac902f5b41","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"f6f586be-1214-4a27-8e47-8ba502c26240"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"f195a0fd-21b8-4aec-a28d-13ac902f5b41","lookup_type":{"ById":"f195a0fd-21b8-4aec-a28d-13ac902f5b41"},"parent":{"key":"65df19a3-101b-46cc-807d-9bec4d6f9d65","lookup_type":{"ById":"65df19a3-101b-46cc-807d-9bec4d6f9d65"},"parent":{"key":"2111640e-ec0f-4296-81a6-157dccba7ad6","lookup_type":{"ById":"2111640e-ec0f-4296-81a6-157dccba7ad6"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"ebbbc43e-bc7e-4492-9573-7ba358f50bdb"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"65df19a3-101b-46cc-807d-9bec4d6f9d65","ram_diff":1073741824},"destroy_active_vmm":"f6f586be-1214-4a27-8e47-8ba502c26240","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-09-03T23:02:14.023883087Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21762024-09-03T23:02:14.028ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
21772024-09-03T23:02:14.032ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
21782024-09-03T23:02:14.032ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21792024-09-03T23:02:14.032ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21802024-09-03T23:02:14.032ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
21812024-09-03T23:02:14.035ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21822024-09-03T23:02:14.035ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
21832024-09-03T23:02:14.039ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21842024-09-03T23:02:14.039ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
21852024-09-03T23:02:14.042ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21862024-09-03T23:02:14.042ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5726848c-1404-401a-a04f-07248f3937e5")) node_id = 0 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
21872024-09-03T23:02:14.047ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21882024-09-03T23:02:14.047ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
21892024-09-03T23:02:14.054ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 parent_lock = UpdaterLock { updater_id: ebbbc43e-bc7e-4492-9573-7ba358f50bdb, locked_gen: Generation(Generation(2)) } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
21902024-09-03T23:02:14.054ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = BecomeUpdater
21912024-09-03T23:02:14.054ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = BecomeUpdater
21922024-09-03T23:02:14.064ZDEBGnexus (SagaExecutor): inherited lock from ebbbc43e-bc7e-4492-9573-7ba358f50bdb to 5726848c-1404-401a-a04f-07248f3937e5 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = ebbbc43e-bc7e-4492-9573-7ba358f50bdb saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = BecomeUpdater updater_id = 5726848c-1404-401a-a04f-07248f3937e5
21932024-09-03T23:02:14.064ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:944 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
21942024-09-03T23:02:14.064ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
21952024-09-03T23:02:14.064ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("5726848c-1404-401a-a04f-07248f3937e5")}) node_id = 1 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
21962024-09-03T23:02:14.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
21972024-09-03T23:02:14.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21982024-09-03T23:02:14.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
21992024-09-03T23:02:14.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22002024-09-03T23:02:14.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22012024-09-03T23:02:14.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22022024-09-03T23:02:14.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22032024-09-03T23:02:14.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22042024-09-03T23:02:14.069ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22052024-09-03T23:02:14.069ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22062024-09-03T23:02:14.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22072024-09-03T23:02:14.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22082024-09-03T23:02:14.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22092024-09-03T23:02:14.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22102024-09-03T23:02:14.073ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22112024-09-03T23:02:14.073ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22122024-09-03T23:02:14.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22132024-09-03T23:02:14.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22142024-09-03T23:02:14.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22152024-09-03T23:02:14.076ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22162024-09-03T23:02:14.076ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22172024-09-03T23:02:14.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
22182024-09-03T23:02:14.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22192024-09-03T23:02:14.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22202024-09-03T23:02:14.082ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:997 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22212024-09-03T23:02:14.088ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
22222024-09-03T23:02:14.088ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.728721ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
22232024-09-03T23:02:14.088ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41
22242024-09-03T23:02:14.091ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UpdateNetworkConfig
22252024-09-03T23:02:14.091ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UpdateNetworkConfig
22262024-09-03T23:02:14.094ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UpdateNetworkConfig
22272024-09-03T23:02:14.094ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UpdateNetworkConfig
22282024-09-03T23:02:14.096ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
22292024-09-03T23:02:14.096ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UpdateNetworkConfig
22302024-09-03T23:02:14.096ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UpdateNetworkConfig
22312024-09-03T23:02:14.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.3513ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22322024-09-03T23:02:14.099ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
22332024-09-03T23:02:14.099ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
22342024-09-03T23:02:14.099ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
22352024-09-03T23:02:14.100ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
22362024-09-03T23:02:14.101ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
22372024-09-03T23:02:14.101ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
22382024-09-03T23:02:14.101ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
22392024-09-03T23:02:14.106ZDEBGnexus: notifying dendrite of updates instance_id = Some(f195a0fd-21b8-4aec-a28d-13ac902f5b41 (instance)) switch = switch0
22402024-09-03T23:02:14.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 354478114 } })
22412024-09-03T23:02:14.110ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
22422024-09-03T23:02:14.145ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
22432024-09-03T23:02:14.145ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22442024-09-03T23:02:14.145ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "529586de-8088-437a-94f2-f4e67301c8df", "content-length": "26", "date": "Tue, 03 Sep 2024 23:02:14 GMT"} })
22452024-09-03T23:02:14.145ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22462024-09-03T23:02:14.146ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22472024-09-03T23:02:14.179ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
22482024-09-03T23:02:14.180ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e48a2624-3f85-4a00-a0ec-62f403213706", "content-length": "4", "date": "Tue, 03 Sep 2024 23:02:13 GMT"} })
22492024-09-03T23:02:14.180ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22502024-09-03T23:02:14.180ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22512024-09-03T23:02:14.185ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22522024-09-03T23:02:14.185ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22532024-09-03T23:02:14.189ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
22542024-09-03T23:02:14.190ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
22552024-09-03T23:02:14.204ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1072 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-09-03T23:02:14.193250Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, time_modified: Some(2024-09-03T23:02:14.193250Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 65df19a3-101b-46cc-807d-9bec4d6f9d65, time_modified: Some(2024-09-03T23:02:14.193250Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22562024-09-03T23:02:14.204ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22572024-09-03T23:02:14.204ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22582024-09-03T23:02:14.208ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22592024-09-03T23:02:14.208ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22602024-09-03T23:02:14.211ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1107 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22612024-09-03T23:02:14.211ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UnassignOximeterProducer
22622024-09-03T23:02:14.212ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UnassignOximeterProducer
22632024-09-03T23:02:14.217ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 producer_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22642024-09-03T23:02:14.217ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UnassignOximeterProducer
22652024-09-03T23:02:14.217ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = UnassignOximeterProducer
22662024-09-03T23:02:14.254ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22672024-09-03T23:02:14.254ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f195a0fd-21b8-4aec-a28d-13ac902f5b41
22682024-09-03T23:02:14.254ZDEBGnexus (SagaExecutor): client response oximeter-collector = f195a0fd-21b8-4aec-a28d-13ac902f5b41 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/f195a0fd-21b8-4aec-a28d-13ac902f5b41", query: None, fragment: None }, status: 204, headers: {"x-request-id": "704e7dee-72ce-4e80-8b6c-b91c4f81cf81", "date": "Tue, 03 Sep 2024 23:02:14 GMT"} }) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22692024-09-03T23:02:14.254ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 producer_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22702024-09-03T23:02:14.256ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22712024-09-03T23:02:14.256ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22722024-09-03T23:02:14.259ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
22732024-09-03T23:02:14.259ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
22742024-09-03T23:02:14.263ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 lock = UpdaterLock { updater_id: 5726848c-1404-401a-a04f-07248f3937e5, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-09-03T23:02:14.023883087Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22752024-09-03T23:02:14.263ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22762024-09-03T23:02:14.263ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22772024-09-03T23:02:14.303ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1156 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 new_runtime = InstanceRuntimeState { time_updated: 2024-09-03T23:02:14.023883087Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
22782024-09-03T23:02:14.303ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22792024-09-03T23:02:14.303ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
22802024-09-03T23:02:14.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22812024-09-03T23:02:14.303ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22822024-09-03T23:02:14.303ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
22832024-09-03T23:02:14.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22842024-09-03T23:02:14.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22852024-09-03T23:02:14.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22862024-09-03T23:02:14.305ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22872024-09-03T23:02:14.305ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22882024-09-03T23:02:14.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22892024-09-03T23:02:14.306ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22902024-09-03T23:02:14.306ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22912024-09-03T23:02:14.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22922024-09-03T23:02:14.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22932024-09-03T23:02:14.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22942024-09-03T23:02:14.308ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
22952024-09-03T23:02:14.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962024-09-03T23:02:14.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22972024-09-03T23:02:14.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22982024-09-03T23:02:14.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22992024-09-03T23:02:14.311ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2111640e-ec0f-4296-81a6-157dccba7ad6, lookup_type: ById(2111640e-ec0f-4296-81a6-157dccba7ad6) }, key: 65df19a3-101b-46cc-807d-9bec4d6f9d65, lookup_type: ById(65df19a3-101b-46cc-807d-9bec4d6f9d65) }, key: f195a0fd-21b8-4aec-a28d-13ac902f5b41, lookup_type: ById(f195a0fd-21b8-4aec-a28d-13ac902f5b41) } result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
23002024-09-03T23:02:14.311ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
23012024-09-03T23:02:14.312ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = CommitInstanceUpdates
23022024-09-03T23:02:14.314ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23032024-09-03T23:02:14.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23042024-09-03T23:02:14.316ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23052024-09-03T23:02:14.316ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23062024-09-03T23:02:14.320ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23072024-09-03T23:02:14.320ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23082024-09-03T23:02:14.324ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23092024-09-03T23:02:14.324ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f195a0fd-21b8-4aec-a28d-13ac902f5b41"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f6f586be-1214-4a27-8e47-8ba502c26240")}) node_id = 7 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23102024-09-03T23:02:14.330ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23112024-09-03T23:02:14.330ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23122024-09-03T23:02:14.334ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23132024-09-03T23:02:14.334ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23142024-09-03T23:02:14.337ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23152024-09-03T23:02:14.337ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23162024-09-03T23:02:14.346ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
23172024-09-03T23:02:14.346ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = ReleaseSledResources
23182024-09-03T23:02:14.347ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = ReleaseSledResources
23192024-09-03T23:02:14.354ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23202024-09-03T23:02:14.354ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23212024-09-03T23:02:14.358ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23222024-09-03T23:02:14.358ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23232024-09-03T23:02:14.361ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 propolis_id = f6f586be-1214-4a27-8e47-8ba502c26240 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update
23242024-09-03T23:02:14.361ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = MarkVmmDeleted
23252024-09-03T23:02:14.361ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_node = MarkVmmDeleted
23262024-09-03T23:02:14.395ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23272024-09-03T23:02:14.395ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23282024-09-03T23:02:14.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23292024-09-03T23:02:14.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23302024-09-03T23:02:14.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23312024-09-03T23:02:14.399ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23322024-09-03T23:02:14.399ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23332024-09-03T23:02:14.399ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23342024-09-03T23:02:14.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23352024-09-03T23:02:14.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23362024-09-03T23:02:14.400ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23372024-09-03T23:02:14.400ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d8e084f6-0939-4bc5-93c8-46dae8f279c5", "content-length": "372", "date": "Tue, 03 Sep 2024 23:02:14 GMT"} })
23382024-09-03T23:02:14.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23392024-09-03T23:02:14.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23402024-09-03T23:02:14.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23412024-09-03T23:02:14.403ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23422024-09-03T23:02:14.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23432024-09-03T23:02:14.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23442024-09-03T23:02:14.403ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23452024-09-03T23:02:14.403ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23462024-09-03T23:02:14.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23472024-09-03T23:02:14.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23482024-09-03T23:02:14.407ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23492024-09-03T23:02:14.407ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23502024-09-03T23:02:14.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23512024-09-03T23:02:14.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23522024-09-03T23:02:14.411ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23532024-09-03T23:02:14.411ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23542024-09-03T23:02:14.411ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23552024-09-03T23:02:14.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0d1f4215-dd63-4583-810f-12382ad89280", "date": "Tue, 03 Sep 2024 23:02:14 GMT"} })
23562024-09-03T23:02:14.413ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 109.664837ms iteration = 16 status = {}
23572024-09-03T23:02:14.436ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23582024-09-03T23:02:14.437ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0b887c6b-3478-4aa9-9fae-d1d842a7f201", "content-length": "691", "date": "Tue, 03 Sep 2024 23:02:14 GMT"} })
23592024-09-03T23:02:14.437ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23602024-09-03T23:02:14.437ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23612024-09-03T23:02:14.437ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23622024-09-03T23:02:14.438ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 134.663451ms iteration = 15 status = {}
23632024-09-03T23:02:14.440ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23642024-09-03T23:02:14.440ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00
23652024-09-03T23:02:14.494ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23662024-09-03T23:02:14.494ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 saga_name = instance-update saga_result = SagaResult { saga_id: e934a90e-d4b2-423d-ad39-44c5cedaec00, saga_log: SagaLog { saga_id: e934a90e-d4b2-423d-ad39-44c5cedaec00, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("5726848c-1404-401a-a04f-07248f3937e5")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("5726848c-1404-401a-a04f-07248f3937e5")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f195a0fd-21b8-4aec-a28d-13ac902f5b41"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f6f586be-1214-4a27-8e47-8ba502c26240")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f195a0fd-21b8-4aec-a28d-13ac902f5b41"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("f6f586be-1214-4a27-8e47-8ba502c26240")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("5726848c-1404-401a-a04f-07248f3937e5"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("5726848c-1404-401a-a04f-07248f3937e5")}} }) }
23672024-09-03T23:02:14.494ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = e934a90e-d4b2-423d-ad39-44c5cedaec00 instance_id = f195a0fd-21b8-4aec-a28d-13ac902f5b41 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update
23682024-09-03T23:02:14.494ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23692024-09-03T23:02:14.494ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
23702024-09-03T23:02:14.498ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23712024-09-03T23:02:14.498ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
23722024-09-03T23:02:14.503ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23732024-09-03T23:02:14.503ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
23742024-09-03T23:02:14.506ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23752024-09-03T23:02:14.506ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2
23762024-09-03T23:02:14.537ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update sec_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
23772024-09-03T23:02:14.537ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 794f4aa1-5dbe-49f2-a456-53f6cafffba2 saga_name = start-instance-update saga_result = SagaResult { saga_id: 794f4aa1-5dbe-49f2-a456-53f6cafffba2, saga_log: SagaLog { saga_id: 794f4aa1-5dbe-49f2-a456-53f6cafffba2, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("ebbbc43e-bc7e-4492-9573-7ba358f50bdb")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("ebbbc43e-bc7e-4492-9573-7ba358f50bdb")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("ebbbc43e-bc7e-4492-9573-7ba358f50bdb"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("ebbbc43e-bc7e-4492-9573-7ba358f50bdb")}} }) }
23782024-09-03T23:02:14.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = eceaa618-9d5d-45b0-8ab6-517578012514 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23792024-09-03T23:02:14.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = eceaa618-9d5d-45b0-8ab6-517578012514 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23802024-09-03T23:02:14.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 4279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = eceaa618-9d5d-45b0-8ab6-517578012514 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23812024-09-03T23:02:15.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 9a645843-3e1b-48ce-914c-0e157821933d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
23822024-09-03T23:02:15.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 9a645843-3e1b-48ce-914c-0e157821933d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
23832024-09-03T23:02:15.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 9a645843-3e1b-48ce-914c-0e157821933d response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
23842024-09-03T23:02:15.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c5ea7cf2-b209-481f-815a-0d4acfcac7ac roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23852024-09-03T23:02:15.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c5ea7cf2-b209-481f-815a-0d4acfcac7ac resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23862024-09-03T23:02:15.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c5ea7cf2-b209-481f-815a-0d4acfcac7ac response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23872024-09-03T23:02:16.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7b6ccb22-547f-4f19-8d81-8b3979f06252 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23882024-09-03T23:02:16.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7b6ccb22-547f-4f19-8d81-8b3979f06252 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23892024-09-03T23:02:16.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7b6ccb22-547f-4f19-8d81-8b3979f06252 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23902024-09-03T23:02:17.392ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = ee90b3d4-e9a7-44ab-a902-92fc3d9a33a4 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
23912024-09-03T23:02:17.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8c63c978-7cfd-46b2-b1c5-909642dddb5d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23922024-09-03T23:02:17.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8c63c978-7cfd-46b2-b1c5-909642dddb5d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23932024-09-03T23:02:17.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8c63c978-7cfd-46b2-b1c5-909642dddb5d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23942024-09-03T23:02:18.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7be77bf7-5557-4707-ba70-6a7738e22d00 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23952024-09-03T23:02:18.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7be77bf7-5557-4707-ba70-6a7738e22d00 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23962024-09-03T23:02:18.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7be77bf7-5557-4707-ba70-6a7738e22d00 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23972024-09-03T23:02:19.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6604470f-07c1-41f7-852f-fb303ab8dc9a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23982024-09-03T23:02:19.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6604470f-07c1-41f7-852f-fb303ab8dc9a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
23992024-09-03T23:02:19.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6604470f-07c1-41f7-852f-fb303ab8dc9a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24002024-09-03T23:02:20.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bd6876c5-1163-4c85-87a7-c159a688bdf6 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24012024-09-03T23:02:20.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bd6876c5-1163-4c85-87a7-c159a688bdf6 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24022024-09-03T23:02:20.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bd6876c5-1163-4c85-87a7-c159a688bdf6 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24032024-09-03T23:02:21.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0b460df3-658a-433e-8b32-62875cf6e58c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24042024-09-03T23:02:21.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0b460df3-658a-433e-8b32-62875cf6e58c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24052024-09-03T23:02:21.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0b460df3-658a-433e-8b32-62875cf6e58c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24062024-09-03T23:02:22.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fbf31676-ffff-41c9-afef-995e2cb9b2f9 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24072024-09-03T23:02:22.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fbf31676-ffff-41c9-afef-995e2cb9b2f9 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24082024-09-03T23:02:22.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fbf31676-ffff-41c9-afef-995e2cb9b2f9 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24092024-09-03T23:02:23.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fd642ff0-197c-48f8-9fbb-ab58cc10c2e6 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24102024-09-03T23:02:23.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fd642ff0-197c-48f8-9fbb-ab58cc10c2e6 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24112024-09-03T23:02:23.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = fd642ff0-197c-48f8-9fbb-ab58cc10c2e6 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
24122024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
24132024-09-03T23:02:24.066ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc
24142024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 26.111\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc"}
24152024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
24162024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
24172024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
24182024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24192024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24202024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
24212024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
24222024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24232024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
24242024-09-03T23:02:24.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24252024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24262024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
24272024-09-03T23:02:24.067ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
24282024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
24292024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24302024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24312024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
24322024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24332024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
24342024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24352024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
24362024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24372024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
24382024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
24392024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
24402024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24412024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
24422024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
24432024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24442024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
24452024-09-03T23:02:24.067ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
24462024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24472024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
24482024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24492024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
24502024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24512024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
24522024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
24532024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24542024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
24552024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24562024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
24572024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
24582024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24592024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24602024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
24612024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24622024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24632024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
24642024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
24652024-09-03T23:02:24.067ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 22:52:24.067265570 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
24662024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
24672024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
24682024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24692024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
24702024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
24712024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24722024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24732024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24742024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24752024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24762024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24772024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24782024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24792024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24802024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24812024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24822024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24832024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24842024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24852024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24862024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24872024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24882024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24892024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24902024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24912024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24922024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24932024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24942024-09-03T23:02:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24952024-09-03T23:02:24.067ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5278d774-fcf6-40b9-b896-4e3af31c54b8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 312546509 } })
24962024-09-03T23:02:24.068ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d574b3d-97ce-4fc4-8255-27d61ab35e88.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9e590c60-1cc5-4f4c-8ae9-48abc39cb394.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 312629790 } })
24972024-09-03T23:02:24.068ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
24982024-09-03T23:02:24.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.483615ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
24992024-09-03T23:02:24.068ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
25002024-09-03T23:02:24.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.768708ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
25012024-09-03T23:02:24.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022024-09-03T23:02:24.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25032024-09-03T23:02:24.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25042024-09-03T23:02:24.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25052024-09-03T23:02:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25062024-09-03T23:02:24.072ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25072024-09-03T23:02:24.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25082024-09-03T23:02:24.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25092024-09-03T23:02:24.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25102024-09-03T23:02:24.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25112024-09-03T23:02:24.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25122024-09-03T23:02:24.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25132024-09-03T23:02:24.076ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.582028ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25142024-09-03T23:02:24.078ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 323294598 } })
25152024-09-03T23:02:24.079ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
25162024-09-03T23:02:24.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25172024-09-03T23:02:24.082ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25182024-09-03T23:02:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25192024-09-03T23:02:24.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25202024-09-03T23:02:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25212024-09-03T23:02:24.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25222024-09-03T23:02:24.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25232024-09-03T23:02:24.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25242024-09-03T23:02:24.088ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
25252024-09-03T23:02:24.088ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
25262024-09-03T23:02:24.088ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.198395ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
25272024-09-03T23:02:24.096ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 22:52:24.067265570 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
25282024-09-03T23:02:24.096ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 28.949815ms iteration = 8 status = {"expiration":"2024-09-03T22:52:24.067265570Z","pruned":[]}
25292024-09-03T23:02:24.099ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 32.620282ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
25302024-09-03T23:02:24.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 344764437 } })
25312024-09-03T23:02:24.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
25322024-09-03T23:02:24.103ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25332024-09-03T23:02:24.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25342024-09-03T23:02:24.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25352024-09-03T23:02:24.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25362024-09-03T23:02:24.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25372024-09-03T23:02:24.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25382024-09-03T23:02:24.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25392024-09-03T23:02:24.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25402024-09-03T23:02:24.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25412024-09-03T23:02:24.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.059264ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
25422024-09-03T23:02:24.141ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25432024-09-03T23:02:24.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25442024-09-03T23:02:24.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25452024-09-03T23:02:24.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25462024-09-03T23:02:24.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25472024-09-03T23:02:24.144ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25482024-09-03T23:02:24.144ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25492024-09-03T23:02:24.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25502024-09-03T23:02:24.145ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25512024-09-03T23:02:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25522024-09-03T23:02:24.146ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25532024-09-03T23:02:24.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25542024-09-03T23:02:24.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552024-09-03T23:02:24.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25562024-09-03T23:02:24.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25572024-09-03T23:02:24.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25582024-09-03T23:02:24.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25592024-09-03T23:02:24.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25602024-09-03T23:02:24.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25612024-09-03T23:02:24.151ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25622024-09-03T23:02:24.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25632024-09-03T23:02:24.153ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25642024-09-03T23:02:24.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25652024-09-03T23:02:24.154ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1125, tv_nsec: 398890408 } })
25662024-09-03T23:02:24.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25672024-09-03T23:02:24.154ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
25682024-09-03T23:02:24.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25692024-09-03T23:02:24.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 89.835715ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
25702024-09-03T23:02:24.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25712024-09-03T23:02:24.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25722024-09-03T23:02:24.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25732024-09-03T23:02:24.159ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
25742024-09-03T23:02:24.159ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25752024-09-03T23:02:24.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25762024-09-03T23:02:24.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25772024-09-03T23:02:24.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25782024-09-03T23:02:24.161ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25792024-09-03T23:02:24.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25802024-09-03T23:02:24.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25812024-09-03T23:02:24.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25822024-09-03T23:02:24.163ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25832024-09-03T23:02:24.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25842024-09-03T23:02:24.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25852024-09-03T23:02:24.165ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25862024-09-03T23:02:24.165ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25872024-09-03T23:02:24.165ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25882024-09-03T23:02:24.165ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25892024-09-03T23:02:24.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25902024-09-03T23:02:24.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25912024-09-03T23:02:24.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25922024-09-03T23:02:24.167ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25932024-09-03T23:02:24.167ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25942024-09-03T23:02:24.167ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.829916ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25952024-09-03T23:02:24.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25962024-09-03T23:02:24.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25972024-09-03T23:02:24.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25982024-09-03T23:02:24.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25992024-09-03T23:02:24.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26002024-09-03T23:02:24.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26012024-09-03T23:02:24.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26022024-09-03T23:02:24.182ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
26032024-09-03T23:02:24.182ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
26042024-09-03T23:02:24.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26052024-09-03T23:02:24.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26062024-09-03T23:02:24.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26072024-09-03T23:02:24.187ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26082024-09-03T23:02:24.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26092024-09-03T23:02:24.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26102024-09-03T23:02:24.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26112024-09-03T23:02:24.191ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26122024-09-03T23:02:24.192ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.200165ms iteration = 18 status = {"physical_disks_added":0}
26132024-09-03T23:02:24.193ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
26142024-09-03T23:02:24.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.047624ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
26152024-09-03T23:02:24.193ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26162024-09-03T23:02:24.193ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 22:55:54.269593 UTC dns_group = internal generation = 1
26172024-09-03T23:02:24.193ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 126.017383ms iteration = 9 status = {"generation":1}
26182024-09-03T23:02:24.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26192024-09-03T23:02:24.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26202024-09-03T23:02:24.195ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
26212024-09-03T23:02:24.195ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26222024-09-03T23:02:24.195ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 128.941433ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26232024-09-03T23:02:24.196ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c16d39a6-b85c-487c-99f4-0d02807395c9", "content-length": "26", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} })
26242024-09-03T23:02:24.196ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26252024-09-03T23:02:24.197ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26262024-09-03T23:02:24.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26272024-09-03T23:02:24.200ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26282024-09-03T23:02:24.200ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 133.419649ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26292024-09-03T23:02:24.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26302024-09-03T23:02:24.203ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26312024-09-03T23:02:24.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26322024-09-03T23:02:24.206ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26332024-09-03T23:02:24.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26342024-09-03T23:02:24.208ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26352024-09-03T23:02:24.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
26362024-09-03T23:02:24.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26372024-09-03T23:02:24.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26382024-09-03T23:02:24.210ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26392024-09-03T23:02:24.210ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26402024-09-03T23:02:24.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26412024-09-03T23:02:24.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26422024-09-03T23:02:24.212ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 145.427881ms iteration = 15 status = 0
26432024-09-03T23:02:24.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
26442024-09-03T23:02:24.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26452024-09-03T23:02:24.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26462024-09-03T23:02:24.215ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
26472024-09-03T23:02:24.215ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26482024-09-03T23:02:24.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26492024-09-03T23:02:24.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26502024-09-03T23:02:24.218ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
26512024-09-03T23:02:24.219ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
26522024-09-03T23:02:24.219ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
26532024-09-03T23:02:24.219ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26542024-09-03T23:02:24.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26552024-09-03T23:02:24.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26562024-09-03T23:02:24.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26572024-09-03T23:02:24.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26582024-09-03T23:02:24.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26592024-09-03T23:02:24.229ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
26602024-09-03T23:02:24.229ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 162.591105ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
26612024-09-03T23:02:24.231ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
26622024-09-03T23:02:24.231ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26632024-09-03T23:02:24.232ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4bd6f3a4-d3b3-4bf6-ad84-1f2fb476cf77", "content-length": "26", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} })
26642024-09-03T23:02:24.232ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26652024-09-03T23:02:24.234ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26662024-09-03T23:02:24.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 173.177943ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26672024-09-03T23:02:24.245ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26682024-09-03T23:02:24.245ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 179.042993ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
26692024-09-03T23:02:24.253ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
26702024-09-03T23:02:24.253ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26712024-09-03T23:02:24.253ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 185.976014ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
26722024-09-03T23:02:24.254ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T22:55:21.166044Z, time_modified: 2024-09-03T22:55:21.166044Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
26732024-09-03T23:02:24.254ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 186.715561ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]}},"default_endpoint":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26742024-09-03T23:02:24.255ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26752024-09-03T23:02:24.255ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
26762024-09-03T23:02:24.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26772024-09-03T23:02:24.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26782024-09-03T23:02:24.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26792024-09-03T23:02:24.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26802024-09-03T23:02:24.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26812024-09-03T23:02:24.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26822024-09-03T23:02:24.262ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
26832024-09-03T23:02:24.262ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26842024-09-03T23:02:24.262ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 22:55:55.157084 UTC dns_group = external generation = 2
26852024-09-03T23:02:24.262ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 195.758383ms iteration = 9 status = {"generation":2}
26862024-09-03T23:02:24.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26872024-09-03T23:02:24.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26882024-09-03T23:02:24.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26892024-09-03T23:02:24.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26902024-09-03T23:02:24.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26912024-09-03T23:02:24.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26922024-09-03T23:02:24.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26932024-09-03T23:02:24.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26942024-09-03T23:02:24.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26952024-09-03T23:02:24.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26962024-09-03T23:02:24.369ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
26972024-09-03T23:02:24.369ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26982024-09-03T23:02:24.369ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9e5a7f9f-78c8-4a69-b0d4-5e15c9ba7d21", "content-length": "26", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} })
26992024-09-03T23:02:24.370ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27002024-09-03T23:02:24.370ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
27012024-09-03T23:02:24.372ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
27022024-09-03T23:02:24.374ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
27032024-09-03T23:02:24.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bc5fcd4e-68f4-4870-997b-9b03032e3acf", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27042024-09-03T23:02:24.374ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27052024-09-03T23:02:24.376ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3821473c-c054-4bc8-af86-ade0b7d337cb", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27062024-09-03T23:02:24.376ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27072024-09-03T23:02:24.378ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27082024-09-03T23:02:24.378ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 311.707724ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27092024-09-03T23:02:24.425ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27102024-09-03T23:02:24.425ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ecbfbff1-2b4d-4aa1-8d96-47440e0ac176", "content-length": "2", "date": "Tue, 03 Sep 2024 23:02:23 GMT"} })
27112024-09-03T23:02:24.427ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27122024-09-03T23:02:24.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27132024-09-03T23:02:24.430ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 362.997726ms iteration = 15 status = null
27142024-09-03T23:02:24.436ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 369.823796ms iteration = 15 status = {}
27152024-09-03T23:02:24.437ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27162024-09-03T23:02:24.472ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27172024-09-03T23:02:24.478ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27182024-09-03T23:02:24.478ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "da48e1f0-cc3f-451f-9801-33836d2d57ec", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27192024-09-03T23:02:24.478ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27202024-09-03T23:02:24.480ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a03397df-5177-4330-8ec5-e15954bf30d0", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27212024-09-03T23:02:24.480ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27222024-09-03T23:02:24.482ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b42d9bca-ca58-4ded-bd68-ce3a2f6c1723", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27232024-09-03T23:02:24.482ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27242024-09-03T23:02:24.484ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27252024-09-03T23:02:24.484ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 416.732994ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27262024-09-03T23:02:24.498ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "93153fe8-88c6-4993-bdbe-3d7a3dd8a1b3", "content-length": "372", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} })
27272024-09-03T23:02:24.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27282024-09-03T23:02:24.498ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a0e9aa58-dcfd-4f8c-85e4-ba59b4829bd8", "content-length": "691", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} })
27292024-09-03T23:02:24.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27302024-09-03T23:02:24.498ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
27312024-09-03T23:02:24.498ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
27322024-09-03T23:02:24.498ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
27332024-09-03T23:02:24.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27342024-09-03T23:02:24.501ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 434.225432ms iteration = 16 status = {}
27352024-09-03T23:02:24.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27362024-09-03T23:02:24.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27372024-09-03T23:02:24.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27382024-09-03T23:02:24.507ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27392024-09-03T23:02:24.507ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "26882600-8607-483a-ac06-e2fdfe590e36", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} })
27402024-09-03T23:02:24.509ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.629337ms iteration = 17 status = {}
27412024-09-03T23:02:24.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27422024-09-03T23:02:24.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27432024-09-03T23:02:24.545ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 4a162852-b7fb-453d-8700-c28c90ceea1a, rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cfbbc591-5a71-4824-b45b-c64ca1770cd0) } rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
27442024-09-03T23:02:24.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27452024-09-03T23:02:24.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27462024-09-03T23:02:24.554ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27472024-09-03T23:02:24.555ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7e97809-2078-42f8-b17e-858ee197aead", "content-length": "121", "date": "Tue, 03 Sep 2024 23:02:23 GMT"} })
27482024-09-03T23:02:24.555ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
27492024-09-03T23:02:24.555ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cfbbc591-5a71-4824-b45b-c64ca1770cd0
27502024-09-03T23:02:24.555ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27512024-09-03T23:02:24.555ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27522024-09-03T23:02:24.555ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
27532024-09-03T23:02:24.555ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
27542024-09-03T23:02:24.555ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
27552024-09-03T23:02:24.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27562024-09-03T23:02:24.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27572024-09-03T23:02:24.556ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27582024-09-03T23:02:24.556ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a6ea8d94-e70e-4916-b13c-85cfa4f19db0", "content-length": "2", "date": "Tue, 03 Sep 2024 23:02:23 GMT"} })
27592024-09-03T23:02:24.556ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27602024-09-03T23:02:24.557ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9642249c-bf51-4551-afb2-a7316f4d4952", "content-length": "52", "date": "Tue, 03 Sep 2024 23:02:23 GMT"} })
27612024-09-03T23:02:24.557ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
27622024-09-03T23:02:24.557ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27632024-09-03T23:02:24.651ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "79a4f447-f439-4672-8e4b-8ca3ccddddf3", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} })
27642024-09-03T23:02:24.651ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch = Switch0
27652024-09-03T23:02:24.651ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27662024-09-03T23:02:24.743ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "57050c3f-4a9b-4bd0-aca7-33320d09d6ac", "content-length": "667", "date": "Tue, 03 Sep 2024 23:02:24 GMT"} })
27672024-09-03T23:02:24.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27682024-09-03T23:02:24.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27692024-09-03T23:02:24.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27702024-09-03T23:02:24.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27712024-09-03T23:02:24.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27722024-09-03T23:02:24.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27732024-09-03T23:02:24.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27742024-09-03T23:02:24.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27752024-09-03T23:02:24.761ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 694.089439ms iteration = 15 status = {}
27762024-09-03T23:02:24.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0ff08252-6687-48d0-a572-cc4e7697b778 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27772024-09-03T23:02:24.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0ff08252-6687-48d0-a572-cc4e7697b778 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27782024-09-03T23:02:24.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0ff08252-6687-48d0-a572-cc4e7697b778 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27792024-09-03T23:02:25.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = afa33ee2-b92c-4eca-80ef-a196dc762486 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27802024-09-03T23:02:25.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = afa33ee2-b92c-4eca-80ef-a196dc762486 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27812024-09-03T23:02:25.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = afa33ee2-b92c-4eca-80ef-a196dc762486 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27822024-09-03T23:02:26.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e565bc37-0552-4722-bc0c-257cfdf5a6c6 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27832024-09-03T23:02:26.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e565bc37-0552-4722-bc0c-257cfdf5a6c6 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27842024-09-03T23:02:26.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2504 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e565bc37-0552-4722-bc0c-257cfdf5a6c6 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27852024-09-03T23:02:27.392ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = c2f6c7dc-2b55-4232-a6f2-6a5b4817ae83 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
27862024-09-03T23:02:27.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 019a0a46-fdeb-44b6-a177-d46055c5c3c0 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27872024-09-03T23:02:27.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 019a0a46-fdeb-44b6-a177-d46055c5c3c0 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27882024-09-03T23:02:27.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 019a0a46-fdeb-44b6-a177-d46055c5c3c0 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27892024-09-03T23:02:29.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 008309e0-166d-421e-8d78-a61353efe4f3 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27902024-09-03T23:02:29.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 008309e0-166d-421e-8d78-a61353efe4f3 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27912024-09-03T23:02:29.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 008309e0-166d-421e-8d78-a61353efe4f3 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27922024-09-03T23:02:30.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d1000553-6e02-4dde-8a13-6a30b63f0e50 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27932024-09-03T23:02:30.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d1000553-6e02-4dde-8a13-6a30b63f0e50 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27942024-09-03T23:02:30.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d1000553-6e02-4dde-8a13-6a30b63f0e50 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27952024-09-03T23:02:31.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cda3ede7-b99d-4dfd-9a0f-889c6fd45f78 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27962024-09-03T23:02:31.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cda3ede7-b99d-4dfd-9a0f-889c6fd45f78 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27972024-09-03T23:02:31.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cda3ede7-b99d-4dfd-9a0f-889c6fd45f78 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27982024-09-03T23:02:32.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 66f517dc-8ab9-4cec-9c13-d0f3c168be9c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
27992024-09-03T23:02:32.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 66f517dc-8ab9-4cec-9c13-d0f3c168be9c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28002024-09-03T23:02:32.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 66f517dc-8ab9-4cec-9c13-d0f3c168be9c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28012024-09-03T23:02:33.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f5888d64-81ae-4434-a4b8-a4ebeacabded roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28022024-09-03T23:02:33.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f5888d64-81ae-4434-a4b8-a4ebeacabded resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28032024-09-03T23:02:33.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f5888d64-81ae-4434-a4b8-a4ebeacabded response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28042024-09-03T23:02:34.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
28052024-09-03T23:02:34.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28062024-09-03T23:02:34.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
28072024-09-03T23:02:34.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28082024-09-03T23:02:34.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28092024-09-03T23:02:34.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28102024-09-03T23:02:34.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28112024-09-03T23:02:34.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28122024-09-03T23:02:34.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28132024-09-03T23:02:34.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28142024-09-03T23:02:34.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28152024-09-03T23:02:34.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28162024-09-03T23:02:34.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28172024-09-03T23:02:34.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28182024-09-03T23:02:34.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28192024-09-03T23:02:34.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
28202024-09-03T23:02:34.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28212024-09-03T23:02:34.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28222024-09-03T23:02:34.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
28232024-09-03T23:02:34.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.845432ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
28242024-09-03T23:02:34.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.993395ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28252024-09-03T23:02:34.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48e7c98d-6b1f-4a5e-8b91-1d9761ecc3fb roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28262024-09-03T23:02:34.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48e7c98d-6b1f-4a5e-8b91-1d9761ecc3fb resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28272024-09-03T23:02:34.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48e7c98d-6b1f-4a5e-8b91-1d9761ecc3fb response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28282024-09-03T23:02:35.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 10320f4b-df6d-443d-b3ef-4a0c65b09a67 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28292024-09-03T23:02:35.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 10320f4b-df6d-443d-b3ef-4a0c65b09a67 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28302024-09-03T23:02:35.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 10320f4b-df6d-443d-b3ef-4a0c65b09a67 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28312024-09-03T23:02:36.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 795078d7-71c2-451e-8d49-d2a40b6a5e47 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28322024-09-03T23:02:36.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 795078d7-71c2-451e-8d49-d2a40b6a5e47 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28332024-09-03T23:02:36.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 795078d7-71c2-451e-8d49-d2a40b6a5e47 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28342024-09-03T23:02:37.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = be1a148f-6433-43d0-ab87-3d44c68450d1 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28352024-09-03T23:02:37.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = be1a148f-6433-43d0-ab87-3d44c68450d1 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28362024-09-03T23:02:37.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = be1a148f-6433-43d0-ab87-3d44c68450d1 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28372024-09-03T23:02:37.392ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1611 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = e15e3b56-9ab3-45b9-b457-9994b80632b4 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
28382024-09-03T23:02:38.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 069ea73b-d866-4d23-816b-01d3beed8628 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28392024-09-03T23:02:38.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 069ea73b-d866-4d23-816b-01d3beed8628 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28402024-09-03T23:02:38.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 069ea73b-d866-4d23-816b-01d3beed8628 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28412024-09-03T23:02:39.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bb487155-5f48-47fd-99ef-cb447678932a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28422024-09-03T23:02:39.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bb487155-5f48-47fd-99ef-cb447678932a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28432024-09-03T23:02:39.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bb487155-5f48-47fd-99ef-cb447678932a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28442024-09-03T23:02:40.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9400a86e-778a-4652-a8d1-ec5bc794e919 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28452024-09-03T23:02:40.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9400a86e-778a-4652-a8d1-ec5bc794e919 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28462024-09-03T23:02:40.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9400a86e-778a-4652-a8d1-ec5bc794e919 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28472024-09-03T23:02:41.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = acbbfa88-77ca-4bbe-9623-11d3638965e0 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28482024-09-03T23:02:41.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = acbbfa88-77ca-4bbe-9623-11d3638965e0 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28492024-09-03T23:02:41.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = acbbfa88-77ca-4bbe-9623-11d3638965e0 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28502024-09-03T23:02:42.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6bcb3044-713f-404e-8c9f-f10279bc1ee5 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28512024-09-03T23:02:42.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6bcb3044-713f-404e-8c9f-f10279bc1ee5 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28522024-09-03T23:02:42.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6bcb3044-713f-404e-8c9f-f10279bc1ee5 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28532024-09-03T23:02:43.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 33311580-8a8a-4f31-8f18-99517f92198c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28542024-09-03T23:02:43.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 33311580-8a8a-4f31-8f18-99517f92198c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28552024-09-03T23:02:43.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 33311580-8a8a-4f31-8f18-99517f92198c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28562024-09-03T23:02:44.066ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
28572024-09-03T23:02:44.066ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
28582024-09-03T23:02:44.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28592024-09-03T23:02:44.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28602024-09-03T23:02:44.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28612024-09-03T23:02:44.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28622024-09-03T23:02:44.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28632024-09-03T23:02:44.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28642024-09-03T23:02:44.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28652024-09-03T23:02:44.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.864639ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28662024-09-03T23:02:44.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28672024-09-03T23:02:44.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28682024-09-03T23:02:44.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28692024-09-03T23:02:44.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28702024-09-03T23:02:44.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28712024-09-03T23:02:44.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28722024-09-03T23:02:44.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
28732024-09-03T23:02:44.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28742024-09-03T23:02:44.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28752024-09-03T23:02:44.082ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
28762024-09-03T23:02:44.082ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.497918ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
28772024-09-03T23:02:44.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 09320356-4671-422e-ba8a-dde2084466b5 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28782024-09-03T23:02:44.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 09320356-4671-422e-ba8a-dde2084466b5 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28792024-09-03T23:02:44.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 09320356-4671-422e-ba8a-dde2084466b5 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28802024-09-03T23:02:45.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 6e49a4bd-aa51-424b-89aa-9fa5745933bc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
28812024-09-03T23:02:45.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 6e49a4bd-aa51-424b-89aa-9fa5745933bc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
28822024-09-03T23:02:45.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 6e49a4bd-aa51-424b-89aa-9fa5745933bc response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
28832024-09-03T23:02:45.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 09a8406b-fa38-4030-af2e-9e41ef57e3bf roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28842024-09-03T23:02:45.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 09a8406b-fa38-4030-af2e-9e41ef57e3bf resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28852024-09-03T23:02:45.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 09a8406b-fa38-4030-af2e-9e41ef57e3bf response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28862024-09-03T23:02:46.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4bbf8460-21de-4c14-a8d8-4f3787980289 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28872024-09-03T23:02:46.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4bbf8460-21de-4c14-a8d8-4f3787980289 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28882024-09-03T23:02:46.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4bbf8460-21de-4c14-a8d8-4f3787980289 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28892024-09-03T23:02:47.391ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1701 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = b27146ff-c146-48dc-a73e-9d81781e9d00 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
28902024-09-03T23:02:47.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dcd625ae-04e8-413b-9ff9-1c36ff2bf78e roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28912024-09-03T23:02:47.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dcd625ae-04e8-413b-9ff9-1c36ff2bf78e resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28922024-09-03T23:02:47.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dcd625ae-04e8-413b-9ff9-1c36ff2bf78e response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28932024-09-03T23:02:48.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0e55ee0a-bdd4-492b-9bca-77f296167868 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28942024-09-03T23:02:48.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0e55ee0a-bdd4-492b-9bca-77f296167868 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28952024-09-03T23:02:48.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0e55ee0a-bdd4-492b-9bca-77f296167868 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28962024-09-03T23:02:49.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 79eb9972-4001-4927-bb9d-50ed444c146f roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28972024-09-03T23:02:49.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 79eb9972-4001-4927-bb9d-50ed444c146f resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28982024-09-03T23:02:49.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 79eb9972-4001-4927-bb9d-50ed444c146f response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
28992024-09-03T23:02:50.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = debe43b4-8b32-463f-a63a-a22f8395cf4f roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29002024-09-03T23:02:50.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = debe43b4-8b32-463f-a63a-a22f8395cf4f resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29012024-09-03T23:02:50.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = debe43b4-8b32-463f-a63a-a22f8395cf4f response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29022024-09-03T23:02:51.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 73aec9e5-8aaf-4bb9-97cd-e63ff928a5c5 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29032024-09-03T23:02:51.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 73aec9e5-8aaf-4bb9-97cd-e63ff928a5c5 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29042024-09-03T23:02:51.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 73aec9e5-8aaf-4bb9-97cd-e63ff928a5c5 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29052024-09-03T23:02:52.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48d27d84-1cb3-4632-9c3e-0ab3abfb33b1 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29062024-09-03T23:02:52.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48d27d84-1cb3-4632-9c3e-0ab3abfb33b1 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29072024-09-03T23:02:52.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 48d27d84-1cb3-4632-9c3e-0ab3abfb33b1 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29082024-09-03T23:02:53.470ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:49494
29092024-09-03T23:02:53.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49494 req_id = 7b93b282-45bb-4f11-a2d9-c13ebd1baadf roles = RoleSet { roles: {} } uri = /metrics/producers
29102024-09-03T23:02:53.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49494 req_id = 7b93b282-45bb-4f11-a2d9-c13ebd1baadf resource = Database result = Ok(()) uri = /metrics/producers
29112024-09-03T23:02:53.504ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
29122024-09-03T23:02:53.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49494 req_id = 7b93b282-45bb-4f11-a2d9-c13ebd1baadf roles = RoleSet { roles: {} } uri = /metrics/producers
29132024-09-03T23:02:53.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49494 req_id = 7b93b282-45bb-4f11-a2d9-c13ebd1baadf resource = Database result = Ok(()) uri = /metrics/producers
29142024-09-03T23:02:53.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 61514b69-a1b1-401d-bcde-72d2a8c81dec roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29152024-09-03T23:02:53.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 61514b69-a1b1-401d-bcde-72d2a8c81dec resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29162024-09-03T23:02:53.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 61514b69-a1b1-401d-bcde-72d2a8c81dec response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
29172024-09-03T23:02:53.542ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
29182024-09-03T23:02:53.543ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "160643eb-31d3-4fe6-9424-eb533a6b9847", "date": "Tue, 03 Sep 2024 23:02:53 GMT"} })
29192024-09-03T23:02:53.543ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = a7982f14-99ae-4669-9eb0-479a503efbc4
29202024-09-03T23:02:53.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 74587 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49494 req_id = 7b93b282-45bb-4f11-a2d9-c13ebd1baadf response_code = 201 uri = /metrics/producers
29212024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
29222024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29232024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
29242024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
29252024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29262024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29272024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
29282024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
29292024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29302024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29312024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29322024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
29332024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
29342024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29352024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29362024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
29372024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29382024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
29392024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
29402024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29412024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
29422024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29432024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29442024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
29452024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
29462024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29472024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
29482024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
29492024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29502024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
29512024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29522024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29532024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
29542024-09-03T23:02:54.067ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29552024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29562024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29572024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29582024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29592024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29602024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29612024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29622024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29632024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29642024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29652024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29662024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29672024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29682024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29692024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29702024-09-03T23:02:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29712024-09-03T23:02:54.073ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.490786ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29722024-09-03T23:02:54.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.141833ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
29732024-09-03T23:02:54.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29742024-09-03T23:02:54.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29752024-09-03T23:02:54.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762024-09-03T23:02:54.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29772024-09-03T23:02:54.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29782024-09-03T23:02:54.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29792024-09-03T23:02:54.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29802024-09-03T23:02:54.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29812024-09-03T23:02:54.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29822024-09-03T23:02:54.076ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29832024-09-03T23:02:54.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29842024-09-03T23:02:54.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29852024-09-03T23:02:54.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29862024-09-03T23:02:54.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29872024-09-03T23:02:54.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29882024-09-03T23:02:54.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29892024-09-03T23:02:54.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902024-09-03T23:02:54.080ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
29912024-09-03T23:02:54.080ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29922024-09-03T23:02:54.080ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29932024-09-03T23:02:54.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29942024-09-03T23:02:54.080ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 324924273 } })
29952024-09-03T23:02:54.081ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
29962024-09-03T23:02:54.081ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 325605900 } })
29972024-09-03T23:02:54.081ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
29982024-09-03T23:02:54.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29992024-09-03T23:02:54.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30002024-09-03T23:02:54.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30012024-09-03T23:02:54.083ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30022024-09-03T23:02:54.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30032024-09-03T23:02:54.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30042024-09-03T23:02:54.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1155, tv_nsec: 329877253 } })
30052024-09-03T23:02:54.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30062024-09-03T23:02:54.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
30072024-09-03T23:02:54.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30082024-09-03T23:02:54.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30092024-09-03T23:02:54.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30102024-09-03T23:02:54.086ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30112024-09-03T23:02:54.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30122024-09-03T23:02:54.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30132024-09-03T23:02:54.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30142024-09-03T23:02:54.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30152024-09-03T23:02:54.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30162024-09-03T23:02:54.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30172024-09-03T23:02:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
30182024-09-03T23:02:54.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30192024-09-03T23:02:54.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30202024-09-03T23:02:54.094ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30212024-09-03T23:02:54.094ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.188736ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30222024-09-03T23:02:54.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30232024-09-03T23:02:54.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30242024-09-03T23:02:54.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30252024-09-03T23:02:54.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
30262024-09-03T23:02:54.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.078108ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
30272024-09-03T23:02:54.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.380442ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
30282024-09-03T23:02:54.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30292024-09-03T23:02:54.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30302024-09-03T23:02:54.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30312024-09-03T23:02:54.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.031111ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30322024-09-03T23:02:54.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.338274ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30332024-09-03T23:02:54.126ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30342024-09-03T23:02:54.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30352024-09-03T23:02:54.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30362024-09-03T23:02:54.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30372024-09-03T23:02:54.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30382024-09-03T23:02:54.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30392024-09-03T23:02:54.129ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.597057ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
30402024-09-03T23:02:54.129ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
30412024-09-03T23:02:54.129ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30422024-09-03T23:02:54.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30432024-09-03T23:02:54.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30442024-09-03T23:02:54.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30452024-09-03T23:02:54.138ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
30462024-09-03T23:02:54.138ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30472024-09-03T23:02:54.139ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "660da245-49fc-4bf5-baf4-2dd6ff17d6a4", "content-length": "26", "date": "Tue, 03 Sep 2024 23:02:53 GMT"} })
30482024-09-03T23:02:54.139ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30492024-09-03T23:02:54.141ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30502024-09-03T23:02:54.143ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
30512024-09-03T23:02:54.143ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30522024-09-03T23:02:54.143ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "38b863f8-e32b-4fe2-9d47-3307cd764449", "content-length": "26", "date": "Tue, 03 Sep 2024 23:02:53 GMT"} })
30532024-09-03T23:02:54.143ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30542024-09-03T23:02:54.145ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
30552024-09-03T23:02:54.146ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
30562024-09-03T23:02:54.146ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30572024-09-03T23:02:54.146ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4f8e258d-70b0-4d28-915e-56a25a90b23c", "content-length": "26", "date": "Tue, 03 Sep 2024 23:02:53 GMT"} })
30582024-09-03T23:02:54.146ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30592024-09-03T23:02:54.147ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30602024-09-03T23:02:54.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30612024-09-03T23:02:54.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30622024-09-03T23:02:54.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30632024-09-03T23:02:54.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30642024-09-03T23:02:54.156ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30652024-09-03T23:02:54.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30662024-09-03T23:02:54.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 90.164208ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30672024-09-03T23:02:54.158ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
30682024-09-03T23:02:54.158ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30692024-09-03T23:02:54.158ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.065187ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
30702024-09-03T23:02:54.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30712024-09-03T23:02:54.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
30722024-09-03T23:02:54.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30732024-09-03T23:02:54.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30742024-09-03T23:02:54.188ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.051242ms iteration = 16 status = 0
30752024-09-03T23:02:54.188ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30762024-09-03T23:02:54.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30772024-09-03T23:02:54.194ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.635579ms iteration = 19 status = {"physical_disks_added":0}
30782024-09-03T23:02:54.255ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 187.750062ms iteration = 16 status = {}
30792024-09-03T23:02:54.257ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30802024-09-03T23:02:54.258ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6406a3fd-b491-4d38-9846-b111b8625457", "content-length": "2", "date": "Tue, 03 Sep 2024 23:02:53 GMT"} })
30812024-09-03T23:02:54.261ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30822024-09-03T23:02:54.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30832024-09-03T23:02:54.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30842024-09-03T23:02:54.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30852024-09-03T23:02:54.268ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 200.699194ms iteration = 16 status = null
30862024-09-03T23:02:54.271ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30872024-09-03T23:02:54.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30882024-09-03T23:02:54.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30892024-09-03T23:02:54.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30902024-09-03T23:02:54.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30912024-09-03T23:02:54.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30922024-09-03T23:02:54.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30932024-09-03T23:02:54.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30942024-09-03T23:02:54.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30952024-09-03T23:02:54.291ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "85a7b58b-b1a9-42d5-b6ab-8642cb8695e3", "content-length": "372", "date": "Tue, 03 Sep 2024 23:02:54 GMT"} })
30962024-09-03T23:02:54.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30972024-09-03T23:02:54.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30982024-09-03T23:02:54.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30992024-09-03T23:02:54.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31002024-09-03T23:02:54.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31012024-09-03T23:02:54.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31022024-09-03T23:02:54.300ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31032024-09-03T23:02:54.301ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "79d20b6d-115d-49aa-983f-c68043201b58", "date": "Tue, 03 Sep 2024 23:02:54 GMT"} })
31042024-09-03T23:02:54.303ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 235.67775ms iteration = 18 status = {}
31052024-09-03T23:02:54.342ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31062024-09-03T23:02:54.342ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "60031e1f-2214-413f-aaa2-dd63490a1b1a", "content-length": "691", "date": "Tue, 03 Sep 2024 23:02:54 GMT"} })
31072024-09-03T23:02:54.342ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31082024-09-03T23:02:54.342ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31092024-09-03T23:02:54.342ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31102024-09-03T23:02:54.344ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 277.033521ms iteration = 17 status = {}
31112024-09-03T23:02:54.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31122024-09-03T23:02:54.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31132024-09-03T23:02:54.357ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 4a162852-b7fb-453d-8700-c28c90ceea1a, rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cfbbc591-5a71-4824-b45b-c64ca1770cd0) } rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
31142024-09-03T23:02:54.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31152024-09-03T23:02:54.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31162024-09-03T23:02:54.367ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31172024-09-03T23:02:54.367ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0b5e37a5-d93d-4210-9739-1d817ba7bb02", "content-length": "121", "date": "Tue, 03 Sep 2024 23:02:53 GMT"} })
31182024-09-03T23:02:54.367ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
31192024-09-03T23:02:54.367ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cfbbc591-5a71-4824-b45b-c64ca1770cd0
31202024-09-03T23:02:54.367ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31212024-09-03T23:02:54.367ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31222024-09-03T23:02:54.367ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
31232024-09-03T23:02:54.367ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
31242024-09-03T23:02:54.367ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
31252024-09-03T23:02:54.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31262024-09-03T23:02:54.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31272024-09-03T23:02:54.369ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31282024-09-03T23:02:54.369ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "156591b0-333c-4209-aa5c-54a95940e1c2", "content-length": "2", "date": "Tue, 03 Sep 2024 23:02:53 GMT"} })
31292024-09-03T23:02:54.369ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31302024-09-03T23:02:54.370ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "021ce3e6-2f95-4356-ad61-edf3074fef1b", "content-length": "52", "date": "Tue, 03 Sep 2024 23:02:53 GMT"} })
31312024-09-03T23:02:54.370ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
31322024-09-03T23:02:54.370ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31332024-09-03T23:02:54.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0d3cb84b-8080-4419-a3da-23764bd8c505", "date": "Tue, 03 Sep 2024 23:02:54 GMT"} })
31342024-09-03T23:02:54.484ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch = Switch0
31352024-09-03T23:02:54.484ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31362024-09-03T23:02:54.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6b885c7f-0eb6-4ce0-bd64-f8653ec1f7ef", "content-length": "667", "date": "Tue, 03 Sep 2024 23:02:54 GMT"} })
31372024-09-03T23:02:54.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31382024-09-03T23:02:54.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31392024-09-03T23:02:54.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31402024-09-03T23:02:54.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31412024-09-03T23:02:54.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31422024-09-03T23:02:54.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31432024-09-03T23:02:54.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31442024-09-03T23:02:54.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31452024-09-03T23:02:54.501ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.444474ms iteration = 16 status = {}
31462024-09-03T23:02:54.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bf7ff61a-4461-4092-991f-4184a6ab3fe9 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31472024-09-03T23:02:54.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bf7ff61a-4461-4092-991f-4184a6ab3fe9 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31482024-09-03T23:02:54.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bf7ff61a-4461-4092-991f-4184a6ab3fe9 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31492024-09-03T23:02:54.639ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:64528
31502024-09-03T23:02:54.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64528 req_id = 55a7429b-6799-414a-970d-560fe426b71c roles = RoleSet { roles: {} } uri = /metrics/producers
31512024-09-03T23:02:54.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64528 req_id = 55a7429b-6799-414a-970d-560fe426b71c resource = Database result = Ok(()) uri = /metrics/producers
31522024-09-03T23:02:54.672ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
31532024-09-03T23:02:54.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64528 req_id = 55a7429b-6799-414a-970d-560fe426b71c roles = RoleSet { roles: {} } uri = /metrics/producers
31542024-09-03T23:02:54.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64528 req_id = 55a7429b-6799-414a-970d-560fe426b71c resource = Database result = Ok(()) uri = /metrics/producers
31552024-09-03T23:02:54.703ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
31562024-09-03T23:02:54.703ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7ca1c6bb-4950-4230-a637-2d71d3fe9100", "date": "Tue, 03 Sep 2024 23:02:54 GMT"} })
31572024-09-03T23:02:54.703ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = d2df786c-b519-4bd8-beec-40bdc5ddeeaa
31582024-09-03T23:02:54.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 65312 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64528 req_id = 55a7429b-6799-414a-970d-560fe426b71c response_code = 201 uri = /metrics/producers
31592024-09-03T23:02:54.714ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:46346
31602024-09-03T23:02:54.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46346 req_id = 99e8baad-82ff-45d9-9a59-2026dfd46bbc roles = RoleSet { roles: {} } uri = /metrics/producers
31612024-09-03T23:02:54.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46346 req_id = 99e8baad-82ff-45d9-9a59-2026dfd46bbc resource = Database result = Ok(()) uri = /metrics/producers
31622024-09-03T23:02:54.747ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
31632024-09-03T23:02:54.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46346 req_id = 99e8baad-82ff-45d9-9a59-2026dfd46bbc roles = RoleSet { roles: {} } uri = /metrics/producers
31642024-09-03T23:02:54.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46346 req_id = 99e8baad-82ff-45d9-9a59-2026dfd46bbc resource = Database result = Ok(()) uri = /metrics/producers
31652024-09-03T23:02:54.778ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
31662024-09-03T23:02:54.778ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c96ac4a1-1afe-4114-9bd7-57f7836bca99", "date": "Tue, 03 Sep 2024 23:02:54 GMT"} })
31672024-09-03T23:02:54.778ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = 03fe690d-d383-493d-857f-957a03d9553b
31682024-09-03T23:02:54.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 64965 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46346 req_id = 99e8baad-82ff-45d9-9a59-2026dfd46bbc response_code = 201 uri = /metrics/producers
31692024-09-03T23:02:55.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e9c84004-66df-46c3-911e-d750524bd63d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31702024-09-03T23:02:55.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e9c84004-66df-46c3-911e-d750524bd63d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31712024-09-03T23:02:55.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e9c84004-66df-46c3-911e-d750524bd63d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31722024-09-03T23:02:55.658ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45850
31732024-09-03T23:02:55.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45850 req_id = 3ff59921-7076-4a45-9c5c-eb480b6b0cf4 roles = RoleSet { roles: {} } uri = /metrics/producers
31742024-09-03T23:02:55.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45850 req_id = 3ff59921-7076-4a45-9c5c-eb480b6b0cf4 resource = Database result = Ok(()) uri = /metrics/producers
31752024-09-03T23:02:55.692ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
31762024-09-03T23:02:55.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45850 req_id = 3ff59921-7076-4a45-9c5c-eb480b6b0cf4 roles = RoleSet { roles: {} } uri = /metrics/producers
31772024-09-03T23:02:55.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45850 req_id = 3ff59921-7076-4a45-9c5c-eb480b6b0cf4 resource = Database result = Ok(()) uri = /metrics/producers
31782024-09-03T23:02:55.698ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
31792024-09-03T23:02:55.698ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "57dd782e-db36-4149-ab64-56f865abba87", "date": "Tue, 03 Sep 2024 23:02:54 GMT"} })
31802024-09-03T23:02:55.698ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = 89f5495b-6ef3-4e29-8cc7-26837304b70a
31812024-09-03T23:02:55.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 40454 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45850 req_id = 3ff59921-7076-4a45-9c5c-eb480b6b0cf4 response_code = 201 uri = /metrics/producers
31822024-09-03T23:02:56.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 574b36a8-d17e-41d3-971d-c4524ec7315a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31832024-09-03T23:02:56.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 574b36a8-d17e-41d3-971d-c4524ec7315a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31842024-09-03T23:02:56.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 574b36a8-d17e-41d3-971d-c4524ec7315a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31852024-09-03T23:02:57.392ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1406 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 670697a7-8b91-4bc1-8d33-99f9b78d1803 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
31862024-09-03T23:02:57.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cab56bac-5b91-454a-8bb7-8691232abce9 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31872024-09-03T23:02:57.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cab56bac-5b91-454a-8bb7-8691232abce9 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31882024-09-03T23:02:57.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cab56bac-5b91-454a-8bb7-8691232abce9 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31892024-09-03T23:02:58.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a0bd01aa-324e-479e-8f1a-2dc1dba92082 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31902024-09-03T23:02:58.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a0bd01aa-324e-479e-8f1a-2dc1dba92082 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31912024-09-03T23:02:58.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a0bd01aa-324e-479e-8f1a-2dc1dba92082 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31922024-09-03T23:02:59.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b062840a-8804-4ee4-9059-2fc5b18c7f21 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31932024-09-03T23:02:59.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b062840a-8804-4ee4-9059-2fc5b18c7f21 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31942024-09-03T23:02:59.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b062840a-8804-4ee4-9059-2fc5b18c7f21 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
31952024-09-03T23:02:59.843ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36018
31962024-09-03T23:02:59.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36018 req_id = 8657ff72-e3cd-440f-bf52-91ddb63d3c88 roles = RoleSet { roles: {} } uri = /metrics/producers
31972024-09-03T23:02:59.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36018 req_id = 8657ff72-e3cd-440f-bf52-91ddb63d3c88 resource = Database result = Ok(()) uri = /metrics/producers
31982024-09-03T23:02:59.876ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
31992024-09-03T23:02:59.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36018 req_id = 8657ff72-e3cd-440f-bf52-91ddb63d3c88 roles = RoleSet { roles: {} } uri = /metrics/producers
32002024-09-03T23:02:59.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36018 req_id = 8657ff72-e3cd-440f-bf52-91ddb63d3c88 resource = Database result = Ok(()) uri = /metrics/producers
32012024-09-03T23:02:59.910ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
32022024-09-03T23:02:59.911ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "546fd9de-26ff-40c3-8245-70f3d0783939", "date": "Tue, 03 Sep 2024 23:02:59 GMT"} })
32032024-09-03T23:02:59.911ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = 41260b76-4f8a-476c-bd42-eab3a900da1f
32042024-09-03T23:02:59.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 68885 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36018 req_id = 8657ff72-e3cd-440f-bf52-91ddb63d3c88 response_code = 201 uri = /metrics/producers
32052024-09-03T23:03:00.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 37b08ffd-0b29-42d1-8558-1ca7dbcd974b roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32062024-09-03T23:03:00.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 37b08ffd-0b29-42d1-8558-1ca7dbcd974b resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32072024-09-03T23:03:00.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 37b08ffd-0b29-42d1-8558-1ca7dbcd974b response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32082024-09-03T23:03:01.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 05a90942-e4e8-440e-ae9f-8f16b84c24a7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32092024-09-03T23:03:01.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 05a90942-e4e8-440e-ae9f-8f16b84c24a7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32102024-09-03T23:03:01.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 05a90942-e4e8-440e-ae9f-8f16b84c24a7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32112024-09-03T23:03:02.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 895c9a83-b07c-4c82-ab0e-3d0fe5c8f7e4 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32122024-09-03T23:03:02.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 895c9a83-b07c-4c82-ab0e-3d0fe5c8f7e4 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32132024-09-03T23:03:02.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 895c9a83-b07c-4c82-ab0e-3d0fe5c8f7e4 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32142024-09-03T23:03:03.547ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35509
32152024-09-03T23:03:03.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35509 req_id = a40a92ef-be5c-4e16-83df-ea359c2da2c2 roles = RoleSet { roles: {} } uri = /metrics/producers
32162024-09-03T23:03:03.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35509 req_id = a40a92ef-be5c-4e16-83df-ea359c2da2c2 resource = Database result = Ok(()) uri = /metrics/producers
32172024-09-03T23:03:03.580ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
32182024-09-03T23:03:03.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35509 req_id = a40a92ef-be5c-4e16-83df-ea359c2da2c2 roles = RoleSet { roles: {} } uri = /metrics/producers
32192024-09-03T23:03:03.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35509 req_id = a40a92ef-be5c-4e16-83df-ea359c2da2c2 resource = Database result = Ok(()) uri = /metrics/producers
32202024-09-03T23:03:03.589ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
32212024-09-03T23:03:03.589ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e8c87b4d-acab-4558-86e1-27584089df62", "date": "Tue, 03 Sep 2024 23:03:03 GMT"} })
32222024-09-03T23:03:03.589ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = a1a183ab-e40f-43f9-9004-475f15db5d85
32232024-09-03T23:03:03.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 42962 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35509 req_id = a40a92ef-be5c-4e16-83df-ea359c2da2c2 response_code = 201 uri = /metrics/producers
32242024-09-03T23:03:03.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = df9125e0-95a3-4526-a083-1babb21b5dad roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32252024-09-03T23:03:03.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = df9125e0-95a3-4526-a083-1babb21b5dad resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32262024-09-03T23:03:03.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = df9125e0-95a3-4526-a083-1babb21b5dad response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32272024-09-03T23:03:04.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
32282024-09-03T23:03:04.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32292024-09-03T23:03:04.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
32302024-09-03T23:03:04.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32312024-09-03T23:03:04.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32322024-09-03T23:03:04.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32332024-09-03T23:03:04.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32342024-09-03T23:03:04.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32352024-09-03T23:03:04.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32362024-09-03T23:03:04.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32372024-09-03T23:03:04.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32382024-09-03T23:03:04.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32392024-09-03T23:03:04.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32402024-09-03T23:03:04.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
32412024-09-03T23:03:04.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32422024-09-03T23:03:04.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32432024-09-03T23:03:04.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
32442024-09-03T23:03:04.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.288216ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
32452024-09-03T23:03:04.095ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32462024-09-03T23:03:04.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32472024-09-03T23:03:04.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.209452ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32482024-09-03T23:03:04.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 00679df8-0b2b-4f8a-97fa-923d4a1302f8 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32492024-09-03T23:03:04.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 00679df8-0b2b-4f8a-97fa-923d4a1302f8 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32502024-09-03T23:03:04.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 00679df8-0b2b-4f8a-97fa-923d4a1302f8 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32512024-09-03T23:03:05.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 900e4e20-63f1-4fb8-9d7f-ae9ea8e4d935 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32522024-09-03T23:03:05.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 900e4e20-63f1-4fb8-9d7f-ae9ea8e4d935 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32532024-09-03T23:03:05.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 900e4e20-63f1-4fb8-9d7f-ae9ea8e4d935 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32542024-09-03T23:03:06.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 96dbcd3b-7a0e-490a-bd5b-3ac0a6b65b18 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32552024-09-03T23:03:06.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 96dbcd3b-7a0e-490a-bd5b-3ac0a6b65b18 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32562024-09-03T23:03:06.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 96dbcd3b-7a0e-490a-bd5b-3ac0a6b65b18 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32572024-09-03T23:03:07.392ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1670 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 6b7cff44-a90a-44a8-8d63-14cb9eff5aff response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
32582024-09-03T23:03:07.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ae32f23d-8616-4ad1-b008-3173c60e5386 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32592024-09-03T23:03:07.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ae32f23d-8616-4ad1-b008-3173c60e5386 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32602024-09-03T23:03:07.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ae32f23d-8616-4ad1-b008-3173c60e5386 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32612024-09-03T23:03:08.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d95c8214-e467-4e7b-8f6e-38de9e25b575 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32622024-09-03T23:03:08.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d95c8214-e467-4e7b-8f6e-38de9e25b575 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32632024-09-03T23:03:08.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d95c8214-e467-4e7b-8f6e-38de9e25b575 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32642024-09-03T23:03:09.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 42c945ab-117d-4319-a6ec-e22baa2ab228 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32652024-09-03T23:03:09.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 42c945ab-117d-4319-a6ec-e22baa2ab228 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32662024-09-03T23:03:09.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 42c945ab-117d-4319-a6ec-e22baa2ab228 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32672024-09-03T23:03:10.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a282b738-a1b4-46fa-80bc-cc7a7c746685 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32682024-09-03T23:03:10.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a282b738-a1b4-46fa-80bc-cc7a7c746685 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32692024-09-03T23:03:10.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a282b738-a1b4-46fa-80bc-cc7a7c746685 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32702024-09-03T23:03:11.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9b82f13e-3a1c-4d98-a016-b938df35b727 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32712024-09-03T23:03:11.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9b82f13e-3a1c-4d98-a016-b938df35b727 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32722024-09-03T23:03:11.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9b82f13e-3a1c-4d98-a016-b938df35b727 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32732024-09-03T23:03:12.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9887906d-55f1-4fa9-8a06-399426b4f947 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32742024-09-03T23:03:12.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9887906d-55f1-4fa9-8a06-399426b4f947 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32752024-09-03T23:03:12.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 9887906d-55f1-4fa9-8a06-399426b4f947 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32762024-09-03T23:03:13.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 489fa325-6db8-4fe7-ac6f-a90abbd27694 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32772024-09-03T23:03:13.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 489fa325-6db8-4fe7-ac6f-a90abbd27694 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32782024-09-03T23:03:13.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 489fa325-6db8-4fe7-ac6f-a90abbd27694 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
32792024-09-03T23:03:14.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
32802024-09-03T23:03:14.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32812024-09-03T23:03:14.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
32822024-09-03T23:03:14.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32832024-09-03T23:03:14.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32842024-09-03T23:03:14.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32852024-09-03T23:03:14.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32862024-09-03T23:03:14.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32872024-09-03T23:03:14.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32882024-09-03T23:03:14.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32892024-09-03T23:03:14.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32902024-09-03T23:03:14.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32912024-09-03T23:03:14.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32922024-09-03T23:03:14.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
32932024-09-03T23:03:14.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32942024-09-03T23:03:14.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32952024-09-03T23:03:14.086ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
32962024-09-03T23:03:14.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.004613ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
32972024-09-03T23:03:14.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32982024-09-03T23:03:14.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32992024-09-03T23:03:14.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.703622ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33002024-09-03T23:03:14.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 769b3f9f-bf6b-4d27-915a-86adec0b0bc8 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33012024-09-03T23:03:14.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 769b3f9f-bf6b-4d27-915a-86adec0b0bc8 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33022024-09-03T23:03:14.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2038 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 769b3f9f-bf6b-4d27-915a-86adec0b0bc8 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33032024-09-03T23:03:15.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 646536d1-f44a-45df-a41d-0a58a5d7b03f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
33042024-09-03T23:03:15.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 646536d1-f44a-45df-a41d-0a58a5d7b03f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
33052024-09-03T23:03:15.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 646536d1-f44a-45df-a41d-0a58a5d7b03f response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
33062024-09-03T23:03:16.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 991f5222-da3f-4e59-8b24-b245d50f85b2 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33072024-09-03T23:03:16.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 991f5222-da3f-4e59-8b24-b245d50f85b2 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33082024-09-03T23:03:16.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 991f5222-da3f-4e59-8b24-b245d50f85b2 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33092024-09-03T23:03:17.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 60ab6224-1807-4889-b43e-1f5701726365 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33102024-09-03T23:03:17.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 60ab6224-1807-4889-b43e-1f5701726365 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33112024-09-03T23:03:17.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 60ab6224-1807-4889-b43e-1f5701726365 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33122024-09-03T23:03:17.392ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1672 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 4164fe29-4e75-43d7-9392-c08aaf8e2ac8 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
33132024-09-03T23:03:18.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2acfceb8-f1ad-482b-842d-83023e4b9371 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33142024-09-03T23:03:18.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2acfceb8-f1ad-482b-842d-83023e4b9371 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33152024-09-03T23:03:18.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2acfceb8-f1ad-482b-842d-83023e4b9371 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33162024-09-03T23:03:19.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 85a97ed5-d355-44f3-82e5-d10360d1afcf roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33172024-09-03T23:03:19.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 85a97ed5-d355-44f3-82e5-d10360d1afcf resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33182024-09-03T23:03:19.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 85a97ed5-d355-44f3-82e5-d10360d1afcf response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33192024-09-03T23:03:20.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 27ae158d-feae-4e9f-834b-ccbcead0b79e roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33202024-09-03T23:03:20.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 27ae158d-feae-4e9f-834b-ccbcead0b79e resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33212024-09-03T23:03:20.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 27ae158d-feae-4e9f-834b-ccbcead0b79e response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33222024-09-03T23:03:21.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c1b89738-a44c-4676-8300-6b66855a9108 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33232024-09-03T23:03:21.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c1b89738-a44c-4676-8300-6b66855a9108 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33242024-09-03T23:03:21.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c1b89738-a44c-4676-8300-6b66855a9108 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33252024-09-03T23:03:22.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dd9ff1d6-8b77-4bb3-a225-c66c72ac41d3 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33262024-09-03T23:03:22.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dd9ff1d6-8b77-4bb3-a225-c66c72ac41d3 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33272024-09-03T23:03:22.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dd9ff1d6-8b77-4bb3-a225-c66c72ac41d3 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33282024-09-03T23:03:23.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4d75ec6b-8102-42f8-983e-752b55f128b4 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33292024-09-03T23:03:23.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4d75ec6b-8102-42f8-983e-752b55f128b4 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33302024-09-03T23:03:23.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 4d75ec6b-8102-42f8-983e-752b55f128b4 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
33312024-09-03T23:03:24.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
33322024-09-03T23:03:24.068ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc
33332024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
33342024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.81\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc"}
33352024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
33362024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33372024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33382024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33392024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
33402024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33412024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
33422024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33432024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33442024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
33452024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
33462024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33472024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33482024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
33492024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33502024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
33512024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33522024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
33532024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33542024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
33552024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
33562024-09-03T23:03:24.068ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 22:53:24.068155478 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33572024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33582024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
33592024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
33602024-09-03T23:03:24.068ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33612024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
33622024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33632024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33642024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
33652024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
33662024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33672024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
33682024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33692024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
33702024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
33712024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33722024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33732024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
33742024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33752024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
33762024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
33772024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33782024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
33792024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33802024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33812024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
33822024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
33832024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33842024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
33852024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33862024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
33872024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33882024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
33892024-09-03T23:03:24.068ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
33902024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33912024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33922024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33932024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33942024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33952024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33962024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33972024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33982024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33992024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34002024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34012024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34022024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34032024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
34042024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34052024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34062024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34072024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34082024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34092024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34102024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34112024-09-03T23:03:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34122024-09-03T23:03:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34132024-09-03T23:03:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34142024-09-03T23:03:24.069ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d574b3d-97ce-4fc4-8255-27d61ab35e88.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9e590c60-1cc5-4f4c-8ae9-48abc39cb394.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 313163950 } })
34152024-09-03T23:03:24.069ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5278d774-fcf6-40b9-b896-4e3af31c54b8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 313164450 } })
34162024-09-03T23:03:24.069ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
34172024-09-03T23:03:24.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.750548ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
34182024-09-03T23:03:24.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34192024-09-03T23:03:24.069ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
34202024-09-03T23:03:24.069ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.600547ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
34212024-09-03T23:03:24.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34222024-09-03T23:03:24.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34232024-09-03T23:03:24.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34242024-09-03T23:03:24.072ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.530946ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34252024-09-03T23:03:24.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34262024-09-03T23:03:24.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34272024-09-03T23:03:24.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34282024-09-03T23:03:24.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34292024-09-03T23:03:24.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34302024-09-03T23:03:24.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34312024-09-03T23:03:24.075ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.971791ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
34322024-09-03T23:03:24.077ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 22:53:24.068155478 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34332024-09-03T23:03:24.077ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.565487ms iteration = 9 status = {"expiration":"2024-09-03T22:53:24.068155478Z","pruned":[]}
34342024-09-03T23:03:24.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34352024-09-03T23:03:24.079ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34362024-09-03T23:03:24.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34372024-09-03T23:03:24.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34382024-09-03T23:03:24.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34392024-09-03T23:03:24.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34402024-09-03T23:03:24.082ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34412024-09-03T23:03:24.082ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422024-09-03T23:03:24.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34432024-09-03T23:03:24.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 329537047 } })
34442024-09-03T23:03:24.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34452024-09-03T23:03:24.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34462024-09-03T23:03:24.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34472024-09-03T23:03:24.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
34482024-09-03T23:03:24.086ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
34492024-09-03T23:03:24.086ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
34502024-09-03T23:03:24.086ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.023954ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
34512024-09-03T23:03:24.088ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 332841230 } })
34522024-09-03T23:03:24.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
34532024-09-03T23:03:24.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1185, tv_nsec: 333500897 } })
34542024-09-03T23:03:24.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
34552024-09-03T23:03:24.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562024-09-03T23:03:24.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34572024-09-03T23:03:24.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34582024-09-03T23:03:24.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34592024-09-03T23:03:24.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34602024-09-03T23:03:24.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34612024-09-03T23:03:24.113ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
34622024-09-03T23:03:24.113ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34632024-09-03T23:03:24.113ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34642024-09-03T23:03:24.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34652024-09-03T23:03:24.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34662024-09-03T23:03:24.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34672024-09-03T23:03:24.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34682024-09-03T23:03:24.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34692024-09-03T23:03:24.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34702024-09-03T23:03:24.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34712024-09-03T23:03:24.124ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34722024-09-03T23:03:24.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.349224ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
34732024-09-03T23:03:24.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34742024-09-03T23:03:24.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34752024-09-03T23:03:24.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34762024-09-03T23:03:24.126ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34772024-09-03T23:03:24.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34782024-09-03T23:03:24.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.509796ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
34792024-09-03T23:03:24.128ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34802024-09-03T23:03:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34812024-09-03T23:03:24.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34822024-09-03T23:03:24.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34832024-09-03T23:03:24.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842024-09-03T23:03:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34852024-09-03T23:03:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34862024-09-03T23:03:24.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34872024-09-03T23:03:24.131ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34882024-09-03T23:03:24.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34892024-09-03T23:03:24.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34902024-09-03T23:03:24.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.625918ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
34912024-09-03T23:03:24.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34922024-09-03T23:03:24.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34932024-09-03T23:03:24.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34942024-09-03T23:03:24.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 70.593009ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34952024-09-03T23:03:24.139ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34962024-09-03T23:03:24.140ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34972024-09-03T23:03:24.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34982024-09-03T23:03:24.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34992024-09-03T23:03:24.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35002024-09-03T23:03:24.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.019884ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35012024-09-03T23:03:24.142ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.534219ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35022024-09-03T23:03:24.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35032024-09-03T23:03:24.143ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35042024-09-03T23:03:24.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35052024-09-03T23:03:24.146ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35062024-09-03T23:03:24.146ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35072024-09-03T23:03:24.146ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.50665ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35082024-09-03T23:03:24.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35092024-09-03T23:03:24.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35102024-09-03T23:03:24.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35112024-09-03T23:03:24.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35122024-09-03T23:03:24.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
35132024-09-03T23:03:24.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35142024-09-03T23:03:24.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35152024-09-03T23:03:24.152ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35162024-09-03T23:03:24.152ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35172024-09-03T23:03:24.152ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35182024-09-03T23:03:24.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35192024-09-03T23:03:24.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35202024-09-03T23:03:24.153ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35212024-09-03T23:03:24.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35222024-09-03T23:03:24.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35232024-09-03T23:03:24.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35242024-09-03T23:03:24.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35252024-09-03T23:03:24.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35262024-09-03T23:03:24.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35272024-09-03T23:03:24.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35282024-09-03T23:03:24.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35292024-09-03T23:03:24.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35302024-09-03T23:03:24.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35312024-09-03T23:03:24.159ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35322024-09-03T23:03:24.159ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35332024-09-03T23:03:24.160ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35342024-09-03T23:03:24.160ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35352024-09-03T23:03:24.160ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35362024-09-03T23:03:24.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35372024-09-03T23:03:24.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35382024-09-03T23:03:24.161ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
35392024-09-03T23:03:24.161ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.430101ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
35402024-09-03T23:03:24.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35412024-09-03T23:03:24.162ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35422024-09-03T23:03:24.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35432024-09-03T23:03:24.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
35442024-09-03T23:03:24.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35452024-09-03T23:03:24.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35462024-09-03T23:03:24.164ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
35472024-09-03T23:03:24.164ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35482024-09-03T23:03:24.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35492024-09-03T23:03:24.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35502024-09-03T23:03:24.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35512024-09-03T23:03:24.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35522024-09-03T23:03:24.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 007ab6dc-7dc6-423f-b103-e7ec78189e96 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
35532024-09-03T23:03:24.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 007ab6dc-7dc6-423f-b103-e7ec78189e96 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
35542024-09-03T23:03:24.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35552024-09-03T23:03:24.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35562024-09-03T23:03:24.204ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35572024-09-03T23:03:24.227ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
35582024-09-03T23:03:24.236ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35592024-09-03T23:03:24.236ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 168.463185ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35602024-09-03T23:03:24.264ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
35612024-09-03T23:03:24.264ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35622024-09-03T23:03:24.265ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "41da12f1-95e8-418b-aca2-90f79b51ccae", "content-length": "26", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} })
35632024-09-03T23:03:24.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35642024-09-03T23:03:24.266ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
35652024-09-03T23:03:24.313ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35662024-09-03T23:03:24.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "956743f2-ed3e-4b4e-bd4a-66e89145deee", "content-length": "372", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} })
35672024-09-03T23:03:24.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35682024-09-03T23:03:24.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35692024-09-03T23:03:24.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35702024-09-03T23:03:24.317ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 248.814703ms iteration = 17 status = 0
35712024-09-03T23:03:24.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35722024-09-03T23:03:24.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35732024-09-03T23:03:24.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35742024-09-03T23:03:24.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752024-09-03T23:03:24.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35762024-09-03T23:03:24.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 136872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 007ab6dc-7dc6-423f-b103-e7ec78189e96 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
35772024-09-03T23:03:24.323ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35782024-09-03T23:03:24.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35792024-09-03T23:03:24.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35802024-09-03T23:03:24.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35812024-09-03T23:03:24.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35822024-09-03T23:03:24.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35832024-09-03T23:03:24.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35842024-09-03T23:03:24.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35852024-09-03T23:03:24.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35862024-09-03T23:03:24.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35872024-09-03T23:03:24.339ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35882024-09-03T23:03:24.339ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1f972d9f-7c2d-4c38-aa8c-1ef817afd54f", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} })
35892024-09-03T23:03:24.342ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 274.083561ms iteration = 19 status = {}
35902024-09-03T23:03:24.353ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35912024-09-03T23:03:24.353ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35922024-09-03T23:03:24.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35932024-09-03T23:03:24.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35942024-09-03T23:03:24.354ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
35952024-09-03T23:03:24.354ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35962024-09-03T23:03:24.354ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 286.658359ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
35972024-09-03T23:03:24.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35982024-09-03T23:03:24.361ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35992024-09-03T23:03:24.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36002024-09-03T23:03:24.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36012024-09-03T23:03:24.364ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
36022024-09-03T23:03:24.364ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
36032024-09-03T23:03:24.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36042024-09-03T23:03:24.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36052024-09-03T23:03:24.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36062024-09-03T23:03:24.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36072024-09-03T23:03:24.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36082024-09-03T23:03:24.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36092024-09-03T23:03:24.371ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T22:55:21.166044Z, time_modified: 2024-09-03T22:55:21.166044Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }) }
36102024-09-03T23:03:24.371ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 302.576371ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]}},"default_endpoint":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36112024-09-03T23:03:24.372ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
36122024-09-03T23:03:24.372ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "11334ac3-037a-437e-8364-9845d012d8e5", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36132024-09-03T23:03:24.372ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36142024-09-03T23:03:24.372ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
36152024-09-03T23:03:24.372ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36162024-09-03T23:03:24.372ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 22:55:55.157084 UTC dns_group = external generation = 2
36172024-09-03T23:03:24.372ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 304.824404ms iteration = 10 status = {"generation":2}
36182024-09-03T23:03:24.373ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2fa622df-387c-498b-8e4d-0da1b1cfb071", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36192024-09-03T23:03:24.373ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36202024-09-03T23:03:24.376ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36212024-09-03T23:03:24.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 308.258499ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36222024-09-03T23:03:24.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36232024-09-03T23:03:24.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36242024-09-03T23:03:24.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36252024-09-03T23:03:24.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36262024-09-03T23:03:24.396ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36272024-09-03T23:03:24.399ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
36282024-09-03T23:03:24.399ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36292024-09-03T23:03:24.399ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 22:55:54.269593 UTC dns_group = internal generation = 1
36302024-09-03T23:03:24.399ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 331.016351ms iteration = 10 status = {"generation":1}
36312024-09-03T23:03:24.423ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 355.654482ms iteration = 20 status = {"physical_disks_added":0}
36322024-09-03T23:03:24.442ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36332024-09-03T23:03:24.442ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36342024-09-03T23:03:24.442ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a5d4aaa4-b784-4c73-9a13-970bc7e51e67", "content-length": "26", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} })
36352024-09-03T23:03:24.442ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36362024-09-03T23:03:24.444ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36372024-09-03T23:03:24.446ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
36382024-09-03T23:03:24.446ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36392024-09-03T23:03:24.446ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b246789e-b864-4c1c-8664-e0e5c96c94b8", "content-length": "26", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} })
36402024-09-03T23:03:24.446ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36412024-09-03T23:03:24.448ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36422024-09-03T23:03:24.538ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36432024-09-03T23:03:24.539ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f379d893-dd1c-4e82-89b7-7a3e585ece63", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36442024-09-03T23:03:24.539ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36452024-09-03T23:03:24.541ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ab82828f-6a39-4a54-b19a-ae6d1cb25020", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36462024-09-03T23:03:24.541ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36472024-09-03T23:03:24.543ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dd98c98f-28f7-4c9f-ba4e-7e44a3dddf8d", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36482024-09-03T23:03:24.543ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36492024-09-03T23:03:24.545ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36502024-09-03T23:03:24.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 476.727824ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36512024-09-03T23:03:24.561ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36522024-09-03T23:03:24.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f71756d9-db34-4f45-8395-896b4a2b0f2b", "content-length": "691", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} })
36532024-09-03T23:03:24.579ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36542024-09-03T23:03:24.579ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36552024-09-03T23:03:24.579ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36562024-09-03T23:03:24.582ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 513.908044ms iteration = 18 status = {}
36572024-09-03T23:03:24.677ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 609.370365ms iteration = 17 status = {}
36582024-09-03T23:03:24.680ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36592024-09-03T23:03:24.680ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7dfb3371-babb-4b1c-8537-2cb33fd704f6", "content-length": "2", "date": "Tue, 03 Sep 2024 23:03:23 GMT"} })
36602024-09-03T23:03:24.682ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36612024-09-03T23:03:24.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36622024-09-03T23:03:24.684ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 616.095194ms iteration = 17 status = null
36632024-09-03T23:03:24.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36642024-09-03T23:03:24.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36652024-09-03T23:03:24.700ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 4a162852-b7fb-453d-8700-c28c90ceea1a, rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cfbbc591-5a71-4824-b45b-c64ca1770cd0) } rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
36662024-09-03T23:03:24.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36672024-09-03T23:03:24.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36682024-09-03T23:03:24.708ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36692024-09-03T23:03:24.709ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd678195-bd99-456d-b04f-be062e24864b", "content-length": "121", "date": "Tue, 03 Sep 2024 23:03:23 GMT"} })
36702024-09-03T23:03:24.709ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
36712024-09-03T23:03:24.709ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cfbbc591-5a71-4824-b45b-c64ca1770cd0
36722024-09-03T23:03:24.709ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36732024-09-03T23:03:24.709ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36742024-09-03T23:03:24.709ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
36752024-09-03T23:03:24.709ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
36762024-09-03T23:03:24.709ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
36772024-09-03T23:03:24.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36782024-09-03T23:03:24.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36792024-09-03T23:03:24.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36802024-09-03T23:03:24.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c83d1def-9385-486e-955a-59e3f3bf946d", "content-length": "2", "date": "Tue, 03 Sep 2024 23:03:23 GMT"} })
36812024-09-03T23:03:24.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36822024-09-03T23:03:24.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "36855699-6ee4-466d-95ec-f1a39efece50", "content-length": "52", "date": "Tue, 03 Sep 2024 23:03:23 GMT"} })
36832024-09-03T23:03:24.711ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
36842024-09-03T23:03:24.711ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36852024-09-03T23:03:24.800ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1c9867e2-bc86-416c-a7c6-137404c98811", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} })
36862024-09-03T23:03:24.800ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch = Switch0
36872024-09-03T23:03:24.800ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36882024-09-03T23:03:24.807ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "09249c26-2295-4d9b-9aa1-a346d7b0ea6d", "content-length": "667", "date": "Tue, 03 Sep 2024 23:03:24 GMT"} })
36892024-09-03T23:03:24.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36902024-09-03T23:03:24.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36912024-09-03T23:03:24.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36922024-09-03T23:03:24.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36932024-09-03T23:03:24.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36942024-09-03T23:03:24.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36952024-09-03T23:03:24.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36962024-09-03T23:03:24.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36972024-09-03T23:03:24.824ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 756.916858ms iteration = 17 status = {}
36982024-09-03T23:03:25.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = af6372fe-bdef-4f9b-bf92-6d007cd1a9c5 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
36992024-09-03T23:03:25.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = af6372fe-bdef-4f9b-bf92-6d007cd1a9c5 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37002024-09-03T23:03:25.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = af6372fe-bdef-4f9b-bf92-6d007cd1a9c5 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37012024-09-03T23:03:26.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b466a993-03e1-419e-87e9-303ddd9dd460 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37022024-09-03T23:03:26.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b466a993-03e1-419e-87e9-303ddd9dd460 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37032024-09-03T23:03:26.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b466a993-03e1-419e-87e9-303ddd9dd460 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37042024-09-03T23:03:27.392ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1317 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 36fba762-6341-414d-ad28-c3da711efa40 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
37052024-09-03T23:03:27.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f067bc41-b344-48eb-a52b-a498d6a17c49 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37062024-09-03T23:03:27.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f067bc41-b344-48eb-a52b-a498d6a17c49 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37072024-09-03T23:03:27.393ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
37082024-09-03T23:03:27.393ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
37092024-09-03T23:03:27.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f067bc41-b344-48eb-a52b-a498d6a17c49 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37102024-09-03T23:03:27.424ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
37112024-09-03T23:03:27.424ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:58668
37122024-09-03T23:03:27.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58668 req_id = 1f0dc323-1900-4195-8907-f172ed7f071f roles = RoleSet { roles: {} } uri = /metrics/producers
37132024-09-03T23:03:27.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58668 req_id = 1f0dc323-1900-4195-8907-f172ed7f071f resource = Database result = Ok(()) uri = /metrics/producers
37142024-09-03T23:03:27.458ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = b68bfc69-03ee-47bf-98cb-cba092ae7190
37152024-09-03T23:03:27.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58668 req_id = 1f0dc323-1900-4195-8907-f172ed7f071f roles = RoleSet { roles: {} } uri = /metrics/producers
37162024-09-03T23:03:27.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58668 req_id = 1f0dc323-1900-4195-8907-f172ed7f071f resource = Database result = Ok(()) uri = /metrics/producers
37172024-09-03T23:03:27.495ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 uri = http://[fd00:1122:3344:101::d]:12223/producers
37182024-09-03T23:03:27.495ZDEBGnexus: client response oximeter-collector = b68bfc69-03ee-47bf-98cb-cba092ae7190 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e8569ac6-911d-45c3-8498-067e7deb4ad8", "date": "Tue, 03 Sep 2024 23:03:27 GMT"} })
37192024-09-03T23:03:27.495ZINFOnexus: assigned collector to new producer collector_id = b68bfc69-03ee-47bf-98cb-cba092ae7190 file = nexus/src/app/oximeter.rs:125 producer_id = 233bc5db-e41f-4898-a8d6-3cba2818c0c4
37202024-09-03T23:03:27.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 72443 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:58668 req_id = 1f0dc323-1900-4195-8907-f172ed7f071f response_code = 201 uri = /metrics/producers
37212024-09-03T23:03:27.497ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "1f0dc323-1900-4195-8907-f172ed7f071f", "content-length": "41", "date": "Tue, 03 Sep 2024 23:03:27 GMT"} })
37222024-09-03T23:03:27.499ZDEBGnexus (producer-registration-task): registered with nexus successfully
37232024-09-03T23:03:27.499ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
37242024-09-03T23:03:28.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 37665925-0c5e-4218-961e-eda7224a860e roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37252024-09-03T23:03:28.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 37665925-0c5e-4218-961e-eda7224a860e resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37262024-09-03T23:03:28.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 37665925-0c5e-4218-961e-eda7224a860e response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37272024-09-03T23:03:29.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = beea606d-c08d-4b4f-9d95-a3fe7ca7c3dd roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37282024-09-03T23:03:29.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = beea606d-c08d-4b4f-9d95-a3fe7ca7c3dd resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37292024-09-03T23:03:29.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = beea606d-c08d-4b4f-9d95-a3fe7ca7c3dd response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37302024-09-03T23:03:30.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e5ef18a7-59cf-49db-8682-abd4c76f674c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37312024-09-03T23:03:30.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e5ef18a7-59cf-49db-8682-abd4c76f674c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37322024-09-03T23:03:30.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e5ef18a7-59cf-49db-8682-abd4c76f674c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37332024-09-03T23:03:31.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 21ee5021-cfa5-4ff8-86b8-deabdbd66803 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37342024-09-03T23:03:31.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 21ee5021-cfa5-4ff8-86b8-deabdbd66803 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37352024-09-03T23:03:31.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 21ee5021-cfa5-4ff8-86b8-deabdbd66803 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37362024-09-03T23:03:32.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e72b6777-9c48-47b9-adeb-85d029b45db0 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37372024-09-03T23:03:32.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e72b6777-9c48-47b9-adeb-85d029b45db0 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37382024-09-03T23:03:32.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = e72b6777-9c48-47b9-adeb-85d029b45db0 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37392024-09-03T23:03:33.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b39671e2-cb00-4fcf-8b40-1c7e09cadb40 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37402024-09-03T23:03:33.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b39671e2-cb00-4fcf-8b40-1c7e09cadb40 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37412024-09-03T23:03:33.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b39671e2-cb00-4fcf-8b40-1c7e09cadb40 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37422024-09-03T23:03:34.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
37432024-09-03T23:03:34.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37442024-09-03T23:03:34.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
37452024-09-03T23:03:34.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37462024-09-03T23:03:34.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37472024-09-03T23:03:34.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37482024-09-03T23:03:34.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37492024-09-03T23:03:34.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37502024-09-03T23:03:34.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37512024-09-03T23:03:34.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37522024-09-03T23:03:34.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37532024-09-03T23:03:34.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37542024-09-03T23:03:34.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37552024-09-03T23:03:34.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
37562024-09-03T23:03:34.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37572024-09-03T23:03:34.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37582024-09-03T23:03:34.087ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
37592024-09-03T23:03:34.087ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.789702ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
37602024-09-03T23:03:34.094ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37612024-09-03T23:03:34.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37622024-09-03T23:03:34.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.08731ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37632024-09-03T23:03:34.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0bb1d12d-1f14-486d-a61d-46feca6d29e7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37642024-09-03T23:03:34.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0bb1d12d-1f14-486d-a61d-46feca6d29e7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37652024-09-03T23:03:34.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0bb1d12d-1f14-486d-a61d-46feca6d29e7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37662024-09-03T23:03:35.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 50386e4f-8159-484f-a84e-3b10a4d8b581 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37672024-09-03T23:03:35.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 50386e4f-8159-484f-a84e-3b10a4d8b581 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37682024-09-03T23:03:35.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 50386e4f-8159-484f-a84e-3b10a4d8b581 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37692024-09-03T23:03:36.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 04f0621d-7073-4245-be89-7abdb64ecd6c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37702024-09-03T23:03:36.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 04f0621d-7073-4245-be89-7abdb64ecd6c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37712024-09-03T23:03:36.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 04f0621d-7073-4245-be89-7abdb64ecd6c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37722024-09-03T23:03:37.499ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 112393ba-3462-407e-9ed7-307288cef2a6 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
37732024-09-03T23:03:37.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bac9c077-cd4e-4bfa-93b0-5aa6c2aa103d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37742024-09-03T23:03:37.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bac9c077-cd4e-4bfa-93b0-5aa6c2aa103d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37752024-09-03T23:03:37.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = bac9c077-cd4e-4bfa-93b0-5aa6c2aa103d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37762024-09-03T23:03:38.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 84ce2b2f-85f1-4f2b-9b09-dae3f2c58765 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37772024-09-03T23:03:38.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 84ce2b2f-85f1-4f2b-9b09-dae3f2c58765 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37782024-09-03T23:03:38.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 84ce2b2f-85f1-4f2b-9b09-dae3f2c58765 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37792024-09-03T23:03:39.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3a6b54a3-270e-45e5-940c-293faca7b8e7 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37802024-09-03T23:03:39.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3a6b54a3-270e-45e5-940c-293faca7b8e7 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37812024-09-03T23:03:39.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 3a6b54a3-270e-45e5-940c-293faca7b8e7 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37822024-09-03T23:03:40.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 32fd2916-06bb-48e1-8e45-cefede7b7df1 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37832024-09-03T23:03:40.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 32fd2916-06bb-48e1-8e45-cefede7b7df1 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37842024-09-03T23:03:40.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 32fd2916-06bb-48e1-8e45-cefede7b7df1 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37852024-09-03T23:03:41.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c67af81a-9dcf-42ae-ae28-c1b2564b8d07 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37862024-09-03T23:03:41.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c67af81a-9dcf-42ae-ae28-c1b2564b8d07 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37872024-09-03T23:03:41.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = c67af81a-9dcf-42ae-ae28-c1b2564b8d07 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37882024-09-03T23:03:42.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f743f569-496a-4eb1-90fc-f70ff8b247b4 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37892024-09-03T23:03:42.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f743f569-496a-4eb1-90fc-f70ff8b247b4 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37902024-09-03T23:03:42.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f743f569-496a-4eb1-90fc-f70ff8b247b4 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37912024-09-03T23:03:43.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 655438b8-5e00-4304-b1e0-984c050ceec2 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37922024-09-03T23:03:43.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 655438b8-5e00-4304-b1e0-984c050ceec2 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37932024-09-03T23:03:43.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 655438b8-5e00-4304-b1e0-984c050ceec2 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
37942024-09-03T23:03:44.067ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
37952024-09-03T23:03:44.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37962024-09-03T23:03:44.067ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
37972024-09-03T23:03:44.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37982024-09-03T23:03:44.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37992024-09-03T23:03:44.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38002024-09-03T23:03:44.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38012024-09-03T23:03:44.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38022024-09-03T23:03:44.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38032024-09-03T23:03:44.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38042024-09-03T23:03:44.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38052024-09-03T23:03:44.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38062024-09-03T23:03:44.095ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38072024-09-03T23:03:44.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38082024-09-03T23:03:44.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.805624ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38092024-09-03T23:03:44.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38102024-09-03T23:03:44.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
38112024-09-03T23:03:44.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38122024-09-03T23:03:44.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38132024-09-03T23:03:44.111ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
38142024-09-03T23:03:44.111ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.436413ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
38152024-09-03T23:03:44.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a75a1d00-9a99-45e4-82d4-f6bd161dcc5c roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38162024-09-03T23:03:44.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a75a1d00-9a99-45e4-82d4-f6bd161dcc5c resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38172024-09-03T23:03:44.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = a75a1d00-9a99-45e4-82d4-f6bd161dcc5c response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38182024-09-03T23:03:45.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 3b71ad94-a3d2-49e1-9e63-6e645d5af1f2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
38192024-09-03T23:03:45.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 3b71ad94-a3d2-49e1-9e63-6e645d5af1f2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
38202024-09-03T23:03:45.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 3b71ad94-a3d2-49e1-9e63-6e645d5af1f2 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
38212024-09-03T23:03:45.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 252e2279-1d8e-4282-a347-082fcce93c94 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38222024-09-03T23:03:45.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 252e2279-1d8e-4282-a347-082fcce93c94 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38232024-09-03T23:03:45.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 252e2279-1d8e-4282-a347-082fcce93c94 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38242024-09-03T23:03:46.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 083e9521-8a90-46ac-bfdc-95924abf7808 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38252024-09-03T23:03:46.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 083e9521-8a90-46ac-bfdc-95924abf7808 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38262024-09-03T23:03:46.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 083e9521-8a90-46ac-bfdc-95924abf7808 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38272024-09-03T23:03:47.499ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1772 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 62c31a07-dea2-4aab-85f4-54344086346b response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
38282024-09-03T23:03:47.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0997b0d3-11a3-40e6-8c86-d5e09c357f28 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38292024-09-03T23:03:47.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0997b0d3-11a3-40e6-8c86-d5e09c357f28 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38302024-09-03T23:03:47.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0997b0d3-11a3-40e6-8c86-d5e09c357f28 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38312024-09-03T23:03:48.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6023d3e8-e9d7-4c24-bfc2-cc151db4a25a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38322024-09-03T23:03:48.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6023d3e8-e9d7-4c24-bfc2-cc151db4a25a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38332024-09-03T23:03:48.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 6023d3e8-e9d7-4c24-bfc2-cc151db4a25a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38342024-09-03T23:03:49.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b52f6680-d9c0-494b-b545-50007e7bda4d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38352024-09-03T23:03:49.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b52f6680-d9c0-494b-b545-50007e7bda4d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38362024-09-03T23:03:49.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b52f6680-d9c0-494b-b545-50007e7bda4d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38372024-09-03T23:03:50.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 79c1d98b-4ba1-43b2-b0b0-688b46225ed2 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38382024-09-03T23:03:50.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 79c1d98b-4ba1-43b2-b0b0-688b46225ed2 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38392024-09-03T23:03:50.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 79c1d98b-4ba1-43b2-b0b0-688b46225ed2 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38402024-09-03T23:03:51.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d63759bc-6244-4247-b760-897454a25af3 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38412024-09-03T23:03:51.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d63759bc-6244-4247-b760-897454a25af3 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38422024-09-03T23:03:51.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d63759bc-6244-4247-b760-897454a25af3 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38432024-09-03T23:03:52.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d81291eb-97d9-40da-8fd8-b821bc604afe roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38442024-09-03T23:03:52.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d81291eb-97d9-40da-8fd8-b821bc604afe resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38452024-09-03T23:03:52.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2752 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d81291eb-97d9-40da-8fd8-b821bc604afe response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38462024-09-03T23:03:53.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 29ad6bfa-aacc-43df-82ef-197f765fcc0d roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38472024-09-03T23:03:53.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 29ad6bfa-aacc-43df-82ef-197f765fcc0d resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38482024-09-03T23:03:53.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 29ad6bfa-aacc-43df-82ef-197f765fcc0d response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
38492024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
38502024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38512024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
38522024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38532024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
38542024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
38552024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
38562024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
38572024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38582024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
38592024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38602024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38612024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
38622024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38632024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38642024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
38652024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38662024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
38672024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38682024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
38692024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38702024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
38712024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38722024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38732024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
38742024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38752024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
38762024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38772024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
38782024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38792024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
38802024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38812024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
38822024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38832024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38842024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38852024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38862024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38872024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38882024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38892024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38902024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38912024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38922024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38932024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38942024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38952024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38962024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38972024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38982024-09-03T23:03:54.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38992024-09-03T23:03:54.070ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39002024-09-03T23:03:54.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39012024-09-03T23:03:54.071ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 315380593 } })
39022024-09-03T23:03:54.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39032024-09-03T23:03:54.072ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
39042024-09-03T23:03:54.072ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.271864ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39052024-09-03T23:03:54.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39062024-09-03T23:03:54.073ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 317132920 } })
39072024-09-03T23:03:54.073ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
39082024-09-03T23:03:54.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39092024-09-03T23:03:54.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39102024-09-03T23:03:54.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39112024-09-03T23:03:54.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39122024-09-03T23:03:54.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39132024-09-03T23:03:54.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39142024-09-03T23:03:54.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39152024-09-03T23:03:54.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39162024-09-03T23:03:54.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39172024-09-03T23:03:54.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39182024-09-03T23:03:54.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39192024-09-03T23:03:54.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39202024-09-03T23:03:54.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39212024-09-03T23:03:54.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39222024-09-03T23:03:54.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39232024-09-03T23:03:54.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39242024-09-03T23:03:54.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39252024-09-03T23:03:54.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39262024-09-03T23:03:54.102ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1215, tv_nsec: 346438979 } })
39272024-09-03T23:03:54.103ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
39282024-09-03T23:03:54.103ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39292024-09-03T23:03:54.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39302024-09-03T23:03:54.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39312024-09-03T23:03:54.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39322024-09-03T23:03:54.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39332024-09-03T23:03:54.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39342024-09-03T23:03:54.117ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
39352024-09-03T23:03:54.117ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39362024-09-03T23:03:54.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39372024-09-03T23:03:54.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39382024-09-03T23:03:54.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39392024-09-03T23:03:54.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.052881ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
39402024-09-03T23:03:54.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39412024-09-03T23:03:54.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39422024-09-03T23:03:54.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39432024-09-03T23:03:54.125ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39442024-09-03T23:03:54.127ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39452024-09-03T23:03:54.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39462024-09-03T23:03:54.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39472024-09-03T23:03:54.129ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39482024-09-03T23:03:54.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39492024-09-03T23:03:54.131ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39502024-09-03T23:03:54.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39512024-09-03T23:03:54.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.416106ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
39522024-09-03T23:03:54.134ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39532024-09-03T23:03:54.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39542024-09-03T23:03:54.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.202404ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39552024-09-03T23:03:54.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39562024-09-03T23:03:54.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
39572024-09-03T23:03:54.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39582024-09-03T23:03:54.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39592024-09-03T23:03:54.154ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39602024-09-03T23:03:54.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.339289ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
39612024-09-03T23:03:54.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39622024-09-03T23:03:54.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39632024-09-03T23:03:54.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
39642024-09-03T23:03:54.157ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39652024-09-03T23:03:54.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39662024-09-03T23:03:54.158ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bcfb11f2-a3cd-4359-b192-671bbceae972", "content-length": "26", "date": "Tue, 03 Sep 2024 23:03:54 GMT"} })
39672024-09-03T23:03:54.158ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39682024-09-03T23:03:54.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 90.100337ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39692024-09-03T23:03:54.159ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
39702024-09-03T23:03:54.159ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.085188ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
39712024-09-03T23:03:54.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39722024-09-03T23:03:54.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39732024-09-03T23:03:54.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39742024-09-03T23:03:54.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39752024-09-03T23:03:54.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39762024-09-03T23:03:54.171ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39772024-09-03T23:03:54.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39782024-09-03T23:03:54.172ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
39792024-09-03T23:03:54.172ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39802024-09-03T23:03:54.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39812024-09-03T23:03:54.172ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
39822024-09-03T23:03:54.172ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39832024-09-03T23:03:54.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39842024-09-03T23:03:54.173ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b9640c52-5671-4e9e-82a8-ce51367b172f", "content-length": "26", "date": "Tue, 03 Sep 2024 23:03:54 GMT"} })
39852024-09-03T23:03:54.173ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39862024-09-03T23:03:54.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 105.947279ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39872024-09-03T23:03:54.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39882024-09-03T23:03:54.179ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39892024-09-03T23:03:54.180ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.614756ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39902024-09-03T23:03:54.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39912024-09-03T23:03:54.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
39922024-09-03T23:03:54.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39932024-09-03T23:03:54.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39942024-09-03T23:03:54.209ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
39952024-09-03T23:03:54.209ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39962024-09-03T23:03:54.209ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.201088ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
39972024-09-03T23:03:54.211ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 142.839354ms iteration = 18 status = 0
39982024-09-03T23:03:54.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39992024-09-03T23:03:54.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40002024-09-03T23:03:54.218ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 149.812765ms iteration = 21 status = {"physical_disks_added":0}
40012024-09-03T23:03:54.234ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
40022024-09-03T23:03:54.234ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40032024-09-03T23:03:54.234ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "737df594-83c4-40b3-8ac0-bddecefc6381", "content-length": "26", "date": "Tue, 03 Sep 2024 23:03:54 GMT"} })
40042024-09-03T23:03:54.234ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40052024-09-03T23:03:54.236ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
40062024-09-03T23:03:54.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40072024-09-03T23:03:54.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40082024-09-03T23:03:54.266ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 197.867225ms iteration = 18 status = {}
40092024-09-03T23:03:54.274ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40102024-09-03T23:03:54.275ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a67b5204-c2b6-4be9-8c28-8f49faecdb81", "content-length": "2", "date": "Tue, 03 Sep 2024 23:03:53 GMT"} })
40112024-09-03T23:03:54.276ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40122024-09-03T23:03:54.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40132024-09-03T23:03:54.303ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40142024-09-03T23:03:54.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40152024-09-03T23:03:54.306ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 238.157305ms iteration = 18 status = null
40162024-09-03T23:03:54.307ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40172024-09-03T23:03:54.307ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40182024-09-03T23:03:54.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40192024-09-03T23:03:54.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202024-09-03T23:03:54.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40212024-09-03T23:03:54.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40222024-09-03T23:03:54.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40232024-09-03T23:03:54.334ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "46db7910-56ef-465c-957c-32afe620a103", "content-length": "372", "date": "Tue, 03 Sep 2024 23:03:54 GMT"} })
40242024-09-03T23:03:54.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40252024-09-03T23:03:54.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40262024-09-03T23:03:54.336ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40272024-09-03T23:03:54.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40282024-09-03T23:03:54.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40292024-09-03T23:03:54.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40302024-09-03T23:03:54.342ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40312024-09-03T23:03:54.343ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ed40a85d-32d0-42c1-8c73-8a55f9e69a7f", "date": "Tue, 03 Sep 2024 23:03:54 GMT"} })
40322024-09-03T23:03:54.344ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 276.526707ms iteration = 20 status = {}
40332024-09-03T23:03:54.373ZDEBGnexus (BackgroundTasks): client request SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40342024-09-03T23:03:54.373ZDEBGnexus (BackgroundTasks): client response SledAgent = 03fe690d-d383-493d-857f-957a03d9553b background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ffc816d0-96ac-4887-a53c-6608b55ac657", "content-length": "691", "date": "Tue, 03 Sep 2024 23:03:54 GMT"} })
40352024-09-03T23:03:54.373ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40362024-09-03T23:03:54.373ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40372024-09-03T23:03:54.373ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40382024-09-03T23:03:54.375ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 307.574402ms iteration = 19 status = {}
40392024-09-03T23:03:54.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40402024-09-03T23:03:54.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40412024-09-03T23:03:54.401ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 4a162852-b7fb-453d-8700-c28c90ceea1a, rack_id: 81c791ad-1b79-46a3-83b3-27074749f874, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cfbbc591-5a71-4824-b45b-c64ca1770cd0) } rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
40422024-09-03T23:03:54.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40432024-09-03T23:03:54.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40442024-09-03T23:03:54.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40452024-09-03T23:03:54.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "40605d5d-9d52-4186-bb9e-03b40c4c5f73", "content-length": "121", "date": "Tue, 03 Sep 2024 23:03:53 GMT"} })
40462024-09-03T23:03:54.409ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
40472024-09-03T23:03:54.409ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cfbbc591-5a71-4824-b45b-c64ca1770cd0
40482024-09-03T23:03:54.409ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40492024-09-03T23:03:54.409ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40502024-09-03T23:03:54.409ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
40512024-09-03T23:03:54.409ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 routes = {}
40522024-09-03T23:03:54.409ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
40532024-09-03T23:03:54.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40542024-09-03T23:03:54.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40552024-09-03T23:03:54.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40562024-09-03T23:03:54.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cacb92a5-739c-46db-b1f3-9ab4560bb2e1", "content-length": "2", "date": "Tue, 03 Sep 2024 23:03:53 GMT"} })
40572024-09-03T23:03:54.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40582024-09-03T23:03:54.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7643200-f680-4458-8d4c-43bfb7ea0220", "content-length": "52", "date": "Tue, 03 Sep 2024 23:03:53 GMT"} })
40592024-09-03T23:03:54.412ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch_location = Switch0
40602024-09-03T23:03:54.412ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40612024-09-03T23:03:54.524ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4d7c4751-e4dc-4cea-a2ca-970d1664e765", "date": "Tue, 03 Sep 2024 23:03:54 GMT"} })
40622024-09-03T23:03:54.524ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 switch = Switch0
40632024-09-03T23:03:54.524ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40642024-09-03T23:03:54.525ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5215ec53-8a2e-40fc-95d3-bd271232d357", "content-length": "667", "date": "Tue, 03 Sep 2024 23:03:54 GMT"} })
40652024-09-03T23:03:54.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40662024-09-03T23:03:54.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40672024-09-03T23:03:54.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40682024-09-03T23:03:54.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40692024-09-03T23:03:54.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40702024-09-03T23:03:54.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40712024-09-03T23:03:54.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40722024-09-03T23:03:54.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40732024-09-03T23:03:54.541ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 473.191449ms iteration = 18 status = {}
40742024-09-03T23:03:54.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0456ca7c-c694-4bfa-84c7-bf7a3a333d85 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40752024-09-03T23:03:54.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0456ca7c-c694-4bfa-84c7-bf7a3a333d85 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40762024-09-03T23:03:54.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0456ca7c-c694-4bfa-84c7-bf7a3a333d85 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40772024-09-03T23:03:56.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ea970bc1-e61b-4544-8265-ed5b6a9487ee roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40782024-09-03T23:03:56.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ea970bc1-e61b-4544-8265-ed5b6a9487ee resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40792024-09-03T23:03:56.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ea970bc1-e61b-4544-8265-ed5b6a9487ee response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40802024-09-03T23:03:57.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1a6c205d-2873-44a3-8075-a758e7189d21 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40812024-09-03T23:03:57.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1a6c205d-2873-44a3-8075-a758e7189d21 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40822024-09-03T23:03:57.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1a6c205d-2873-44a3-8075-a758e7189d21 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40832024-09-03T23:03:57.499ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1511 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 19c106e4-a3e2-46d0-a2c3-e40393747ac6 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
40842024-09-03T23:03:58.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 07117003-4b7d-4451-8ed2-94e09f94f5d1 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40852024-09-03T23:03:58.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 07117003-4b7d-4451-8ed2-94e09f94f5d1 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40862024-09-03T23:03:58.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 07117003-4b7d-4451-8ed2-94e09f94f5d1 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40872024-09-03T23:03:59.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8eeb1500-35a2-42f1-bb64-eebb6234e257 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40882024-09-03T23:03:59.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8eeb1500-35a2-42f1-bb64-eebb6234e257 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40892024-09-03T23:03:59.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8eeb1500-35a2-42f1-bb64-eebb6234e257 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40902024-09-03T23:04:00.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5ff29b08-a218-44d4-8ef1-edd709ce8450 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40912024-09-03T23:04:00.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5ff29b08-a218-44d4-8ef1-edd709ce8450 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40922024-09-03T23:04:00.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 5ff29b08-a218-44d4-8ef1-edd709ce8450 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40932024-09-03T23:04:01.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2f56909c-2520-4614-b3b6-ed0f2635b4c9 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40942024-09-03T23:04:01.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2f56909c-2520-4614-b3b6-ed0f2635b4c9 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40952024-09-03T23:04:01.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2f56909c-2520-4614-b3b6-ed0f2635b4c9 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40962024-09-03T23:04:02.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbf482a9-23b4-4988-898e-19db77d04599 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40972024-09-03T23:04:02.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbf482a9-23b4-4988-898e-19db77d04599 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40982024-09-03T23:04:02.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = cbf482a9-23b4-4988-898e-19db77d04599 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
40992024-09-03T23:04:03.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7ddec7cd-8d43-45ec-b13b-292538c05dd1 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41002024-09-03T23:04:03.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7ddec7cd-8d43-45ec-b13b-292538c05dd1 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41012024-09-03T23:04:03.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7ddec7cd-8d43-45ec-b13b-292538c05dd1 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41022024-09-03T23:04:04.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
41032024-09-03T23:04:04.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41042024-09-03T23:04:04.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
41052024-09-03T23:04:04.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41062024-09-03T23:04:04.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41072024-09-03T23:04:04.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41082024-09-03T23:04:04.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41092024-09-03T23:04:04.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41102024-09-03T23:04:04.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41112024-09-03T23:04:04.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41122024-09-03T23:04:04.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41132024-09-03T23:04:04.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41142024-09-03T23:04:04.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41152024-09-03T23:04:04.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
41162024-09-03T23:04:04.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41172024-09-03T23:04:04.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41182024-09-03T23:04:04.089ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
41192024-09-03T23:04:04.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.849173ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
41202024-09-03T23:04:04.099ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41212024-09-03T23:04:04.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41222024-09-03T23:04:04.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.266493ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41232024-09-03T23:04:04.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 83450164-83bb-4f6e-b2e5-56a32dee4dd0 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41242024-09-03T23:04:04.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 83450164-83bb-4f6e-b2e5-56a32dee4dd0 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41252024-09-03T23:04:04.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 83450164-83bb-4f6e-b2e5-56a32dee4dd0 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41262024-09-03T23:04:05.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 62952208-c8c2-4cbc-a2d2-e231924ad5ec roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41272024-09-03T23:04:05.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 62952208-c8c2-4cbc-a2d2-e231924ad5ec resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41282024-09-03T23:04:05.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 62952208-c8c2-4cbc-a2d2-e231924ad5ec response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41292024-09-03T23:04:06.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1d625b62-9046-4a79-8896-528781cb7fc4 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41302024-09-03T23:04:06.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1d625b62-9046-4a79-8896-528781cb7fc4 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41312024-09-03T23:04:06.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 1d625b62-9046-4a79-8896-528781cb7fc4 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41322024-09-03T23:04:07.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f7421b20-52f8-4abd-bbb8-e5890e1fd16b roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41332024-09-03T23:04:07.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f7421b20-52f8-4abd-bbb8-e5890e1fd16b resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41342024-09-03T23:04:07.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f7421b20-52f8-4abd-bbb8-e5890e1fd16b response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41352024-09-03T23:04:07.499ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1593 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = 65f04807-d724-430d-b2ff-8870ce402876 response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
41362024-09-03T23:04:08.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ef421836-73e7-4158-b9da-78cb698db8c9 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41372024-09-03T23:04:08.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ef421836-73e7-4158-b9da-78cb698db8c9 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41382024-09-03T23:04:08.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = ef421836-73e7-4158-b9da-78cb698db8c9 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41392024-09-03T23:04:09.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc17b66e-0c8b-45e3-9d11-7ada7f930eb9 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41402024-09-03T23:04:09.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc17b66e-0c8b-45e3-9d11-7ada7f930eb9 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41412024-09-03T23:04:09.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = dc17b66e-0c8b-45e3-9d11-7ada7f930eb9 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41422024-09-03T23:04:10.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d01bd419-5bdb-4b15-b230-5fb6491eac72 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41432024-09-03T23:04:10.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d01bd419-5bdb-4b15-b230-5fb6491eac72 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41442024-09-03T23:04:10.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = d01bd419-5bdb-4b15-b230-5fb6491eac72 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41452024-09-03T23:04:11.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 81720bf7-1953-4c90-94a4-70518a226a3e roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41462024-09-03T23:04:11.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 81720bf7-1953-4c90-94a4-70518a226a3e resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41472024-09-03T23:04:11.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 81720bf7-1953-4c90-94a4-70518a226a3e response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41482024-09-03T23:04:12.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7eda358b-4dbe-411d-a2de-14d4469a50b8 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41492024-09-03T23:04:12.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7eda358b-4dbe-411d-a2de-14d4469a50b8 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41502024-09-03T23:04:12.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 7eda358b-4dbe-411d-a2de-14d4469a50b8 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41512024-09-03T23:04:13.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = feb14f1e-79f5-4935-ab1f-e18f1a32b983 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41522024-09-03T23:04:13.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = feb14f1e-79f5-4935-ab1f-e18f1a32b983 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41532024-09-03T23:04:13.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = feb14f1e-79f5-4935-ab1f-e18f1a32b983 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41542024-09-03T23:04:14.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
41552024-09-03T23:04:14.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
41562024-09-03T23:04:14.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41572024-09-03T23:04:14.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41582024-09-03T23:04:14.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41592024-09-03T23:04:14.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41602024-09-03T23:04:14.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41612024-09-03T23:04:14.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41622024-09-03T23:04:14.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41632024-09-03T23:04:14.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41642024-09-03T23:04:14.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41652024-09-03T23:04:14.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41662024-09-03T23:04:14.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41672024-09-03T23:04:14.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
41682024-09-03T23:04:14.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41692024-09-03T23:04:14.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41702024-09-03T23:04:14.089ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
41712024-09-03T23:04:14.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.140245ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
41722024-09-03T23:04:14.095ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41732024-09-03T23:04:14.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41742024-09-03T23:04:14.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.277353ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41752024-09-03T23:04:14.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2e33d96a-c418-4494-bf4c-bad7b010f6da roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41762024-09-03T23:04:14.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2e33d96a-c418-4494-bf4c-bad7b010f6da resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41772024-09-03T23:04:14.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 2e33d96a-c418-4494-bf4c-bad7b010f6da response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41782024-09-03T23:04:15.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 837f9d50-d181-4e64-965d-f12d402d9969 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
41792024-09-03T23:04:15.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 837f9d50-d181-4e64-965d-f12d402d9969 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
41802024-09-03T23:04:15.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 3764 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:44820 req_id = 837f9d50-d181-4e64-965d-f12d402d9969 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
41812024-09-03T23:04:15.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8d8bc26a-fa3a-4bb7-bf9a-efdd3ece6d1a roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41822024-09-03T23:04:15.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8d8bc26a-fa3a-4bb7-bf9a-efdd3ece6d1a resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41832024-09-03T23:04:15.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 8d8bc26a-fa3a-4bb7-bf9a-efdd3ece6d1a response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41842024-09-03T23:04:16.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0f5ae947-2142-47ce-8cc7-34b455a09cab roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41852024-09-03T23:04:16.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0f5ae947-2142-47ce-8cc7-34b455a09cab resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41862024-09-03T23:04:16.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 0f5ae947-2142-47ce-8cc7-34b455a09cab response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41872024-09-03T23:04:17.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b089c8ac-f323-4460-9dd5-fc5c0cb4db73 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41882024-09-03T23:04:17.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b089c8ac-f323-4460-9dd5-fc5c0cb4db73 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41892024-09-03T23:04:17.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b089c8ac-f323-4460-9dd5-fc5c0cb4db73 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41902024-09-03T23:04:17.498ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1311 local_addr = [fd00:1122:3344:101::b]:50440 method = GET remote_addr = [fd00:1122:3344:101::d]:42270 req_id = d2381b4f-09db-40d5-93f5-02f661312cbe response_code = 200 uri = /233bc5db-e41f-4898-a8d6-3cba2818c0c4
41912024-09-03T23:04:18.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 94233320-4f3b-458a-99da-b185db36bf18 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41922024-09-03T23:04:18.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 94233320-4f3b-458a-99da-b185db36bf18 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41932024-09-03T23:04:18.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 94233320-4f3b-458a-99da-b185db36bf18 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41942024-09-03T23:04:19.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f5162026-d263-4522-bbfa-163b3484ad47 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41952024-09-03T23:04:19.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f5162026-d263-4522-bbfa-163b3484ad47 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41962024-09-03T23:04:19.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2501 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = f5162026-d263-4522-bbfa-163b3484ad47 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41972024-09-03T23:04:20.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 64af5a0b-c1f5-4924-a656-6a031e99de28 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41982024-09-03T23:04:20.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 64af5a0b-c1f5-4924-a656-6a031e99de28 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
41992024-09-03T23:04:20.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 64af5a0b-c1f5-4924-a656-6a031e99de28 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42002024-09-03T23:04:21.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b21c78e9-7ba4-40a0-b92d-b276902ff7da roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42012024-09-03T23:04:21.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b21c78e9-7ba4-40a0-b92d-b276902ff7da resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42022024-09-03T23:04:21.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = b21c78e9-7ba4-40a0-b92d-b276902ff7da response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42032024-09-03T23:04:22.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 06a59a12-72b1-4d4c-b72b-11bb25c8e662 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42042024-09-03T23:04:22.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 06a59a12-72b1-4d4c-b72b-11bb25c8e662 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42052024-09-03T23:04:22.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 06a59a12-72b1-4d4c-b72b-11bb25c8e662 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42062024-09-03T23:04:23.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 805c5bf5-dc6e-4ec8-bfad-5b09bf1c2e83 roles = RoleSet { roles: {} } uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42072024-09-03T23:04:23.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 805c5bf5-dc6e-4ec8-bfad-5b09bf1c2e83 resource = Database result = Ok(()) uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42082024-09-03T23:04:23.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/31c0b74/dropshot/src/server.rs:914 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41426 req_id = 805c5bf5-dc6e-4ec8-bfad-5b09bf1c2e83 response_code = 200 uri = /probes/03fe690d-d383-493d-857f-957a03d9553b
42092024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
42102024-09-03T23:04:24.068ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc
42112024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 28.66\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc"}
42122024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
42132024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
42142024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42152024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42162024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42172024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
42182024-09-03T23:04:24.068ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
42192024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42202024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
42212024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
42222024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42232024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42242024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
42252024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42262024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
42272024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
42282024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
42292024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
42302024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42312024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42322024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
42332024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
42342024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42352024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
42362024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42372024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
42382024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
42392024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42402024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42412024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
42422024-09-03T23:04:24.068ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-03 22:54:24.068499001 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42432024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42442024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
42452024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42462024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
42472024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42482024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
42492024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
42502024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
42512024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42522024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
42532024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42542024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
42552024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42562024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
42572024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42582024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42592024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
42602024-09-03T23:04:24.068ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42612024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42622024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
42632024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42642024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
42652024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42662024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
42672024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42682024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
42692024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42702024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42712024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42722024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42732024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42742024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42752024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42762024-09-03T23:04:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42772024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42782024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42792024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42802024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42812024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42822024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42832024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42842024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42852024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42862024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42872024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42882024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42892024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42902024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42912024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42922024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42932024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42942024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42952024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42962024-09-03T23:04:24.069ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5278d774-fcf6-40b9-b896-4e3af31c54b8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a18455-e4a4-4775-b583-fa895e235cf8.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 312638221 } })
42972024-09-03T23:04:24.069ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7d574b3d-97ce-4fc4-8255-27d61ab35e88.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9e590c60-1cc5-4f4c-8ae9-48abc39cb394.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c2b4bad9-4d0b-4e92-9e46-69ede3f83bc5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 312662061 } })
42982024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42992024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43002024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43012024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43022024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43032024-09-03T23:04:24.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43042024-09-03T23:04:24.070ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
43052024-09-03T23:04:24.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.678697ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
43062024-09-03T23:04:24.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43072024-09-03T23:04:24.070ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
43082024-09-03T23:04:24.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.507995ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
43092024-09-03T23:04:24.071ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43102024-09-03T23:04:24.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43112024-09-03T23:04:24.075ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43122024-09-03T23:04:24.075ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43132024-09-03T23:04:24.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43142024-09-03T23:04:24.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.139963ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
43152024-09-03T23:04:24.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43162024-09-03T23:04:24.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43172024-09-03T23:04:24.078ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.634888ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43182024-09-03T23:04:24.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43192024-09-03T23:04:24.081ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43202024-09-03T23:04:24.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43212024-09-03T23:04:24.082ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 326141288 } })
43222024-09-03T23:04:24.083ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
43232024-09-03T23:04:24.084ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 327547643 } })
43242024-09-03T23:04:24.084ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
43252024-09-03T23:04:24.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43262024-09-03T23:04:24.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43272024-09-03T23:04:24.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43282024-09-03T23:04:24.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43292024-09-03T23:04:24.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43302024-09-03T23:04:24.085ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.266706ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
43312024-09-03T23:04:24.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43322024-09-03T23:04:24.094ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-03 22:54:24.068499001 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43332024-09-03T23:04:24.094ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 26.021165ms iteration = 10 status = {"expiration":"2024-09-03T22:54:24.068499001Z","pruned":[]}
43342024-09-03T23:04:24.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43352024-09-03T23:04:24.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43362024-09-03T23:04:24.098ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43372024-09-03T23:04:24.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43382024-09-03T23:04:24.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43392024-09-03T23:04:24.101ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43402024-09-03T23:04:24.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43412024-09-03T23:04:24.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43422024-09-03T23:04:24.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43432024-09-03T23:04:24.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43442024-09-03T23:04:24.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43452024-09-03T23:04:24.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43462024-09-03T23:04:24.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43472024-09-03T23:04:24.125ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
43482024-09-03T23:04:24.125ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
43492024-09-03T23:04:24.125ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.074281ms iteration = 10 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
43502024-09-03T23:04:24.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43512024-09-03T23:04:24.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43522024-09-03T23:04:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43532024-09-03T23:04:24.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43542024-09-03T23:04:24.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43552024-09-03T23:04:24.130ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43562024-09-03T23:04:24.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43572024-09-03T23:04:24.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43582024-09-03T23:04:24.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43592024-09-03T23:04:24.149ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43602024-09-03T23:04:24.149ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43612024-09-03T23:04:24.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43622024-09-03T23:04:24.152ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43632024-09-03T23:04:24.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43642024-09-03T23:04:24.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43652024-09-03T23:04:24.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43662024-09-03T23:04:24.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43672024-09-03T23:04:24.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43682024-09-03T23:04:24.159ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43692024-09-03T23:04:24.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43702024-09-03T23:04:24.159ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43712024-09-03T23:04:24.160ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43722024-09-03T23:04:24.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43732024-09-03T23:04:24.161ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
43742024-09-03T23:04:24.161ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43752024-09-03T23:04:24.161ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43762024-09-03T23:04:24.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43772024-09-03T23:04:24.162ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43782024-09-03T23:04:24.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43792024-09-03T23:04:24.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43802024-09-03T23:04:24.163ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43812024-09-03T23:04:24.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43822024-09-03T23:04:24.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43832024-09-03T23:04:24.163ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43842024-09-03T23:04:24.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43852024-09-03T23:04:24.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43862024-09-03T23:04:24.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43872024-09-03T23:04:24.165ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43882024-09-03T23:04:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43892024-09-03T23:04:24.166ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43902024-09-03T23:04:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43912024-09-03T23:04:24.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43922024-09-03T23:04:24.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43932024-09-03T23:04:24.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43942024-09-03T23:04:24.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43952024-09-03T23:04:24.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43962024-09-03T23:04:24.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43972024-09-03T23:04:24.168ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43982024-09-03T23:04:24.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43992024-09-03T23:04:24.168ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44002024-09-03T23:04:24.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 101.836177ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44012024-09-03T23:04:24.170ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44022024-09-03T23:04:24.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44032024-09-03T23:04:24.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.16093ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
44042024-09-03T23:04:24.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44052024-09-03T23:04:24.171ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44062024-09-03T23:04:24.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44072024-09-03T23:04:24.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44082024-09-03T23:04:24.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44092024-09-03T23:04:24.179ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-03fe690d-d383-493d-857f-957a03d9553b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1245, tv_nsec: 423013565 } })
44102024-09-03T23:04:24.180ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874
44112024-09-03T23:04:24.186ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44122024-09-03T23:04:24.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44132024-09-03T23:04:24.189ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44142024-09-03T23:04:24.189ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44152024-09-03T23:04:24.189ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44162024-09-03T23:04:24.189ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44172024-09-03T23:04:24.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44182024-09-03T23:04:24.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44192024-09-03T23:04:24.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44202024-09-03T23:04:24.190ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44212024-09-03T23:04:24.191ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 122.77583ms iteration = 5 status = {"nsuccess":5}
44222024-09-03T23:04:24.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44232024-09-03T23:04:24.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44242024-09-03T23:04:24.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44252024-09-03T23:04:24.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44262024-09-03T23:04:24.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44272024-09-03T23:04:24.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44282024-09-03T23:04:24.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44292024-09-03T23:04:24.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44302024-09-03T23:04:24.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44312024-09-03T23:04:24.199ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44322024-09-03T23:04:24.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44332024-09-03T23:04:24.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44342024-09-03T23:04:24.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44352024-09-03T23:04:24.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 03fe690d-d383-493d-857f-957a03d9553b, lookup_type: ById(03fe690d-d383-493d-857f-957a03d9553b) } result = Ok(())
44362024-09-03T23:04:24.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44372024-09-03T23:04:24.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44382024-09-03T23:04:24.206ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 138.627211ms iteration = 19 status = 0
44392024-09-03T23:04:24.208ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 140.427789ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44402024-09-03T23:04:24.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44412024-09-03T23:04:24.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44422024-09-03T23:04:24.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44432024-09-03T23:04:24.213ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 145.454102ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
44442024-09-03T23:04:24.214ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44452024-09-03T23:04:24.214ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44462024-09-03T23:04:24.214ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44472024-09-03T23:04:24.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44482024-09-03T23:04:24.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44492024-09-03T23:04:24.216ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44502024-09-03T23:04:24.216ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44512024-09-03T23:04:24.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44522024-09-03T23:04:24.218ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44532024-09-03T23:04:24.218ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44542024-09-03T23:04:24.218ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 148.574113ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44552024-09-03T23:04:24.219ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
44562024-09-03T23:04:24.219ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44572024-09-03T23:04:24.219ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44582024-09-03T23:04:24.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44592024-09-03T23:04:24.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44602024-09-03T23:04:24.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44612024-09-03T23:04:24.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44622024-09-03T23:04:24.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44632024-09-03T23:04:24.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44642024-09-03T23:04:24.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 53dea4da-30ea-4a8d-b1ba-1caec76e81bc, lookup_type: ById(53dea4da-30ea-4a8d-b1ba-1caec76e81bc) } result = Ok(())
44652024-09-03T23:04:24.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44662024-09-03T23:04:24.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44672024-09-03T23:04:24.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44682024-09-03T23:04:24.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44692024-09-03T23:04:24.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44702024-09-03T23:04:24.232ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc original_time_created = 2024-09-03 22:55:04.431451 UTC target_id = 53dea4da-30ea-4a8d-b1ba-1caec76e81bc time_created = 2024-09-03 22:55:04.431451 UTC
44712024-09-03T23:04:24.232ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 163.817048ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"53dea4da-30ea-4a8d-b1ba-1caec76e81bc","time_created":"2024-09-03T22:55:04.431451Z"}
44722024-09-03T23:04:24.242ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
44732024-09-03T23:04:24.242ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44742024-09-03T23:04:24.243ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4b2764e1-69b6-4a90-8ba1-ad9700e87e64", "content-length": "26", "date": "Tue, 03 Sep 2024 23:04:24 GMT"} })
44752024-09-03T23:04:24.243ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44762024-09-03T23:04:24.245ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44772024-09-03T23:04:24.248ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
44782024-09-03T23:04:24.248ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
44792024-09-03T23:04:24.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44802024-09-03T23:04:24.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44812024-09-03T23:04:24.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822024-09-03T23:04:24.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44832024-09-03T23:04:24.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44842024-09-03T23:04:24.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44852024-09-03T23:04:24.256ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 956a1b13-148d-49f2-839b-b380659b6c69 dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
44862024-09-03T23:04:24.256ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
44872024-09-03T23:04:24.256ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-03 22:55:54.269593 UTC dns_group = internal generation = 1
44882024-09-03T23:04:24.256ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 188.107836ms iteration = 11 status = {"generation":1}
44892024-09-03T23:04:24.260ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
44902024-09-03T23:04:24.260ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44912024-09-03T23:04:24.260ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dedd801f-93ba-42b5-a3f9-9e1dff3f04ec", "content-length": "26", "date": "Tue, 03 Sep 2024 23:04:24 GMT"} })
44922024-09-03T23:04:24.260ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44932024-09-03T23:04:24.262ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44942024-09-03T23:04:24.265ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 196.500681ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44952024-09-03T23:04:24.266ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:480 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44962024-09-03T23:04:24.266ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 198.259379ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44972024-09-03T23:04:24.268ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:56
44982024-09-03T23:04:24.268ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:241 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44992024-09-03T23:04:24.268ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 199.446801ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"failed_active_vmms":0,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
45002024-09-03T23:04:24.268ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45012024-09-03T23:04:24.268ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
45022024-09-03T23:04:24.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45032024-09-03T23:04:24.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45042024-09-03T23:04:24.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45052024-09-03T23:04:24.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45062024-09-03T23:04:24.273ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45072024-09-03T23:04:24.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45082024-09-03T23:04:24.275ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 23b7b0a9-843a-4a95-b940-0b90decf8d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
45092024-09-03T23:04:24.275ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45102024-09-03T23:04:24.275ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-03 22:55:55.157084 UTC dns_group = external generation = 2
45112024-09-03T23:04:24.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 207.390722ms iteration = 11 status = {"generation":2}
45122024-09-03T23:04:24.282ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-03T22:55:21.166044Z, time_modified: 2024-09-03T22:55:21.166044Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2111640e-ec0f-4296-81a6-157dccba7ad6, db_silo: Silo { identity: SiloIdentity { id: 2111640e-ec0f-4296-81a6-157dccba7ad6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-03T22:55:55.097076Z, time_modified: 2024-09-03T22:55:55.097076Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971" }] }) }
45132024-09-03T23:04:24.282ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 213.809247ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]}},"default_endpoint":{"silo_id":"2111640e-ec0f-4296-81a6-157dccba7ad6","tls_certs":["d4719814df38c5e09fffb3a1b5bbcb891adccab72e3bd9462d96b365a7cec971"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45142024-09-03T23:04:24.295ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.605838ms iteration = 22 status = {"physical_disks_added":0}
45152024-09-03T23:04:24.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45162024-09-03T23:04:24.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45172024-09-03T23:04:24.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45182024-09-03T23:04:24.310ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45192024-09-03T23:04:24.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45202024-09-03T23:04:24.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45212024-09-03T23:04:24.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45222024-09-03T23:04:24.313ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45232024-09-03T23:04:24.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45242024-09-03T23:04:24.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45252024-09-03T23:04:24.346ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45262024-09-03T23:04:24.347ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ed52e39d-964b-446c-9650-34eca7f8d095", "date": "Tue, 03 Sep 2024 23:04:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45272024-09-03T23:04:24.347ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45282024-09-03T23:04:24.349ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "77baf81a-39f2-41e4-a1fa-8da66e049c2d", "date": "Tue, 03 Sep 2024 23:04:24 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45292024-09-03T23:04:24.349ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45302024-09-03T23:04:24.350ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45312024-09-03T23:04:24.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 282.321986ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45322024-09-03T23:04:24.351ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 zone_address = fd00:1122:3344:101::2
45332024-09-03T23:04:24.351ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45342024-09-03T23:04:24.351ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5d8c644b-d809-4d2d-9438-b44105f80dd7", "content-length": "26", "date": "Tue, 03 Sep 2024 23:04:24 GMT"} })
45352024-09-03T23:04:24.351ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = 81c791ad-1b79-46a3-83b3-27074749f874 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45362024-09-03T23:04:24.353ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 81c791ad-1b79-46a3-83b3-27074749f874