Max level shown:
12024-10-30T14:15:00.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ab2d358a-aa3e-4369-b9d7-156e043b88e8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22024-10-30T14:15:00.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ab2d358a-aa3e-4369-b9d7-156e043b88e8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32024-10-30T14:15:00.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ab2d358a-aa3e-4369-b9d7-156e043b88e8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
42024-10-30T14:15:00.898ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59547
52024-10-30T14:15:00.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59547 req_id = 54879912-2534-4372-86a8-57fbf8a37444 roles = RoleSet { roles: {} } uri = /metrics/producers
62024-10-30T14:15:00.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59547 req_id = 54879912-2534-4372-86a8-57fbf8a37444 resource = Database result = Ok(()) uri = /metrics/producers
72024-10-30T14:15:00.913ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = a2da6817-ca4e-49a7-97c4-d0e11c495db8
82024-10-30T14:15:00.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 14555 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59547 req_id = 54879912-2534-4372-86a8-57fbf8a37444 response_code = 201 uri = /metrics/producers
92024-10-30T14:15:01.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0577528d-c2a9-4bb4-991a-e0d6e54e63f2 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
102024-10-30T14:15:01.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0577528d-c2a9-4bb4-991a-e0d6e54e63f2 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
112024-10-30T14:15:01.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0577528d-c2a9-4bb4-991a-e0d6e54e63f2 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
122024-10-30T14:15:02.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 94f3a964-f612-4c54-a355-09a01c7a293e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
132024-10-30T14:15:02.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 94f3a964-f612-4c54-a355-09a01c7a293e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
142024-10-30T14:15:02.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 94f3a964-f612-4c54-a355-09a01c7a293e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
152024-10-30T14:15:03.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7f9afb12-bdc5-404b-8f2a-cbe3cada9831 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
162024-10-30T14:15:03.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7f9afb12-bdc5-404b-8f2a-cbe3cada9831 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
172024-10-30T14:15:03.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7f9afb12-bdc5-404b-8f2a-cbe3cada9831 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
182024-10-30T14:15:04.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 46110743-d3e5-4d3e-a5f9-7e40b47f6c60 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
192024-10-30T14:15:04.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 46110743-d3e5-4d3e-a5f9-7e40b47f6c60 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
202024-10-30T14:15:04.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 46110743-d3e5-4d3e-a5f9-7e40b47f6c60 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
212024-10-30T14:15:05.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 53946b51-9940-445a-8bd9-d30d070c6d42 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
222024-10-30T14:15:05.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 53946b51-9940-445a-8bd9-d30d070c6d42 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
232024-10-30T14:15:05.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 53946b51-9940-445a-8bd9-d30d070c6d42 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
242024-10-30T14:15:06.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e221b433-cedd-45da-bd4f-e934d062f7f9 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
252024-10-30T14:15:06.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e221b433-cedd-45da-bd4f-e934d062f7f9 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
262024-10-30T14:15:06.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e221b433-cedd-45da-bd4f-e934d062f7f9 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
272024-10-30T14:15:07.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 78f43928-6a15-4ad4-a201-6361236c19c4 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
282024-10-30T14:15:07.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 78f43928-6a15-4ad4-a201-6361236c19c4 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
292024-10-30T14:15:07.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 78f43928-6a15-4ad4-a201-6361236c19c4 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
302024-10-30T14:15:08.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1279 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 36c5ea3d-b1ae-4fc8-b997-65a35180fc87 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
312024-10-30T14:15:08.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1d5d4ad-4e39-4412-b6a8-08cc17225d8c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
322024-10-30T14:15:08.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1d5d4ad-4e39-4412-b6a8-08cc17225d8c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
332024-10-30T14:15:08.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1d5d4ad-4e39-4412-b6a8-08cc17225d8c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
342024-10-30T14:15:09.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
352024-10-30T14:15:09.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362024-10-30T14:15:09.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
372024-10-30T14:15:09.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
382024-10-30T14:15:09.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
392024-10-30T14:15:09.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
402024-10-30T14:15:09.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
412024-10-30T14:15:09.431ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
422024-10-30T14:15:09.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
432024-10-30T14:15:09.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
442024-10-30T14:15:09.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
452024-10-30T14:15:09.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
462024-10-30T14:15:09.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.240553ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
472024-10-30T14:15:09.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
482024-10-30T14:15:09.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
492024-10-30T14:15:09.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
502024-10-30T14:15:09.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
512024-10-30T14:15:09.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
522024-10-30T14:15:09.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
532024-10-30T14:15:09.446ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
542024-10-30T14:15:09.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.077899ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
552024-10-30T14:15:09.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0552160b-4deb-49a5-ab5b-7770a14c3fc7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
562024-10-30T14:15:09.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0552160b-4deb-49a5-ab5b-7770a14c3fc7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
572024-10-30T14:15:09.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0552160b-4deb-49a5-ab5b-7770a14c3fc7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
582024-10-30T14:15:10.781ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:63292
592024-10-30T14:15:10.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63292 req_id = f9a2cc2a-7a3f-47b3-8f5d-db47ba45b0ef roles = RoleSet { roles: {} } uri = /metrics/producers
602024-10-30T14:15:10.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63292 req_id = f9a2cc2a-7a3f-47b3-8f5d-db47ba45b0ef resource = Database result = Ok(()) uri = /metrics/producers
612024-10-30T14:15:10.819ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 8b1f385c-ab41-4fc7-98ed-4c3cf5f8458d
622024-10-30T14:15:10.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37677 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63292 req_id = f9a2cc2a-7a3f-47b3-8f5d-db47ba45b0ef response_code = 201 uri = /metrics/producers
632024-10-30T14:15:10.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4bef1d58-1af0-499a-964a-d20f0a9bf08e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
642024-10-30T14:15:10.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4bef1d58-1af0-499a-964a-d20f0a9bf08e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
652024-10-30T14:15:10.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4bef1d58-1af0-499a-964a-d20f0a9bf08e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
662024-10-30T14:15:11.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b09fc546-a46f-4b33-b098-619c87d2678f roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
672024-10-30T14:15:11.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b09fc546-a46f-4b33-b098-619c87d2678f resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
682024-10-30T14:15:11.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b09fc546-a46f-4b33-b098-619c87d2678f response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
692024-10-30T14:15:12.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1889a590-296e-4949-8994-e27e902e5560 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
702024-10-30T14:15:12.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1889a590-296e-4949-8994-e27e902e5560 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
712024-10-30T14:15:12.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1889a590-296e-4949-8994-e27e902e5560 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
722024-10-30T14:15:13.368ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:48451
732024-10-30T14:15:13.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48451 req_id = e5ad5777-8a4b-44ec-9a7e-2ecbcf18311c roles = RoleSet { roles: {} } uri = /metrics/producers
742024-10-30T14:15:13.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48451 req_id = e5ad5777-8a4b-44ec-9a7e-2ecbcf18311c resource = Database result = Ok(()) uri = /metrics/producers
752024-10-30T14:15:13.377ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = e1387952-eca6-4979-9c49-a3d6657c9659
762024-10-30T14:15:13.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8594 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48451 req_id = e5ad5777-8a4b-44ec-9a7e-2ecbcf18311c response_code = 201 uri = /metrics/producers
772024-10-30T14:15:13.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = be2b2cbc-8f8d-48bc-920f-c0875d95ca1a roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
782024-10-30T14:15:13.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = be2b2cbc-8f8d-48bc-920f-c0875d95ca1a resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
792024-10-30T14:15:13.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = be2b2cbc-8f8d-48bc-920f-c0875d95ca1a response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
802024-10-30T14:15:13.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 375d0865-f35d-4787-8d40-872f968b6b01 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
812024-10-30T14:15:13.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 375d0865-f35d-4787-8d40-872f968b6b01 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
822024-10-30T14:15:13.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 375d0865-f35d-4787-8d40-872f968b6b01 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
832024-10-30T14:15:13.660ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:44620
842024-10-30T14:15:13.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44620 req_id = d78233f3-9b74-41ec-9b5f-d66284964a05 roles = RoleSet { roles: {} } uri = /metrics/producers
852024-10-30T14:15:13.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44620 req_id = d78233f3-9b74-41ec-9b5f-d66284964a05 resource = Database result = Ok(()) uri = /metrics/producers
862024-10-30T14:15:13.697ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 25ed936f-01bc-4d77-82c8-0c6af0320a9a
872024-10-30T14:15:13.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37122 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44620 req_id = d78233f3-9b74-41ec-9b5f-d66284964a05 response_code = 201 uri = /metrics/producers
882024-10-30T14:15:13.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c7e4210e-19c3-4d8c-8c42-f1c89453cb9a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
892024-10-30T14:15:13.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c7e4210e-19c3-4d8c-8c42-f1c89453cb9a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
902024-10-30T14:15:13.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c7e4210e-19c3-4d8c-8c42-f1c89453cb9a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
912024-10-30T14:15:14.307ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59643
922024-10-30T14:15:14.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59643 req_id = 6320c247-f2fc-402d-b72a-92b4604ebd18 roles = RoleSet { roles: {} } uri = /metrics/producers
932024-10-30T14:15:14.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59643 req_id = 6320c247-f2fc-402d-b72a-92b4604ebd18 resource = Database result = Ok(()) uri = /metrics/producers
942024-10-30T14:15:14.316ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 8e3800e0-4cba-4ddc-97e5-4f101c72290f
952024-10-30T14:15:14.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8278 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59643 req_id = 6320c247-f2fc-402d-b72a-92b4604ebd18 response_code = 201 uri = /metrics/producers
962024-10-30T14:15:14.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5205126a-c323-4ce0-96d9-c685058db93d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
972024-10-30T14:15:14.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5205126a-c323-4ce0-96d9-c685058db93d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
982024-10-30T14:15:14.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5205126a-c323-4ce0-96d9-c685058db93d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
992024-10-30T14:15:15.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 48320679-36ef-4607-ade5-ab4d269f91b7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1002024-10-30T14:15:15.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 48320679-36ef-4607-ade5-ab4d269f91b7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1012024-10-30T14:15:15.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2012 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 48320679-36ef-4607-ade5-ab4d269f91b7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1022024-10-30T14:15:16.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4e438a67-28d9-4bf2-906b-0bae0673bde3 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1032024-10-30T14:15:16.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4e438a67-28d9-4bf2-906b-0bae0673bde3 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1042024-10-30T14:15:16.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4e438a67-28d9-4bf2-906b-0bae0673bde3 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1052024-10-30T14:15:18.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9fd53def-4170-4c63-9cd9-0cfe63a21c6b roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1062024-10-30T14:15:18.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9fd53def-4170-4c63-9cd9-0cfe63a21c6b resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1072024-10-30T14:15:18.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9fd53def-4170-4c63-9cd9-0cfe63a21c6b response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1082024-10-30T14:15:19.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 51477ea2-a0ea-4ea5-8b0f-18381a828606 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1092024-10-30T14:15:19.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 51477ea2-a0ea-4ea5-8b0f-18381a828606 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1102024-10-30T14:15:19.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 51477ea2-a0ea-4ea5-8b0f-18381a828606 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1112024-10-30T14:15:19.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
1122024-10-30T14:15:19.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1132024-10-30T14:15:19.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1142024-10-30T14:15:19.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
1152024-10-30T14:15:19.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1162024-10-30T14:15:19.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1172024-10-30T14:15:19.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1182024-10-30T14:15:19.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1192024-10-30T14:15:19.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1202024-10-30T14:15:19.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.541396ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1212024-10-30T14:15:19.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1222024-10-30T14:15:19.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1232024-10-30T14:15:19.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1242024-10-30T14:15:19.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1252024-10-30T14:15:19.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1262024-10-30T14:15:19.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1272024-10-30T14:15:19.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
1282024-10-30T14:15:19.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1292024-10-30T14:15:19.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1302024-10-30T14:15:19.556ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
1312024-10-30T14:15:19.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.076331ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
1322024-10-30T14:15:20.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 34d40e9a-bd56-4289-b7f3-a5926fb3b2e6 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1332024-10-30T14:15:20.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 34d40e9a-bd56-4289-b7f3-a5926fb3b2e6 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1342024-10-30T14:15:20.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 34d40e9a-bd56-4289-b7f3-a5926fb3b2e6 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1352024-10-30T14:15:21.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4e8a442c-268c-4bd6-b3e1-758cebb3e167 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1362024-10-30T14:15:21.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4e8a442c-268c-4bd6-b3e1-758cebb3e167 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1372024-10-30T14:15:21.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4e8a442c-268c-4bd6-b3e1-758cebb3e167 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1382024-10-30T14:15:22.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b9513c57-af77-4e06-ae0d-6e708f0fe07a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1392024-10-30T14:15:22.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b9513c57-af77-4e06-ae0d-6e708f0fe07a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1402024-10-30T14:15:22.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b9513c57-af77-4e06-ae0d-6e708f0fe07a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1412024-10-30T14:15:23.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 78ea13c4-931b-4352-a19a-77bc26c1808c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1422024-10-30T14:15:23.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 78ea13c4-931b-4352-a19a-77bc26c1808c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1432024-10-30T14:15:23.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 78ea13c4-931b-4352-a19a-77bc26c1808c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1442024-10-30T14:15:23.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1438 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 0e7feb27-ebe2-41dc-b9c9-cb6648a11017 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
1452024-10-30T14:15:24.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e331f58e-b6fb-4d76-9019-1d8f84d0a88a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1462024-10-30T14:15:24.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e331f58e-b6fb-4d76-9019-1d8f84d0a88a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1472024-10-30T14:15:24.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e331f58e-b6fb-4d76-9019-1d8f84d0a88a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1482024-10-30T14:15:25.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0706d631-7553-4c5a-b944-1940e1506636 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1492024-10-30T14:15:25.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0706d631-7553-4c5a-b944-1940e1506636 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1502024-10-30T14:15:25.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0706d631-7553-4c5a-b944-1940e1506636 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1512024-10-30T14:15:26.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 00087e60-4f68-4931-b0e6-81d4bf7239c5 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1522024-10-30T14:15:26.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 00087e60-4f68-4931-b0e6-81d4bf7239c5 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1532024-10-30T14:15:26.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 00087e60-4f68-4931-b0e6-81d4bf7239c5 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1542024-10-30T14:15:27.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2724b3f-b4f4-4658-bc8d-5c1113b1a714 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1552024-10-30T14:15:27.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2724b3f-b4f4-4658-bc8d-5c1113b1a714 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1562024-10-30T14:15:27.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2724b3f-b4f4-4658-bc8d-5c1113b1a714 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1572024-10-30T14:15:28.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5ecddfb5-9d87-4415-87bd-be0dce3c9103 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1582024-10-30T14:15:28.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5ecddfb5-9d87-4415-87bd-be0dce3c9103 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1592024-10-30T14:15:28.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5ecddfb5-9d87-4415-87bd-be0dce3c9103 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1602024-10-30T14:15:28.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 2a5fca57-908e-4cf2-a6f9-638fef18b8bb roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
1612024-10-30T14:15:28.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 2a5fca57-908e-4cf2-a6f9-638fef18b8bb resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
1622024-10-30T14:15:28.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2647 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 2a5fca57-908e-4cf2-a6f9-638fef18b8bb response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
1632024-10-30T14:15:28.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = b984c7c9-108c-48af-9106-04693abddedc roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
1642024-10-30T14:15:28.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = b984c7c9-108c-48af-9106-04693abddedc resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
1652024-10-30T14:15:28.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = b984c7c9-108c-48af-9106-04693abddedc response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
1662024-10-30T14:15:29.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 06155918-fed1-4a91-a06c-5d3e4f359f41 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1672024-10-30T14:15:29.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 06155918-fed1-4a91-a06c-5d3e4f359f41 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1682024-10-30T14:15:29.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 06155918-fed1-4a91-a06c-5d3e4f359f41 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
1692024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
1702024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
1712024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1722024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
1732024-10-30T14:15:29.427ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-30 14:05:29.427830095 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1742024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1752024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
1762024-10-30T14:15:29.427ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854
1772024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
1782024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.881\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854"}
1792024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
1802024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
1812024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
1822024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1832024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1842024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
1852024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
1862024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1872024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1882024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1892024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
1902024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
1912024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1922024-10-30T14:15:29.427ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
1932024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
1942024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1952024-10-30T14:15:29.428ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1962024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1972024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
1982024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1992024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
2002024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2012024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
2022024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
2032024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2042024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2052024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2062024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2072024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2082024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
2092024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2102024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2112024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2122024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
2132024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
2142024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2152024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2162024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2172024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2182024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
2192024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2202024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
2212024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2222024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2232024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2242024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2252024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2262024-10-30T14:15:29.428ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62825ae7-d0e8-4554-b47e-377bf9997852.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a5a8b395-0169-4688-a9f0-b29d7a7c4214.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a5a8b395-0169-4688-a9f0-b29d7a7c4214.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33290, tv_nsec: 608608098 } })
2272024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2282024-10-30T14:15:29.428ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d63b0d7-b7b2-4bc1-b329-13e53ae58f30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d00dc1a3-b063-4364-8a39-247d9fd1eb38.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40e7162-26ca-4c45-932d-9e6f8cedacab.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40e7162-26ca-4c45-932d-9e6f8cedacab.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 33290, tv_nsec: 608647129 } })
2292024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2302024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2312024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2322024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2332024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2342024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2352024-10-30T14:15:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2362024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2372024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2382024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2392024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
2402024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
2412024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
2422024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2432024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2442024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
2452024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2462024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.406959ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
2472024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.281975ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2482024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2492024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2502024-10-30T14:15:29.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2512024-10-30T14:15:29.430ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.394974ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2522024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
2532024-10-30T14:15:29.431ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
2542024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
2552024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
2562024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2572024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.69\u{b5}s iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2582024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.12\u{b5}s iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2592024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
2602024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
2612024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
2622024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
2632024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
2642024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
2652024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.22\u{b5}s iteration = 7 status = {"errors":[],"records_set_to_done":[]}
2662024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.1\u{b5}s iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
2672024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2682024-10-30T14:15:29.431ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33290, tv_nsec: 611551608 } })
2692024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2702024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2712024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2722024-10-30T14:15:29.431ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
2732024-10-30T14:15:29.431ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-30 14:05:29.427830095 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2742024-10-30T14:15:29.431ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.04707ms iteration = 4 status = {"expiration":"2024-10-30T14:05:29.427830095Z","pruned":[]}
2752024-10-30T14:15:29.432ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2762024-10-30T14:15:29.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2772024-10-30T14:15:29.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2782024-10-30T14:15:29.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2792024-10-30T14:15:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2802024-10-30T14:15:29.434ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2812024-10-30T14:15:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2822024-10-30T14:15:29.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2832024-10-30T14:15:29.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2842024-10-30T14:15:29.434ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2852024-10-30T14:15:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2862024-10-30T14:15:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2872024-10-30T14:15:29.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2882024-10-30T14:15:29.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2892024-10-30T14:15:29.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2902024-10-30T14:15:29.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2912024-10-30T14:15:29.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2922024-10-30T14:15:29.437ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33290, tv_nsec: 617420307 } })
2932024-10-30T14:15:29.437ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
2942024-10-30T14:15:29.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2952024-10-30T14:15:29.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2962024-10-30T14:15:29.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2972024-10-30T14:15:29.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2982024-10-30T14:15:29.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2992024-10-30T14:15:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3002024-10-30T14:15:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3012024-10-30T14:15:29.440ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3022024-10-30T14:15:29.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3032024-10-30T14:15:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3042024-10-30T14:15:29.440ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3052024-10-30T14:15:29.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3062024-10-30T14:15:29.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3072024-10-30T14:15:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3082024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
3092024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3102024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3112024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3122024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
3132024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3142024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
3152024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3162024-10-30T14:15:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3172024-10-30T14:15:29.444ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3182024-10-30T14:15:29.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3192024-10-30T14:15:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3202024-10-30T14:15:29.447ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3212024-10-30T14:15:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3222024-10-30T14:15:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3232024-10-30T14:15:29.447ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3242024-10-30T14:15:29.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3252024-10-30T14:15:29.449ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3262024-10-30T14:15:29.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3272024-10-30T14:15:29.449ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282024-10-30T14:15:29.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3292024-10-30T14:15:29.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3302024-10-30T14:15:29.451ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3312024-10-30T14:15:29.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3322024-10-30T14:15:29.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3332024-10-30T14:15:29.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3342024-10-30T14:15:29.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3352024-10-30T14:15:29.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3362024-10-30T14:15:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3372024-10-30T14:15:29.455ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3382024-10-30T14:15:29.455ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392024-10-30T14:15:29.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3402024-10-30T14:15:29.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3412024-10-30T14:15:29.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3422024-10-30T14:15:29.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3432024-10-30T14:15:29.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3442024-10-30T14:15:29.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.865795ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3452024-10-30T14:15:29.457ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33290, tv_nsec: 637839173 } })
3462024-10-30T14:15:29.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
3472024-10-30T14:15:29.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3482024-10-30T14:15:29.462ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 34.788236ms iteration = 3 status = {"nsuccess":5}
3492024-10-30T14:15:29.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502024-10-30T14:15:29.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3512024-10-30T14:15:29.466ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3522024-10-30T14:15:29.466ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
3532024-10-30T14:15:29.466ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
3542024-10-30T14:15:29.466ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
3552024-10-30T14:15:29.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3562024-10-30T14:15:29.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3572024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3582024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3592024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
3602024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3612024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3622024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3632024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3642024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3652024-10-30T14:15:29.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3662024-10-30T14:15:29.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3672024-10-30T14:15:29.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3682024-10-30T14:15:29.474ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3692024-10-30T14:15:29.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3702024-10-30T14:15:29.482ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3712024-10-30T14:15:29.483ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.530633ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3722024-10-30T14:15:29.483ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3732024-10-30T14:15:29.483ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 036a00d3-1b62-4bb7-8512-8a6cf898e068 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3742024-10-30T14:15:29.483ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3752024-10-30T14:15:29.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3762024-10-30T14:15:29.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3772024-10-30T14:15:29.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3782024-10-30T14:15:29.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3792024-10-30T14:15:29.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3802024-10-30T14:15:29.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3812024-10-30T14:15:29.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3822024-10-30T14:15:29.507ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
3832024-10-30T14:15:29.507ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
3842024-10-30T14:15:29.507ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.982586ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
3852024-10-30T14:15:29.507ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3862024-10-30T14:15:29.507ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
3872024-10-30T14:15:29.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3882024-10-30T14:15:29.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3892024-10-30T14:15:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3902024-10-30T14:15:29.509ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3912024-10-30T14:15:29.509ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3922024-10-30T14:15:29.509ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.153778ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3932024-10-30T14:15:29.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3942024-10-30T14:15:29.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3952024-10-30T14:15:29.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3962024-10-30T14:15:29.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3972024-10-30T14:15:29.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3982024-10-30T14:15:29.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3992024-10-30T14:15:29.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4002024-10-30T14:15:29.514ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4012024-10-30T14:15:29.514ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
4022024-10-30T14:15:29.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4032024-10-30T14:15:29.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4042024-10-30T14:15:29.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.899474ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
4052024-10-30T14:15:29.516ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
4062024-10-30T14:15:29.516ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
4072024-10-30T14:15:29.516ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
4082024-10-30T14:15:29.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4092024-10-30T14:15:29.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4102024-10-30T14:15:29.541ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4112024-10-30T14:15:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4122024-10-30T14:15:29.545ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 114.067913ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
4132024-10-30T14:15:29.557ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.247916ms iteration = 10 status = {"physical_disks_added":0}
4142024-10-30T14:15:29.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4152024-10-30T14:15:29.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4162024-10-30T14:15:29.592ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4172024-10-30T14:15:29.593ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
4182024-10-30T14:15:29.593ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 165.625285ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
4192024-10-30T14:15:29.597ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 036a00d3-1b62-4bb7-8512-8a6cf898e068 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
4202024-10-30T14:15:29.597ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
4212024-10-30T14:15:29.597ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-30 14:12:58.822178 UTC dns_group = internal generation = 1
4222024-10-30T14:15:29.597ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 169.999434ms iteration = 5 status = {"generation":1}
4232024-10-30T14:15:29.598ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
4242024-10-30T14:15:29.598ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4252024-10-30T14:15:29.598ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82cbc674-babf-4b96-a9aa-a6e27b231607", "content-length": "26", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
4262024-10-30T14:15:29.598ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4272024-10-30T14:15:29.600ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4282024-10-30T14:15:29.607ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
4292024-10-30T14:15:29.607ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 178.268549ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
4302024-10-30T14:15:29.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 zone_address = fd00:1122:3344:101::2
4312024-10-30T14:15:29.627ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4322024-10-30T14:15:29.628ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43a81196-5d1c-47ff-a3a6-aea6abd2b7b5", "content-length": "26", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
4332024-10-30T14:15:29.628ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4342024-10-30T14:15:29.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
4352024-10-30T14:15:29.696ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4362024-10-30T14:15:29.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4372024-10-30T14:15:29.757ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4382024-10-30T14:15:29.766ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 339.037762ms iteration = 7 status = {}
4392024-10-30T14:15:29.783ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
4402024-10-30T14:15:29.783ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4412024-10-30T14:15:29.783ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c72ad89-1f40-4252-8757-787d279e3cc6", "content-length": "26", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
4422024-10-30T14:15:29.783ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4432024-10-30T14:15:29.785ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4442024-10-30T14:15:29.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4452024-10-30T14:15:29.895ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4462024-10-30T14:15:29.896ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "017b56df-1808-4663-acf8-af894af9a2c6", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4472024-10-30T14:15:29.896ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4482024-10-30T14:15:29.897ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bcc114d8-e488-4fbd-92e8-d6de73997848", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4492024-10-30T14:15:29.897ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4502024-10-30T14:15:29.899ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a68c98f2-2d1f-4d51-a6a1-66a3c4e0b8dc", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4512024-10-30T14:15:29.899ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4522024-10-30T14:15:29.900ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4532024-10-30T14:15:29.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4542024-10-30T14:15:29.900ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4552024-10-30T14:15:29.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 473.127859ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4562024-10-30T14:15:29.901ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a61b2dca-2551-4f59-b32e-9a8ecb59fbba", "content-length": "372", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
4572024-10-30T14:15:29.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4582024-10-30T14:15:29.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4592024-10-30T14:15:29.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4602024-10-30T14:15:29.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4612024-10-30T14:15:29.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4622024-10-30T14:15:29.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4632024-10-30T14:15:29.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4642024-10-30T14:15:29.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4652024-10-30T14:15:29.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4662024-10-30T14:15:29.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4672024-10-30T14:15:29.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4682024-10-30T14:15:29.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4692024-10-30T14:15:29.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4702024-10-30T14:15:29.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4712024-10-30T14:15:29.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4722024-10-30T14:15:29.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4732024-10-30T14:15:29.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4742024-10-30T14:15:29.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4752024-10-30T14:15:29.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4762024-10-30T14:15:29.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4772024-10-30T14:15:29.916ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4782024-10-30T14:15:29.916ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9e6226d-d89d-4652-82ed-0415fba5f3b1", "content-length": "1", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
4792024-10-30T14:15:29.917ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-30T14:12:28.404860Z, time_modified: 2024-10-30T14:12:28.404860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, db_silo: Silo { identity: SiloIdentity { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-30T14:12:59.312829Z, time_modified: 2024-10-30T14:12:59.312829Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, db_silo: Silo { identity: SiloIdentity { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-30T14:12:59.312829Z, time_modified: 2024-10-30T14:12:59.312829Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48" }] }) }
4802024-10-30T14:15:29.917ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 489.619068ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","tls_certs":["1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48"]}},"default_endpoint":{"silo_id":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","tls_certs":["1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4812024-10-30T14:15:29.918ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4822024-10-30T14:15:29.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4832024-10-30T14:15:29.920ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 492.613289ms iteration = 7 status = null
4842024-10-30T14:15:29.928ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4852024-10-30T14:15:29.928ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4862024-10-30T14:15:29.928ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 499.605919ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
4872024-10-30T14:15:29.932ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4882024-10-30T14:15:29.932ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4840160e-9ffc-449d-9682-bd185e98fb2e", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4892024-10-30T14:15:29.932ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4902024-10-30T14:15:29.934ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c64b884d-ca17-4cee-8d72-e72688717916", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4912024-10-30T14:15:29.934ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4922024-10-30T14:15:29.936ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4932024-10-30T14:15:29.936ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 508.350637ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4942024-10-30T14:15:29.936ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4952024-10-30T14:15:29.936ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
4962024-10-30T14:15:29.936ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7aaf8c85-7de8-4dba-ba3c-bea52a7650b0 dns_zone_name = oxide.test found_so_far = 0 version = 2
4972024-10-30T14:15:29.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4982024-10-30T14:15:29.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4992024-10-30T14:15:29.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 963ac472-284b-4429-931a-df4a09f45485, lookup_type: ById(963ac472-284b-4429-931a-df4a09f45485) } result = Ok(())
5002024-10-30T14:15:29.939ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5012024-10-30T14:15:29.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5022024-10-30T14:15:29.941ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 513.833977ms iteration = 7 status = 0
5032024-10-30T14:15:29.946ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
5042024-10-30T14:15:29.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
5052024-10-30T14:15:29.947ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3db42cbc-e033-421f-9dd1-17950157da69", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
5062024-10-30T14:15:29.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5072024-10-30T14:15:29.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5082024-10-30T14:15:29.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5092024-10-30T14:15:29.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5102024-10-30T14:15:29.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5112024-10-30T14:15:29.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5122024-10-30T14:15:29.958ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
5132024-10-30T14:15:29.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5142024-10-30T14:15:29.958ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5152024-10-30T14:15:29.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5162024-10-30T14:15:29.959ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f26d93f5-20c7-46ab-806f-a2f00f39b522", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
5172024-10-30T14:15:29.961ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9704a443-267a-4c29-90f6-c5d616116fea, rack_id: 1e7155fc-ddca-45d5-a711-7b3b989aed61, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(498615ba-af90-4d49-8ca5-0cf4d1a30c69) } rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
5182024-10-30T14:15:29.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5192024-10-30T14:15:29.961ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 530.314935ms iteration = 8 status = {}
5202024-10-30T14:15:29.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5212024-10-30T14:15:29.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5222024-10-30T14:15:29.975ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5232024-10-30T14:15:29.976ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "56458303-3ca5-4f6e-84c4-8225c5ffa6d1", "content-length": "121", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
5242024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
5252024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 498615ba-af90-4d49-8ca5-0cf4d1a30c69
5262024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5272024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5282024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5292024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5302024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5312024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5322024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5332024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5342024-10-30T14:15:29.976ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
5352024-10-30T14:15:29.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5362024-10-30T14:15:29.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5372024-10-30T14:15:29.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5382024-10-30T14:15:29.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5392024-10-30T14:15:29.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5402024-10-30T14:15:30.005ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5412024-10-30T14:15:30.005ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e86fff25-01d7-48ca-b24b-598c9dd59635", "content-length": "691", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
5422024-10-30T14:15:30.005ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
5432024-10-30T14:15:30.005ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
5442024-10-30T14:15:30.005ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
5452024-10-30T14:15:30.006ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 578.30674ms iteration = 7 status = {}
5462024-10-30T14:15:30.007ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7aaf8c85-7de8-4dba-ba3c-bea52a7650b0 dns_zone_name = oxide.test found_so_far = 1 version = 2
5472024-10-30T14:15:30.007ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
5482024-10-30T14:15:30.007ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-30 14:12:59.359161 UTC dns_group = external generation = 2
5492024-10-30T14:15:30.007ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 579.427691ms iteration = 5 status = {"generation":2}
5502024-10-30T14:15:30.007ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5512024-10-30T14:15:30.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3bf6ad2-e957-441e-935c-9c9f37955524", "content-length": "2", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
5522024-10-30T14:15:30.007ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5532024-10-30T14:15:30.007ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "27350d48-9543-40e5-b9f5-8e87a387fad9", "content-length": "52", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
5542024-10-30T14:15:30.007ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
5552024-10-30T14:15:30.007ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5562024-10-30T14:15:30.121ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "da0d3a23-c268-44f9-a36e-4243e8b04708", "date": "Wed, 30 Oct 2024 14:15:29 GMT"} })
5572024-10-30T14:15:30.121ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch = Switch0
5582024-10-30T14:15:30.121ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5592024-10-30T14:15:30.121ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a865cd3-3b9e-4564-9171-1c90270131fc", "content-length": "669", "date": "Wed, 30 Oct 2024 14:15:30 GMT"} })
5602024-10-30T14:15:30.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5612024-10-30T14:15:30.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5622024-10-30T14:15:30.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5632024-10-30T14:15:30.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5642024-10-30T14:15:30.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5652024-10-30T14:15:30.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5662024-10-30T14:15:30.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5672024-10-30T14:15:30.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5682024-10-30T14:15:30.248ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 820.409726ms iteration = 7 status = {}
5692024-10-30T14:15:30.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = aa2fb837-ac15-4909-a611-c3fb68443267 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5702024-10-30T14:15:30.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = aa2fb837-ac15-4909-a611-c3fb68443267 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5712024-10-30T14:15:30.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = aa2fb837-ac15-4909-a611-c3fb68443267 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5722024-10-30T14:15:30.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 859d081e-420c-46c5-9e34-02ad64123dfa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
5732024-10-30T14:15:30.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 859d081e-420c-46c5-9e34-02ad64123dfa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
5742024-10-30T14:15:30.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 859d081e-420c-46c5-9e34-02ad64123dfa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
5752024-10-30T14:15:30.748ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
5762024-10-30T14:15:30.748ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
5772024-10-30T14:15:30.778ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5782024-10-30T14:15:30.778ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60385
5792024-10-30T14:15:30.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60385 req_id = e983d8aa-e299-4ba1-86e7-63c20e2ab3ee roles = RoleSet { roles: {} } uri = /metrics/producers
5802024-10-30T14:15:30.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60385 req_id = e983d8aa-e299-4ba1-86e7-63c20e2ab3ee resource = Database result = Ok(()) uri = /metrics/producers
5812024-10-30T14:15:30.818ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
5822024-10-30T14:15:30.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40229 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60385 req_id = e983d8aa-e299-4ba1-86e7-63c20e2ab3ee response_code = 201 uri = /metrics/producers
5832024-10-30T14:15:30.818ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e983d8aa-e299-4ba1-86e7-63c20e2ab3ee", "content-length": "41", "date": "Wed, 30 Oct 2024 14:15:30 GMT"} })
5842024-10-30T14:15:30.820ZDEBGnexus (producer-registration-task): registered with nexus successfully
5852024-10-30T14:15:30.820ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
5862024-10-30T14:15:31.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 59505057-f2d7-4dfd-a1f7-826694105306 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5872024-10-30T14:15:31.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 59505057-f2d7-4dfd-a1f7-826694105306 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5882024-10-30T14:15:31.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 59505057-f2d7-4dfd-a1f7-826694105306 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5892024-10-30T14:15:32.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b824a97-aefd-451b-bef2-43a2ab23a651 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5902024-10-30T14:15:32.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b824a97-aefd-451b-bef2-43a2ab23a651 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5912024-10-30T14:15:32.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b824a97-aefd-451b-bef2-43a2ab23a651 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5922024-10-30T14:15:33.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d1aec8bc-aa56-4e22-9a7e-14f4ceb6b189 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5932024-10-30T14:15:33.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d1aec8bc-aa56-4e22-9a7e-14f4ceb6b189 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5942024-10-30T14:15:33.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d1aec8bc-aa56-4e22-9a7e-14f4ceb6b189 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5952024-10-30T14:15:34.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = da5e11c9-c7d8-4efa-8fc8-d9eaa2ae9d9a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5962024-10-30T14:15:34.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = da5e11c9-c7d8-4efa-8fc8-d9eaa2ae9d9a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5972024-10-30T14:15:34.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = da5e11c9-c7d8-4efa-8fc8-d9eaa2ae9d9a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5982024-10-30T14:15:35.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 19df2d7f-ce1f-49d1-83d3-7edbb06a5c44 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
5992024-10-30T14:15:35.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 19df2d7f-ce1f-49d1-83d3-7edbb06a5c44 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6002024-10-30T14:15:35.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 19df2d7f-ce1f-49d1-83d3-7edbb06a5c44 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6012024-10-30T14:15:36.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 450a3194-d6da-4f63-a03b-23806be83bd3 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6022024-10-30T14:15:36.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 450a3194-d6da-4f63-a03b-23806be83bd3 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6032024-10-30T14:15:36.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 450a3194-d6da-4f63-a03b-23806be83bd3 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6042024-10-30T14:15:37.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 67628a54-9c46-47b9-b9c3-275008937e1c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6052024-10-30T14:15:37.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 67628a54-9c46-47b9-b9c3-275008937e1c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6062024-10-30T14:15:37.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 67628a54-9c46-47b9-b9c3-275008937e1c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6072024-10-30T14:15:38.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0011d977-6b70-4e85-9a76-7350f43febc7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6082024-10-30T14:15:38.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0011d977-6b70-4e85-9a76-7350f43febc7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6092024-10-30T14:15:38.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0011d977-6b70-4e85-9a76-7350f43febc7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6102024-10-30T14:15:38.488ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 5438cff7-80a9-4a61-85a6-851f6a87eeef response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
6112024-10-30T14:15:39.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
6122024-10-30T14:15:39.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6132024-10-30T14:15:39.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6142024-10-30T14:15:39.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
6152024-10-30T14:15:39.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6162024-10-30T14:15:39.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6172024-10-30T14:15:39.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182024-10-30T14:15:39.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6192024-10-30T14:15:39.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6202024-10-30T14:15:39.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6212024-10-30T14:15:39.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6222024-10-30T14:15:39.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6232024-10-30T14:15:39.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6242024-10-30T14:15:39.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6252024-10-30T14:15:39.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6262024-10-30T14:15:39.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
6272024-10-30T14:15:39.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6282024-10-30T14:15:39.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6292024-10-30T14:15:39.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.761829ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6302024-10-30T14:15:39.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1f10c918-db90-4b5b-834e-0c2f28816936 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6312024-10-30T14:15:39.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1f10c918-db90-4b5b-834e-0c2f28816936 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6322024-10-30T14:15:39.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1f10c918-db90-4b5b-834e-0c2f28816936 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6332024-10-30T14:15:39.547ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
6342024-10-30T14:15:39.547ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 119.637615ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
6352024-10-30T14:15:40.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ebea2805-8b62-43f3-8257-2c3645056f53 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6362024-10-30T14:15:40.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ebea2805-8b62-43f3-8257-2c3645056f53 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6372024-10-30T14:15:40.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ebea2805-8b62-43f3-8257-2c3645056f53 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6382024-10-30T14:15:41.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a7ecc235-60b8-4664-948f-b7e10cbea1ea roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6392024-10-30T14:15:41.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a7ecc235-60b8-4664-948f-b7e10cbea1ea resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6402024-10-30T14:15:41.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a7ecc235-60b8-4664-948f-b7e10cbea1ea response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6412024-10-30T14:15:42.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a8fcebb2-6c6a-4c88-8569-7743a4dd73bf roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6422024-10-30T14:15:42.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a8fcebb2-6c6a-4c88-8569-7743a4dd73bf resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6432024-10-30T14:15:42.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a8fcebb2-6c6a-4c88-8569-7743a4dd73bf response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6442024-10-30T14:15:43.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7907a3d9-9add-4734-a4b1-e4058fb74b64 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6452024-10-30T14:15:43.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7907a3d9-9add-4734-a4b1-e4058fb74b64 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6462024-10-30T14:15:43.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7907a3d9-9add-4734-a4b1-e4058fb74b64 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6472024-10-30T14:15:44.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d270089e-3993-405e-b992-679d29f70c70 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6482024-10-30T14:15:44.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d270089e-3993-405e-b992-679d29f70c70 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6492024-10-30T14:15:44.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d270089e-3993-405e-b992-679d29f70c70 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6502024-10-30T14:15:45.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2346016-9cbc-438e-a741-d40cfb3051d7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6512024-10-30T14:15:45.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2346016-9cbc-438e-a741-d40cfb3051d7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6522024-10-30T14:15:45.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2346016-9cbc-438e-a741-d40cfb3051d7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6532024-10-30T14:15:46.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 75bbfa16-1439-46c4-adaf-defd84770b35 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6542024-10-30T14:15:46.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 75bbfa16-1439-46c4-adaf-defd84770b35 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6552024-10-30T14:15:46.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 75bbfa16-1439-46c4-adaf-defd84770b35 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6562024-10-30T14:15:47.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = fc4ef08f-666f-4d41-821c-2471bc19f846 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6572024-10-30T14:15:47.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = fc4ef08f-666f-4d41-821c-2471bc19f846 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6582024-10-30T14:15:47.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = fc4ef08f-666f-4d41-821c-2471bc19f846 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6592024-10-30T14:15:48.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 814d305c-a462-4e98-8aa5-7708acddefc1 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6602024-10-30T14:15:48.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 814d305c-a462-4e98-8aa5-7708acddefc1 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6612024-10-30T14:15:48.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 814d305c-a462-4e98-8aa5-7708acddefc1 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6622024-10-30T14:15:49.428ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
6632024-10-30T14:15:49.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6642024-10-30T14:15:49.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6652024-10-30T14:15:49.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
6662024-10-30T14:15:49.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6672024-10-30T14:15:49.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6682024-10-30T14:15:49.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6692024-10-30T14:15:49.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6702024-10-30T14:15:49.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6712024-10-30T14:15:49.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6722024-10-30T14:15:49.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6732024-10-30T14:15:49.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6742024-10-30T14:15:49.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6752024-10-30T14:15:49.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6762024-10-30T14:15:49.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6772024-10-30T14:15:49.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
6782024-10-30T14:15:49.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6792024-10-30T14:15:49.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6802024-10-30T14:15:49.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
6812024-10-30T14:15:49.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.145661ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
6822024-10-30T14:15:49.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.131819ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6832024-10-30T14:15:49.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1721b7e-19dd-4260-ad90-61a2d47dc354 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6842024-10-30T14:15:49.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1721b7e-19dd-4260-ad90-61a2d47dc354 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6852024-10-30T14:15:49.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1721b7e-19dd-4260-ad90-61a2d47dc354 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6862024-10-30T14:15:50.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 34de502e-e7f0-4ec6-8652-f3337e4f5564 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6872024-10-30T14:15:50.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 34de502e-e7f0-4ec6-8652-f3337e4f5564 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6882024-10-30T14:15:50.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 34de502e-e7f0-4ec6-8652-f3337e4f5564 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6892024-10-30T14:15:51.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a7cafc36-08cb-4c26-b853-e07a552dca76 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6902024-10-30T14:15:51.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a7cafc36-08cb-4c26-b853-e07a552dca76 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6912024-10-30T14:15:51.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2629 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a7cafc36-08cb-4c26-b853-e07a552dca76 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6922024-10-30T14:15:52.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2b54ce9d-ddc9-4612-97db-584b3e816f3b roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6932024-10-30T14:15:52.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2b54ce9d-ddc9-4612-97db-584b3e816f3b resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6942024-10-30T14:15:52.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2b54ce9d-ddc9-4612-97db-584b3e816f3b response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6952024-10-30T14:15:53.489ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1251 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 1cbaa1cb-6695-457b-8ab6-d978e581dc48 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
6962024-10-30T14:15:53.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cdcb4c36-6b12-401e-aaf6-30c09f769451 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6972024-10-30T14:15:53.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cdcb4c36-6b12-401e-aaf6-30c09f769451 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6982024-10-30T14:15:53.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cdcb4c36-6b12-401e-aaf6-30c09f769451 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
6992024-10-30T14:15:54.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b2feb9c5-3281-4084-958e-0a95ff44a58b roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7002024-10-30T14:15:54.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b2feb9c5-3281-4084-958e-0a95ff44a58b resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7012024-10-30T14:15:54.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2081 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b2feb9c5-3281-4084-958e-0a95ff44a58b response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7022024-10-30T14:15:55.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 941843f7-838d-4133-94cb-9cb116ec143c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7032024-10-30T14:15:55.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 941843f7-838d-4133-94cb-9cb116ec143c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7042024-10-30T14:15:55.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 941843f7-838d-4133-94cb-9cb116ec143c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7052024-10-30T14:15:56.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 52884128-d181-4c4f-9183-bf85859f341a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7062024-10-30T14:15:56.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 52884128-d181-4c4f-9183-bf85859f341a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7072024-10-30T14:15:56.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 52884128-d181-4c4f-9183-bf85859f341a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7082024-10-30T14:15:57.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4603f114-efb1-498f-9176-cd8e1a8d9e35 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7092024-10-30T14:15:57.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4603f114-efb1-498f-9176-cd8e1a8d9e35 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7102024-10-30T14:15:57.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4603f114-efb1-498f-9176-cd8e1a8d9e35 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7112024-10-30T14:15:58.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = bdf71d4e-f676-42ae-8410-460fc5b7603d roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
7122024-10-30T14:15:58.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = bdf71d4e-f676-42ae-8410-460fc5b7603d resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
7132024-10-30T14:15:58.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = bdf71d4e-f676-42ae-8410-460fc5b7603d response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
7142024-10-30T14:15:58.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 87fb7efa-c88b-407f-b7e1-14469c6cc968 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
7152024-10-30T14:15:58.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 87fb7efa-c88b-407f-b7e1-14469c6cc968 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
7162024-10-30T14:15:58.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 87fb7efa-c88b-407f-b7e1-14469c6cc968 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
7172024-10-30T14:15:58.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 42d887af-621c-45c1-ae5b-a10aa588de0c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7182024-10-30T14:15:58.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 42d887af-621c-45c1-ae5b-a10aa588de0c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7192024-10-30T14:15:58.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 42d887af-621c-45c1-ae5b-a10aa588de0c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
7202024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
7212024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
7222024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7232024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7242024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
7252024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
7262024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7272024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7282024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
7292024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7302024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
7312024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
7322024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7332024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7342024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7352024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7362024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7372024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7382024-10-30T14:15:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7392024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
7402024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
7412024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7422024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7432024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
7442024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7452024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
7462024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7472024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7482024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7492024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7502024-10-30T14:15:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7512024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7522024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
7532024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7542024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7552024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7562024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
7572024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.64\u{b5}s iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
7582024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
7592024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.85\u{b5}s iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7602024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
7612024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
7622024-10-30T14:15:59.430ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
7632024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7642024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.37\u{b5}s iteration = 8 status = {"errors":[],"records_set_to_done":[]}
7652024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
7662024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.2\u{b5}s iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7672024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7682024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692024-10-30T14:15:59.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702024-10-30T14:15:59.431ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33320, tv_nsec: 611579229 } })
7712024-10-30T14:15:59.431ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
7722024-10-30T14:15:59.431ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.809193ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7732024-10-30T14:15:59.432ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33320, tv_nsec: 612133744 } })
7742024-10-30T14:15:59.432ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
7752024-10-30T14:15:59.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7762024-10-30T14:15:59.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7772024-10-30T14:15:59.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7782024-10-30T14:15:59.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7792024-10-30T14:15:59.433ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7802024-10-30T14:15:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7812024-10-30T14:15:59.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7822024-10-30T14:15:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7832024-10-30T14:15:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7842024-10-30T14:15:59.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7852024-10-30T14:15:59.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7862024-10-30T14:15:59.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7872024-10-30T14:15:59.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7882024-10-30T14:15:59.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7892024-10-30T14:15:59.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7902024-10-30T14:15:59.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7912024-10-30T14:15:59.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7922024-10-30T14:15:59.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33320, tv_nsec: 623559574 } })
7932024-10-30T14:15:59.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
7942024-10-30T14:15:59.471ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7952024-10-30T14:15:59.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7962024-10-30T14:15:59.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7972024-10-30T14:15:59.476ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7982024-10-30T14:15:59.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7992024-10-30T14:15:59.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8002024-10-30T14:15:59.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
8012024-10-30T14:15:59.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8022024-10-30T14:15:59.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8032024-10-30T14:15:59.478ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8042024-10-30T14:15:59.478ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8052024-10-30T14:15:59.478ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8062024-10-30T14:15:59.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8072024-10-30T14:15:59.479ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8082024-10-30T14:15:59.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8092024-10-30T14:15:59.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8102024-10-30T14:15:59.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8112024-10-30T14:15:59.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8122024-10-30T14:15:59.481ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8132024-10-30T14:15:59.481ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8142024-10-30T14:15:59.481ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8152024-10-30T14:15:59.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8162024-10-30T14:15:59.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8172024-10-30T14:15:59.483ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8182024-10-30T14:15:59.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8192024-10-30T14:15:59.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8202024-10-30T14:15:59.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8212024-10-30T14:15:59.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8222024-10-30T14:15:59.486ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8232024-10-30T14:15:59.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8242024-10-30T14:15:59.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8252024-10-30T14:15:59.489ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
8262024-10-30T14:15:59.489ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.321238ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
8272024-10-30T14:15:59.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8282024-10-30T14:15:59.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8292024-10-30T14:15:59.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8302024-10-30T14:15:59.494ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8312024-10-30T14:15:59.494ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.738069ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8322024-10-30T14:15:59.497ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
8332024-10-30T14:15:59.497ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8342024-10-30T14:15:59.497ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ed3afc3-bfd2-4875-9eb2-99097decce41", "content-length": "26", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
8352024-10-30T14:15:59.497ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8362024-10-30T14:15:59.499ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8372024-10-30T14:15:59.508ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
8382024-10-30T14:15:59.508ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8392024-10-30T14:15:59.509ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "135754bb-bb8b-497d-99fa-81ce021e4bda", "content-length": "26", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
8402024-10-30T14:15:59.509ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8412024-10-30T14:15:59.510ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8422024-10-30T14:15:59.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.662863ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
8432024-10-30T14:15:59.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 85.66727ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8442024-10-30T14:15:59.526ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8452024-10-30T14:15:59.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8462024-10-30T14:15:59.534ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 zone_address = fd00:1122:3344:101::2
8472024-10-30T14:15:59.534ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8482024-10-30T14:15:59.534ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae0cab84-e374-40f0-a386-20c031b26b32", "content-length": "26", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
8492024-10-30T14:15:59.534ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8502024-10-30T14:15:59.536ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
8512024-10-30T14:15:59.544ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8522024-10-30T14:15:59.544ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8532024-10-30T14:15:59.544ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.514905ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8542024-10-30T14:15:59.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8552024-10-30T14:15:59.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8562024-10-30T14:15:59.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8572024-10-30T14:15:59.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8582024-10-30T14:15:59.617ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 189.660469ms iteration = 8 status = {}
8592024-10-30T14:15:59.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8602024-10-30T14:15:59.618ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.939854ms iteration = 11 status = {"physical_disks_added":0}
8612024-10-30T14:15:59.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 963ac472-284b-4429-931a-df4a09f45485, lookup_type: ById(963ac472-284b-4429-931a-df4a09f45485) } result = Ok(())
8622024-10-30T14:15:59.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8632024-10-30T14:15:59.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8642024-10-30T14:15:59.622ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 194.586922ms iteration = 8 status = 0
8652024-10-30T14:15:59.628ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8662024-10-30T14:15:59.629ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "828336d5-4281-487a-a98d-f6d49319c1fd", "content-length": "1", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
8672024-10-30T14:15:59.630ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8682024-10-30T14:15:59.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8692024-10-30T14:15:59.633ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 205.212992ms iteration = 8 status = null
8702024-10-30T14:15:59.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8712024-10-30T14:15:59.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8722024-10-30T14:15:59.646ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8732024-10-30T14:15:59.647ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8742024-10-30T14:15:59.647ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2bf50bf-8252-4101-99ca-8df5953e7888", "content-length": "372", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
8752024-10-30T14:15:59.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8762024-10-30T14:15:59.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8772024-10-30T14:15:59.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8782024-10-30T14:15:59.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8792024-10-30T14:15:59.683ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8802024-10-30T14:15:59.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8812024-10-30T14:15:59.693ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8822024-10-30T14:15:59.693ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8832024-10-30T14:15:59.693ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8542d3af-07ce-4cb6-bbc5-bd5c317f61ea", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
8842024-10-30T14:15:59.693ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8852024-10-30T14:15:59.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8862024-10-30T14:15:59.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8872024-10-30T14:15:59.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8882024-10-30T14:15:59.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8892024-10-30T14:15:59.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8902024-10-30T14:15:59.705ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8912024-10-30T14:15:59.705ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8922024-10-30T14:15:59.705ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e520f495-8ab6-4cbc-8465-35285514316a", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
8932024-10-30T14:15:59.707ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.082366ms iteration = 9 status = {}
8942024-10-30T14:15:59.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8952024-10-30T14:15:59.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8962024-10-30T14:15:59.713ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9704a443-267a-4c29-90f6-c5d616116fea, rack_id: 1e7155fc-ddca-45d5-a711-7b3b989aed61, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(498615ba-af90-4d49-8ca5-0cf4d1a30c69) } rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
8972024-10-30T14:15:59.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8982024-10-30T14:15:59.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8992024-10-30T14:15:59.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9002024-10-30T14:15:59.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9012024-10-30T14:15:59.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9022024-10-30T14:15:59.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9032024-10-30T14:15:59.750ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9042024-10-30T14:15:59.750ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "967e8a3d-d1bf-488a-ba48-c836c14cbc3d", "content-length": "691", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
9052024-10-30T14:15:59.750ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9062024-10-30T14:15:59.750ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9072024-10-30T14:15:59.750ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9082024-10-30T14:15:59.752ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 322.946354ms iteration = 8 status = {}
9092024-10-30T14:15:59.832ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
9102024-10-30T14:15:59.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b54af0a4-4817-4195-bcc7-3f2e5b5f6b18", "content-length": "121", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
9112024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
9122024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 498615ba-af90-4d49-8ca5-0cf4d1a30c69
9132024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9142024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9152024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9162024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9172024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9182024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9192024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9202024-10-30T14:15:59.833ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9212024-10-30T14:15:59.834ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
9222024-10-30T14:15:59.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9232024-10-30T14:15:59.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9242024-10-30T14:15:59.836ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9252024-10-30T14:15:59.836ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4345b41-e2d5-4b39-b405-da3545f02e2c", "content-length": "2", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
9262024-10-30T14:15:59.836ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9272024-10-30T14:15:59.837ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "374ced18-08ee-4420-b781-f23a6f1fafa1", "content-length": "52", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
9282024-10-30T14:15:59.837ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
9292024-10-30T14:15:59.837ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9302024-10-30T14:15:59.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0e07227b-25ac-4380-aee1-8abb5e53029b roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9312024-10-30T14:15:59.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0e07227b-25ac-4380-aee1-8abb5e53029b resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9322024-10-30T14:15:59.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0e07227b-25ac-4380-aee1-8abb5e53029b response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9332024-10-30T14:15:59.993ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "23459a61-3aa9-4253-a24d-4766cca87eb3", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
9342024-10-30T14:15:59.993ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch = Switch0
9352024-10-30T14:15:59.993ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9362024-10-30T14:15:59.994ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1a1eaa7-f6a7-4b99-a261-18d227c7f1e1", "content-length": "669", "date": "Wed, 30 Oct 2024 14:15:59 GMT"} })
9372024-10-30T14:15:59.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9382024-10-30T14:15:59.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9392024-10-30T14:16:00.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9402024-10-30T14:16:00.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9412024-10-30T14:16:00.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9422024-10-30T14:16:00.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9432024-10-30T14:16:00.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9442024-10-30T14:16:00.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9452024-10-30T14:16:00.118ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 690.210434ms iteration = 8 status = {}
9462024-10-30T14:16:00.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = e705275a-cb9d-4ba6-a405-78be25e00514 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
9472024-10-30T14:16:00.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = e705275a-cb9d-4ba6-a405-78be25e00514 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
9482024-10-30T14:16:00.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = e705275a-cb9d-4ba6-a405-78be25e00514 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
9492024-10-30T14:16:00.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 310edd81-f292-4802-a9c3-66271a712f0f roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9502024-10-30T14:16:00.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 310edd81-f292-4802-a9c3-66271a712f0f resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9512024-10-30T14:16:00.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 310edd81-f292-4802-a9c3-66271a712f0f response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9522024-10-30T14:16:02.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9eb9a413-5a73-476f-aabd-af396bb0e287 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9532024-10-30T14:16:02.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9eb9a413-5a73-476f-aabd-af396bb0e287 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9542024-10-30T14:16:02.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9eb9a413-5a73-476f-aabd-af396bb0e287 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9552024-10-30T14:16:03.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3e71a0b3-f57c-448b-9332-a2c9fa8afdd7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9562024-10-30T14:16:03.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3e71a0b3-f57c-448b-9332-a2c9fa8afdd7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9572024-10-30T14:16:03.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3e71a0b3-f57c-448b-9332-a2c9fa8afdd7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9582024-10-30T14:16:04.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4c61bc7a-b2e0-4ef7-b1e7-375776d89dfa roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9592024-10-30T14:16:04.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4c61bc7a-b2e0-4ef7-b1e7-375776d89dfa resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9602024-10-30T14:16:04.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4c61bc7a-b2e0-4ef7-b1e7-375776d89dfa response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9612024-10-30T14:16:05.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 62914dcc-9e21-4665-9d4f-5c2cd928899a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9622024-10-30T14:16:05.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 62914dcc-9e21-4665-9d4f-5c2cd928899a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9632024-10-30T14:16:05.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 62914dcc-9e21-4665-9d4f-5c2cd928899a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9642024-10-30T14:16:06.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 33c166f0-2c24-4818-877f-3f4c3f55945b roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9652024-10-30T14:16:06.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 33c166f0-2c24-4818-877f-3f4c3f55945b resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9662024-10-30T14:16:06.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 33c166f0-2c24-4818-877f-3f4c3f55945b response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9672024-10-30T14:16:07.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d5435503-c7b3-46b6-9d35-c7520a31913a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9682024-10-30T14:16:07.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d5435503-c7b3-46b6-9d35-c7520a31913a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9692024-10-30T14:16:07.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d5435503-c7b3-46b6-9d35-c7520a31913a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9702024-10-30T14:16:08.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b8b1b347-2099-428b-88f5-859d012d5340 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9712024-10-30T14:16:08.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b8b1b347-2099-428b-88f5-859d012d5340 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9722024-10-30T14:16:08.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b8b1b347-2099-428b-88f5-859d012d5340 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9732024-10-30T14:16:08.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1219 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 9632ea56-6079-4e74-8edd-de2010e17f3f response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
9742024-10-30T14:16:09.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 33831378-e7b0-4b14-b00d-6a341ffc5291 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9752024-10-30T14:16:09.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 33831378-e7b0-4b14-b00d-6a341ffc5291 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9762024-10-30T14:16:09.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 33831378-e7b0-4b14-b00d-6a341ffc5291 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9772024-10-30T14:16:09.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
9782024-10-30T14:16:09.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9792024-10-30T14:16:09.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9802024-10-30T14:16:09.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
9812024-10-30T14:16:09.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9822024-10-30T14:16:09.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9832024-10-30T14:16:09.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9842024-10-30T14:16:09.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9852024-10-30T14:16:09.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9862024-10-30T14:16:09.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9872024-10-30T14:16:09.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9882024-10-30T14:16:09.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9892024-10-30T14:16:09.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9902024-10-30T14:16:09.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9912024-10-30T14:16:09.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.519793ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9922024-10-30T14:16:09.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9932024-10-30T14:16:09.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
9942024-10-30T14:16:09.463ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9952024-10-30T14:16:09.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9962024-10-30T14:16:09.472ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
9972024-10-30T14:16:09.472ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.241853ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
9982024-10-30T14:16:10.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 085d428c-0048-4034-987f-53ddb497a019 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
9992024-10-30T14:16:10.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 085d428c-0048-4034-987f-53ddb497a019 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10002024-10-30T14:16:10.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 085d428c-0048-4034-987f-53ddb497a019 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10012024-10-30T14:16:11.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7a840c7f-07db-4dcb-a8f2-e0585092b198 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10022024-10-30T14:16:11.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7a840c7f-07db-4dcb-a8f2-e0585092b198 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10032024-10-30T14:16:11.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7a840c7f-07db-4dcb-a8f2-e0585092b198 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10042024-10-30T14:16:12.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 15efa6e3-fa38-4af3-bc1a-d5a0c1ad9992 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10052024-10-30T14:16:12.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 15efa6e3-fa38-4af3-bc1a-d5a0c1ad9992 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10062024-10-30T14:16:12.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 15efa6e3-fa38-4af3-bc1a-d5a0c1ad9992 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10072024-10-30T14:16:13.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 27e611d4-5ee7-41b1-889d-b3b602d03dd3 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10082024-10-30T14:16:13.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 27e611d4-5ee7-41b1-889d-b3b602d03dd3 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10092024-10-30T14:16:13.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 27e611d4-5ee7-41b1-889d-b3b602d03dd3 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10102024-10-30T14:16:14.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f9010338-795c-44aa-9188-6b054434b002 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10112024-10-30T14:16:14.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f9010338-795c-44aa-9188-6b054434b002 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10122024-10-30T14:16:14.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f9010338-795c-44aa-9188-6b054434b002 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10132024-10-30T14:16:15.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 28a258bc-21b0-4e9f-815c-98e319e71b73 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10142024-10-30T14:16:15.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 28a258bc-21b0-4e9f-815c-98e319e71b73 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10152024-10-30T14:16:15.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 28a258bc-21b0-4e9f-815c-98e319e71b73 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10162024-10-30T14:16:16.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 65f63e2e-d911-40c8-bf3c-7a560e8f0715 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10172024-10-30T14:16:16.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 65f63e2e-d911-40c8-bf3c-7a560e8f0715 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10182024-10-30T14:16:16.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 65f63e2e-d911-40c8-bf3c-7a560e8f0715 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10192024-10-30T14:16:17.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 52c3f537-6efe-4ab8-91a9-ebe5cb44c6e3 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10202024-10-30T14:16:17.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 52c3f537-6efe-4ab8-91a9-ebe5cb44c6e3 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10212024-10-30T14:16:17.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 52c3f537-6efe-4ab8-91a9-ebe5cb44c6e3 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10222024-10-30T14:16:18.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a0e41f15-955a-41a7-9a34-872ffd92cbf3 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10232024-10-30T14:16:18.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a0e41f15-955a-41a7-9a34-872ffd92cbf3 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10242024-10-30T14:16:18.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a0e41f15-955a-41a7-9a34-872ffd92cbf3 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10252024-10-30T14:16:19.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0ad431ab-3e72-4c9e-85f6-56e18bf5e409 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10262024-10-30T14:16:19.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0ad431ab-3e72-4c9e-85f6-56e18bf5e409 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10272024-10-30T14:16:19.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0ad431ab-3e72-4c9e-85f6-56e18bf5e409 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10282024-10-30T14:16:19.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
10292024-10-30T14:16:19.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10302024-10-30T14:16:19.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10312024-10-30T14:16:19.429ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
10322024-10-30T14:16:19.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10332024-10-30T14:16:19.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10342024-10-30T14:16:19.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10352024-10-30T14:16:19.431ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10362024-10-30T14:16:19.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10372024-10-30T14:16:19.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10382024-10-30T14:16:19.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10392024-10-30T14:16:19.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10402024-10-30T14:16:19.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10412024-10-30T14:16:19.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10422024-10-30T14:16:19.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432024-10-30T14:16:19.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
10442024-10-30T14:16:19.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10452024-10-30T14:16:19.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10462024-10-30T14:16:19.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.781847ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10472024-10-30T14:16:19.545ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
10482024-10-30T14:16:19.545ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.490264ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
10492024-10-30T14:16:20.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6ec6c412-19c5-438c-a6f4-4cddc41de71e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10502024-10-30T14:16:20.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6ec6c412-19c5-438c-a6f4-4cddc41de71e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10512024-10-30T14:16:20.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6ec6c412-19c5-438c-a6f4-4cddc41de71e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10522024-10-30T14:16:21.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 056331eb-63e7-44ab-9a6b-6e9385dc952c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10532024-10-30T14:16:21.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 056331eb-63e7-44ab-9a6b-6e9385dc952c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10542024-10-30T14:16:21.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 056331eb-63e7-44ab-9a6b-6e9385dc952c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10552024-10-30T14:16:22.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 12b51174-712d-483f-a29e-67e59b74710a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10562024-10-30T14:16:22.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 12b51174-712d-483f-a29e-67e59b74710a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10572024-10-30T14:16:22.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 12b51174-712d-483f-a29e-67e59b74710a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10582024-10-30T14:16:23.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1b82092a-143b-44f6-a737-27e4f6378d1a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10592024-10-30T14:16:23.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1b82092a-143b-44f6-a737-27e4f6378d1a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10602024-10-30T14:16:23.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1b82092a-143b-44f6-a737-27e4f6378d1a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10612024-10-30T14:16:23.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 1cb77622-4393-437e-af09-f6772b403ccd response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
10622024-10-30T14:16:24.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c8b9848f-974f-4fbe-85dd-bc85d4170457 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10632024-10-30T14:16:24.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c8b9848f-974f-4fbe-85dd-bc85d4170457 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10642024-10-30T14:16:24.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c8b9848f-974f-4fbe-85dd-bc85d4170457 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10652024-10-30T14:16:25.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 28d209f4-9637-4f14-be5c-24efc11efa08 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10662024-10-30T14:16:25.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 28d209f4-9637-4f14-be5c-24efc11efa08 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10672024-10-30T14:16:25.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 28d209f4-9637-4f14-be5c-24efc11efa08 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10682024-10-30T14:16:26.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 04601b5c-93d6-4c3f-9a4e-40998666e615 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10692024-10-30T14:16:26.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 04601b5c-93d6-4c3f-9a4e-40998666e615 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10702024-10-30T14:16:26.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 04601b5c-93d6-4c3f-9a4e-40998666e615 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10712024-10-30T14:16:27.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8fc0ac13-3dd2-45aa-987b-99f84a3d975e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10722024-10-30T14:16:27.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8fc0ac13-3dd2-45aa-987b-99f84a3d975e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10732024-10-30T14:16:27.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8fc0ac13-3dd2-45aa-987b-99f84a3d975e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10742024-10-30T14:16:28.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = b3b74b86-3e09-46d7-935f-b41678558f82 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
10752024-10-30T14:16:28.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = b3b74b86-3e09-46d7-935f-b41678558f82 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
10762024-10-30T14:16:28.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = b3b74b86-3e09-46d7-935f-b41678558f82 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
10772024-10-30T14:16:28.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = f01f5f06-21fa-4917-a099-787c16723370 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
10782024-10-30T14:16:28.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = f01f5f06-21fa-4917-a099-787c16723370 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
10792024-10-30T14:16:28.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = f01f5f06-21fa-4917-a099-787c16723370 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
10802024-10-30T14:16:28.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 18d9f2d5-d74d-4797-a198-8d902e21ab63 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10812024-10-30T14:16:28.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 18d9f2d5-d74d-4797-a198-8d902e21ab63 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10822024-10-30T14:16:28.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 18d9f2d5-d74d-4797-a198-8d902e21ab63 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
10832024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
10842024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10852024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
10862024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10872024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10882024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
10892024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
10902024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10912024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
10922024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
10932024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
10942024-10-30T14:16:29.428ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10952024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10962024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
10972024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
10982024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
10992024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
11002024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11012024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11022024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
11032024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11042024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
11052024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
11062024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11072024-10-30T14:16:29.428ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854
11082024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
11092024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
11102024-10-30T14:16:29.428ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-30 14:06:29.428292426 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11112024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.201\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854"}
11122024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11132024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11142024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
11152024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11162024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11172024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
11182024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11192024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
11202024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11212024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
11222024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11232024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
11242024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11252024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11262024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11272024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11282024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11292024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11302024-10-30T14:16:29.428ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62825ae7-d0e8-4554-b47e-377bf9997852.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a5a8b395-0169-4688-a9f0-b29d7a7c4214.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a5a8b395-0169-4688-a9f0-b29d7a7c4214.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33350, tv_nsec: 608788383 } })
11312024-10-30T14:16:29.428ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d63b0d7-b7b2-4bc1-b329-13e53ae58f30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d00dc1a3-b063-4364-8a39-247d9fd1eb38.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40e7162-26ca-4c45-932d-9e6f8cedacab.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40e7162-26ca-4c45-932d-9e6f8cedacab.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 33350, tv_nsec: 608791393 } })
11322024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11332024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11342024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11352024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11362024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
11372024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11382024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11392024-10-30T14:16:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11402024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11412024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11422024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
11432024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11442024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
11452024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11462024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11472024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
11482024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.160851ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
11492024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
11502024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.338646ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
11512024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11522024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11532024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11542024-10-30T14:16:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11552024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11562024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
11572024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
11582024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.08\u{b5}s iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11592024-10-30T14:16:29.430ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11602024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
11612024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
11622024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.24\u{b5}s iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
11632024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11642024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
11652024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
11662024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
11672024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
11682024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.14\u{b5}s iteration = 9 status = {"errors":[],"records_set_to_done":[]}
11692024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
11702024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.89\u{b5}s iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11712024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11722024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
11732024-10-30T14:16:29.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11742024-10-30T14:16:29.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11752024-10-30T14:16:29.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11762024-10-30T14:16:29.431ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.377112ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11772024-10-30T14:16:29.431ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11782024-10-30T14:16:29.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11792024-10-30T14:16:29.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11802024-10-30T14:16:29.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11812024-10-30T14:16:29.434ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11822024-10-30T14:16:29.434ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11832024-10-30T14:16:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11842024-10-30T14:16:29.434ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33350, tv_nsec: 614773495 } })
11852024-10-30T14:16:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11862024-10-30T14:16:29.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11872024-10-30T14:16:29.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11882024-10-30T14:16:29.434ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11892024-10-30T14:16:29.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11902024-10-30T14:16:29.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11912024-10-30T14:16:29.435ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
11922024-10-30T14:16:29.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11932024-10-30T14:16:29.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11942024-10-30T14:16:29.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952024-10-30T14:16:29.437ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33350, tv_nsec: 617715626 } })
11962024-10-30T14:16:29.438ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
11972024-10-30T14:16:29.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11982024-10-30T14:16:29.438ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-30 14:06:29.428292426 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11992024-10-30T14:16:29.438ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.438994ms iteration = 5 status = {"expiration":"2024-10-30T14:06:29.428292426Z","pruned":[]}
12002024-10-30T14:16:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12012024-10-30T14:16:29.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12022024-10-30T14:16:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12032024-10-30T14:16:29.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12042024-10-30T14:16:29.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12052024-10-30T14:16:29.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12062024-10-30T14:16:29.443ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.138858ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
12072024-10-30T14:16:29.445ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
12082024-10-30T14:16:29.445ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
12092024-10-30T14:16:29.445ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.306186ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
12102024-10-30T14:16:29.450ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12112024-10-30T14:16:29.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33350, tv_nsec: 630130883 } })
12122024-10-30T14:16:29.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12132024-10-30T14:16:29.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
12142024-10-30T14:16:29.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12152024-10-30T14:16:29.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12162024-10-30T14:16:29.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12172024-10-30T14:16:29.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12182024-10-30T14:16:29.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12192024-10-30T14:16:29.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12202024-10-30T14:16:29.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12212024-10-30T14:16:29.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12222024-10-30T14:16:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12232024-10-30T14:16:29.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12242024-10-30T14:16:29.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12252024-10-30T14:16:29.463ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12262024-10-30T14:16:29.463ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.832027ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12272024-10-30T14:16:29.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
12282024-10-30T14:16:29.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12292024-10-30T14:16:29.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12302024-10-30T14:16:29.481ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312024-10-30T14:16:29.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12322024-10-30T14:16:29.484ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12332024-10-30T14:16:29.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12342024-10-30T14:16:29.485ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
12352024-10-30T14:16:29.486ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.858374ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
12362024-10-30T14:16:29.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12372024-10-30T14:16:29.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12382024-10-30T14:16:29.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12392024-10-30T14:16:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12402024-10-30T14:16:29.493ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12412024-10-30T14:16:29.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12422024-10-30T14:16:29.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12432024-10-30T14:16:29.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12442024-10-30T14:16:29.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12452024-10-30T14:16:29.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12462024-10-30T14:16:29.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12472024-10-30T14:16:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12482024-10-30T14:16:29.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12492024-10-30T14:16:29.501ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12502024-10-30T14:16:29.501ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12512024-10-30T14:16:29.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12522024-10-30T14:16:29.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12532024-10-30T14:16:29.502ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12542024-10-30T14:16:29.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 963ac472-284b-4429-931a-df4a09f45485, lookup_type: ById(963ac472-284b-4429-931a-df4a09f45485) } result = Ok(())
12552024-10-30T14:16:29.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12562024-10-30T14:16:29.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12572024-10-30T14:16:29.505ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12582024-10-30T14:16:29.505ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12592024-10-30T14:16:29.505ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.531149ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12602024-10-30T14:16:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
12612024-10-30T14:16:29.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12622024-10-30T14:16:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12632024-10-30T14:16:29.507ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.515043ms iteration = 9 status = 0
12642024-10-30T14:16:29.509ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12652024-10-30T14:16:29.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12662024-10-30T14:16:29.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672024-10-30T14:16:29.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12682024-10-30T14:16:29.512ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12692024-10-30T14:16:29.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12702024-10-30T14:16:29.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12712024-10-30T14:16:29.516ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12722024-10-30T14:16:29.516ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12732024-10-30T14:16:29.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12742024-10-30T14:16:29.517ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12752024-10-30T14:16:29.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12762024-10-30T14:16:29.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12772024-10-30T14:16:29.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12782024-10-30T14:16:29.521ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12792024-10-30T14:16:29.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12802024-10-30T14:16:29.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.125442ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12812024-10-30T14:16:29.557ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12822024-10-30T14:16:29.557ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12832024-10-30T14:16:29.557ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12842024-10-30T14:16:29.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12852024-10-30T14:16:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12862024-10-30T14:16:29.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 129.706588ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12872024-10-30T14:16:29.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12882024-10-30T14:16:29.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12892024-10-30T14:16:29.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12902024-10-30T14:16:29.564ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12912024-10-30T14:16:29.564ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12922024-10-30T14:16:29.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12932024-10-30T14:16:29.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12942024-10-30T14:16:29.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12952024-10-30T14:16:29.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12962024-10-30T14:16:29.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12972024-10-30T14:16:29.565ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
12982024-10-30T14:16:29.565ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12992024-10-30T14:16:29.565ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "df00ab40-4914-4161-9033-4bef772b2162", "content-length": "26", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
13002024-10-30T14:16:29.565ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13012024-10-30T14:16:29.567ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13022024-10-30T14:16:29.571ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13032024-10-30T14:16:29.571ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13042024-10-30T14:16:29.571ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13052024-10-30T14:16:29.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13062024-10-30T14:16:29.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13072024-10-30T14:16:29.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082024-10-30T14:16:29.574ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
13092024-10-30T14:16:29.577ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13102024-10-30T14:16:29.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13112024-10-30T14:16:29.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13122024-10-30T14:16:29.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13132024-10-30T14:16:29.579ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-30T14:12:28.404860Z, time_modified: 2024-10-30T14:12:28.404860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, db_silo: Silo { identity: SiloIdentity { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-30T14:12:59.312829Z, time_modified: 2024-10-30T14:12:59.312829Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, db_silo: Silo { identity: SiloIdentity { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-30T14:12:59.312829Z, time_modified: 2024-10-30T14:12:59.312829Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48" }] }) }
13142024-10-30T14:16:29.579ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 151.596724ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","tls_certs":["1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48"]}},"default_endpoint":{"silo_id":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","tls_certs":["1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
13152024-10-30T14:16:29.580ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13162024-10-30T14:16:29.580ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7aaf8c85-7de8-4dba-ba3c-bea52a7650b0 dns_zone_name = oxide.test found_so_far = 0 version = 2
13172024-10-30T14:16:29.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13182024-10-30T14:16:29.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13192024-10-30T14:16:29.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13202024-10-30T14:16:29.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13212024-10-30T14:16:29.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13222024-10-30T14:16:29.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13232024-10-30T14:16:29.588ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
13242024-10-30T14:16:29.588ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13252024-10-30T14:16:29.589ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b0c2e3f-5d09-48b0-b06e-80832e926a58", "content-length": "26", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
13262024-10-30T14:16:29.589ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13272024-10-30T14:16:29.590ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13282024-10-30T14:16:29.596ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7aaf8c85-7de8-4dba-ba3c-bea52a7650b0 dns_zone_name = oxide.test found_so_far = 1 version = 2
13292024-10-30T14:16:29.596ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13302024-10-30T14:16:29.596ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-30 14:12:59.359161 UTC dns_group = external generation = 2
13312024-10-30T14:16:29.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 168.38012ms iteration = 6 status = {"generation":2}
13322024-10-30T14:16:29.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 909405cd-b839-46bd-bf5d-f4c14fd188fe roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
13332024-10-30T14:16:29.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 909405cd-b839-46bd-bf5d-f4c14fd188fe resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
13342024-10-30T14:16:29.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 909405cd-b839-46bd-bf5d-f4c14fd188fe response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
13352024-10-30T14:16:29.619ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13362024-10-30T14:16:29.619ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 036a00d3-1b62-4bb7-8512-8a6cf898e068 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13372024-10-30T14:16:29.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13382024-10-30T14:16:29.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 zone_address = fd00:1122:3344:101::2
13392024-10-30T14:16:29.619ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13402024-10-30T14:16:29.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13412024-10-30T14:16:29.619ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a72e7bd-9c7e-42f1-9f3b-a7fe8260e9d3", "content-length": "26", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
13422024-10-30T14:16:29.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13432024-10-30T14:16:29.619ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13442024-10-30T14:16:29.619ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13452024-10-30T14:16:29.619ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 190.549793ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13462024-10-30T14:16:29.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
13472024-10-30T14:16:29.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13482024-10-30T14:16:29.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13492024-10-30T14:16:29.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13502024-10-30T14:16:29.627ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13512024-10-30T14:16:29.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13522024-10-30T14:16:29.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13532024-10-30T14:16:29.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13542024-10-30T14:16:29.632ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13552024-10-30T14:16:29.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13562024-10-30T14:16:29.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13572024-10-30T14:16:29.634ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.88974ms iteration = 12 status = {"physical_disks_added":0}
13582024-10-30T14:16:29.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13592024-10-30T14:16:29.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13602024-10-30T14:16:29.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13612024-10-30T14:16:29.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13622024-10-30T14:16:29.673ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13632024-10-30T14:16:29.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 243.830872ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13642024-10-30T14:16:29.709ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13652024-10-30T14:16:29.710ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0687d2e4-7afc-479f-bc5f-b639bf463b94", "content-length": "1", "date": "Wed, 30 Oct 2024 14:16:28 GMT"} })
13662024-10-30T14:16:29.711ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13672024-10-30T14:16:29.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13682024-10-30T14:16:29.732ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13692024-10-30T14:16:29.735ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.606166ms iteration = 9 status = {}
13702024-10-30T14:16:29.743ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13712024-10-30T14:16:29.744ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "01a7cc54-ce60-4882-91ad-05f411e0fd97", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13722024-10-30T14:16:29.744ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13732024-10-30T14:16:29.745ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "85e2d5ad-579a-485c-9520-fee61ef80f6e", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13742024-10-30T14:16:29.745ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13752024-10-30T14:16:29.747ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13762024-10-30T14:16:29.747ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 319.056228ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13772024-10-30T14:16:29.761ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13782024-10-30T14:16:29.761ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13792024-10-30T14:16:29.761ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec822863-2d67-45e8-9798-ea0489a5daf0", "content-length": "372", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
13802024-10-30T14:16:29.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13812024-10-30T14:16:29.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13822024-10-30T14:16:29.764ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 036a00d3-1b62-4bb7-8512-8a6cf898e068 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13832024-10-30T14:16:29.764ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13842024-10-30T14:16:29.764ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-30 14:12:58.822178 UTC dns_group = internal generation = 1
13852024-10-30T14:16:29.764ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 336.161043ms iteration = 6 status = {"generation":1}
13862024-10-30T14:16:29.764ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 336.511373ms iteration = 9 status = null
13872024-10-30T14:16:29.802ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
13882024-10-30T14:16:29.803ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "68749f33-8a9e-4e71-8e1a-75ef40cd4971", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13892024-10-30T14:16:29.803ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13902024-10-30T14:16:29.804ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "456dbc46-7a82-4b6c-87c6-e3506492d2ae", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13912024-10-30T14:16:29.804ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13922024-10-30T14:16:29.806ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0cbea543-a2a7-435d-9091-cdbf115e7b1d", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13932024-10-30T14:16:29.806ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
13942024-10-30T14:16:29.807ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
13952024-10-30T14:16:29.807ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13962024-10-30T14:16:29.807ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1465c548-bfd7-47b9-9e67-22dfa1e5252a", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
13972024-10-30T14:16:29.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13982024-10-30T14:16:29.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13992024-10-30T14:16:29.808ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
14002024-10-30T14:16:29.808ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 380.281244ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
14012024-10-30T14:16:29.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14022024-10-30T14:16:29.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14032024-10-30T14:16:29.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14042024-10-30T14:16:29.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14052024-10-30T14:16:29.817ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14062024-10-30T14:16:29.817ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14072024-10-30T14:16:29.817ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "348c5304-ee2c-4ade-bb5e-1abdb7972d5d", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
14082024-10-30T14:16:29.819ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 388.941209ms iteration = 10 status = {}
14092024-10-30T14:16:29.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14102024-10-30T14:16:29.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14112024-10-30T14:16:29.878ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14122024-10-30T14:16:29.878ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8527d6b-9ea1-4d00-a8fc-c2ea39904bd4", "content-length": "691", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
14132024-10-30T14:16:29.879ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
14142024-10-30T14:16:29.879ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
14152024-10-30T14:16:29.879ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
14162024-10-30T14:16:29.880ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 452.21988ms iteration = 9 status = {}
14172024-10-30T14:16:29.881ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9704a443-267a-4c29-90f6-c5d616116fea, rack_id: 1e7155fc-ddca-45d5-a711-7b3b989aed61, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(498615ba-af90-4d49-8ca5-0cf4d1a30c69) } rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
14182024-10-30T14:16:29.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14192024-10-30T14:16:29.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14202024-10-30T14:16:29.893ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
14212024-10-30T14:16:29.894ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "982e0f77-6735-48c0-a071-1e131340e41e", "content-length": "121", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
14222024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
14232024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 498615ba-af90-4d49-8ca5-0cf4d1a30c69
14242024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
14252024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
14262024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14272024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14282024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14292024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14302024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
14312024-10-30T14:16:29.894ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
14322024-10-30T14:16:29.895ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
14332024-10-30T14:16:29.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14342024-10-30T14:16:29.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14352024-10-30T14:16:29.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14362024-10-30T14:16:29.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "20c6f44c-e322-4165-8c1b-c300e0fe0122", "content-length": "2", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
14372024-10-30T14:16:29.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14382024-10-30T14:16:29.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2df4452-154e-4989-a47a-e3d21e633ba6", "content-length": "52", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
14392024-10-30T14:16:29.897ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
14402024-10-30T14:16:29.897ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14412024-10-30T14:16:29.997ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f24e2698-3e14-4789-ab76-c6c9fc6218af", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
14422024-10-30T14:16:29.997ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch = Switch0
14432024-10-30T14:16:29.997ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14442024-10-30T14:16:29.997ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc33d3cb-c0c8-4a1b-9d05-d5dbd2381170", "content-length": "669", "date": "Wed, 30 Oct 2024 14:16:29 GMT"} })
14452024-10-30T14:16:29.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14462024-10-30T14:16:29.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14472024-10-30T14:16:30.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14482024-10-30T14:16:30.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14492024-10-30T14:16:30.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14502024-10-30T14:16:30.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14512024-10-30T14:16:30.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14522024-10-30T14:16:30.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14532024-10-30T14:16:30.015ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 586.982946ms iteration = 9 status = {}
14542024-10-30T14:16:30.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = d4563b3f-0e6f-4f56-a382-9a53deed10fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14552024-10-30T14:16:30.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = d4563b3f-0e6f-4f56-a382-9a53deed10fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14562024-10-30T14:16:30.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = d4563b3f-0e6f-4f56-a382-9a53deed10fa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14572024-10-30T14:16:30.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 434df040-b650-4915-bfd8-ed1268901989 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14582024-10-30T14:16:30.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 434df040-b650-4915-bfd8-ed1268901989 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14592024-10-30T14:16:30.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 434df040-b650-4915-bfd8-ed1268901989 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14602024-10-30T14:16:31.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e1822c04-0d81-4462-9697-ea137bba8f9a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14612024-10-30T14:16:31.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e1822c04-0d81-4462-9697-ea137bba8f9a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14622024-10-30T14:16:31.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e1822c04-0d81-4462-9697-ea137bba8f9a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14632024-10-30T14:16:32.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3d7d065c-d930-4f89-8fd1-89b4c343ba9c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14642024-10-30T14:16:32.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3d7d065c-d930-4f89-8fd1-89b4c343ba9c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14652024-10-30T14:16:32.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3d7d065c-d930-4f89-8fd1-89b4c343ba9c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14662024-10-30T14:16:33.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1fd4fe2a-e455-4580-ae66-7f7f43d7db1b roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14672024-10-30T14:16:33.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1fd4fe2a-e455-4580-ae66-7f7f43d7db1b resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14682024-10-30T14:16:33.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1fd4fe2a-e455-4580-ae66-7f7f43d7db1b response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14692024-10-30T14:16:34.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d37ba095-cba9-4752-8899-87f1e0f200b9 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14702024-10-30T14:16:34.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d37ba095-cba9-4752-8899-87f1e0f200b9 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14712024-10-30T14:16:34.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d37ba095-cba9-4752-8899-87f1e0f200b9 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14722024-10-30T14:16:35.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2ae4f311-a456-4433-a3e8-80c35b569aad roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14732024-10-30T14:16:35.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2ae4f311-a456-4433-a3e8-80c35b569aad resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14742024-10-30T14:16:35.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2ae4f311-a456-4433-a3e8-80c35b569aad response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14752024-10-30T14:16:36.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2de10a5c-e117-4d9f-a688-76e95e3c0a6d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14762024-10-30T14:16:36.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2de10a5c-e117-4d9f-a688-76e95e3c0a6d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14772024-10-30T14:16:36.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2de10a5c-e117-4d9f-a688-76e95e3c0a6d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14782024-10-30T14:16:37.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ca37842f-14d0-4787-b57d-b4ba4702f70c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14792024-10-30T14:16:37.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ca37842f-14d0-4787-b57d-b4ba4702f70c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14802024-10-30T14:16:37.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ca37842f-14d0-4787-b57d-b4ba4702f70c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14812024-10-30T14:16:38.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1394 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 2be68679-2380-41e5-8061-637a5c2353f3 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
14822024-10-30T14:16:38.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 59ada023-0376-423e-8992-198176988c42 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14832024-10-30T14:16:38.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 59ada023-0376-423e-8992-198176988c42 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14842024-10-30T14:16:38.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 59ada023-0376-423e-8992-198176988c42 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
14852024-10-30T14:16:39.428ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
14862024-10-30T14:16:39.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14872024-10-30T14:16:39.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14882024-10-30T14:16:39.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
14892024-10-30T14:16:39.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14902024-10-30T14:16:39.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14912024-10-30T14:16:39.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922024-10-30T14:16:39.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14932024-10-30T14:16:39.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14942024-10-30T14:16:39.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14952024-10-30T14:16:39.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14962024-10-30T14:16:39.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14972024-10-30T14:16:39.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14982024-10-30T14:16:39.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
14992024-10-30T14:16:39.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15002024-10-30T14:16:39.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15012024-10-30T14:16:39.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
15022024-10-30T14:16:39.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.676995ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
15032024-10-30T14:16:39.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15042024-10-30T14:16:39.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15052024-10-30T14:16:39.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.632666ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15062024-10-30T14:16:39.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a4f43686-8173-44e4-9778-841e56d28662 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15072024-10-30T14:16:39.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a4f43686-8173-44e4-9778-841e56d28662 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15082024-10-30T14:16:39.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a4f43686-8173-44e4-9778-841e56d28662 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15092024-10-30T14:16:40.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 88015207-496f-480b-ab7d-33cb1180dc4d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15102024-10-30T14:16:40.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 88015207-496f-480b-ab7d-33cb1180dc4d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15112024-10-30T14:16:40.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 88015207-496f-480b-ab7d-33cb1180dc4d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15122024-10-30T14:16:41.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 92cfd5dd-910e-45a0-9597-76bdfe1aa81e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15132024-10-30T14:16:41.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 92cfd5dd-910e-45a0-9597-76bdfe1aa81e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15142024-10-30T14:16:41.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 92cfd5dd-910e-45a0-9597-76bdfe1aa81e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15152024-10-30T14:16:42.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 098f9d9b-c1ef-485d-80c2-f2aabcec7568 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15162024-10-30T14:16:42.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 098f9d9b-c1ef-485d-80c2-f2aabcec7568 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15172024-10-30T14:16:42.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 098f9d9b-c1ef-485d-80c2-f2aabcec7568 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15182024-10-30T14:16:43.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 38e731c3-945e-415f-b051-9c046c0b688d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15192024-10-30T14:16:43.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 38e731c3-945e-415f-b051-9c046c0b688d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15202024-10-30T14:16:43.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 38e731c3-945e-415f-b051-9c046c0b688d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15212024-10-30T14:16:44.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ce7d6640-aecd-4a63-bf06-816f17c65732 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15222024-10-30T14:16:44.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ce7d6640-aecd-4a63-bf06-816f17c65732 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15232024-10-30T14:16:44.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ce7d6640-aecd-4a63-bf06-816f17c65732 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15242024-10-30T14:16:45.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3608d6ef-9018-4208-9619-d1463b05bf55 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15252024-10-30T14:16:45.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3608d6ef-9018-4208-9619-d1463b05bf55 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15262024-10-30T14:16:45.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3608d6ef-9018-4208-9619-d1463b05bf55 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15272024-10-30T14:16:46.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2a8e169-c372-4362-b8e0-77998717540f roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15282024-10-30T14:16:46.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2a8e169-c372-4362-b8e0-77998717540f resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15292024-10-30T14:16:46.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f2a8e169-c372-4362-b8e0-77998717540f response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15302024-10-30T14:16:48.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = dde8a5e2-9f14-4102-bd85-528d39b42208 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15312024-10-30T14:16:48.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = dde8a5e2-9f14-4102-bd85-528d39b42208 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15322024-10-30T14:16:48.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = dde8a5e2-9f14-4102-bd85-528d39b42208 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15332024-10-30T14:16:49.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3927bb38-14ff-4d65-992d-3d0fb295dbe8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15342024-10-30T14:16:49.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3927bb38-14ff-4d65-992d-3d0fb295dbe8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15352024-10-30T14:16:49.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3927bb38-14ff-4d65-992d-3d0fb295dbe8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15362024-10-30T14:16:49.427ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
15372024-10-30T14:16:49.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15382024-10-30T14:16:49.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15392024-10-30T14:16:49.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
15402024-10-30T14:16:49.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15412024-10-30T14:16:49.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15422024-10-30T14:16:49.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15432024-10-30T14:16:49.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15442024-10-30T14:16:49.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15452024-10-30T14:16:49.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15462024-10-30T14:16:49.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15472024-10-30T14:16:49.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15482024-10-30T14:16:49.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15492024-10-30T14:16:49.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15502024-10-30T14:16:49.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15512024-10-30T14:16:49.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
15522024-10-30T14:16:49.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15532024-10-30T14:16:49.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15542024-10-30T14:16:49.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.461455ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15552024-10-30T14:16:49.575ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
15562024-10-30T14:16:49.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 148.433368ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
15572024-10-30T14:16:50.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 41029d6c-5dd1-4aec-b12b-a899dca5dbf1 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15582024-10-30T14:16:50.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 41029d6c-5dd1-4aec-b12b-a899dca5dbf1 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15592024-10-30T14:16:50.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 41029d6c-5dd1-4aec-b12b-a899dca5dbf1 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15602024-10-30T14:16:50.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 08fa2550-16f1-44f8-bf4e-6b5594954fb9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
15612024-10-30T14:16:50.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 08fa2550-16f1-44f8-bf4e-6b5594954fb9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
15622024-10-30T14:16:50.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 08fa2550-16f1-44f8-bf4e-6b5594954fb9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
15632024-10-30T14:16:50.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = c22e5d7a-ae28-43ad-915b-2854da16c883 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
15642024-10-30T14:16:50.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = c22e5d7a-ae28-43ad-915b-2854da16c883 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
15652024-10-30T14:16:50.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = c22e5d7a-ae28-43ad-915b-2854da16c883 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
15662024-10-30T14:16:51.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7d04a831-3aea-409d-af0e-208265ede11e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15672024-10-30T14:16:51.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7d04a831-3aea-409d-af0e-208265ede11e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15682024-10-30T14:16:51.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7d04a831-3aea-409d-af0e-208265ede11e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15692024-10-30T14:16:52.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 41bc2768-3bef-40b9-b0f2-6d05b44b7149 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15702024-10-30T14:16:52.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 41bc2768-3bef-40b9-b0f2-6d05b44b7149 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15712024-10-30T14:16:52.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 41bc2768-3bef-40b9-b0f2-6d05b44b7149 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15722024-10-30T14:16:53.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b3498c23-7bf2-4163-8999-ad1ccd1cf0a7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15732024-10-30T14:16:53.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b3498c23-7bf2-4163-8999-ad1ccd1cf0a7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15742024-10-30T14:16:53.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b3498c23-7bf2-4163-8999-ad1ccd1cf0a7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15752024-10-30T14:16:53.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1346 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = e770308d-6e21-4250-83af-87c6c9de14b6 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
15762024-10-30T14:16:54.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d4cbd94d-f54b-485c-9d52-b81f4b293b2e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15772024-10-30T14:16:54.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d4cbd94d-f54b-485c-9d52-b81f4b293b2e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15782024-10-30T14:16:54.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d4cbd94d-f54b-485c-9d52-b81f4b293b2e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15792024-10-30T14:16:55.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 17a6d36f-edc3-46a8-8e6e-4c86832320ea roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15802024-10-30T14:16:55.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 17a6d36f-edc3-46a8-8e6e-4c86832320ea resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15812024-10-30T14:16:55.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 17a6d36f-edc3-46a8-8e6e-4c86832320ea response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15822024-10-30T14:16:56.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5cbfe8de-f2db-4341-936b-3cc53edbe6f1 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15832024-10-30T14:16:56.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5cbfe8de-f2db-4341-936b-3cc53edbe6f1 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15842024-10-30T14:16:56.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5cbfe8de-f2db-4341-936b-3cc53edbe6f1 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15852024-10-30T14:16:57.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = aa9b60c1-d62d-4075-935b-1661bc87da8d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15862024-10-30T14:16:57.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = aa9b60c1-d62d-4075-935b-1661bc87da8d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15872024-10-30T14:16:57.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = aa9b60c1-d62d-4075-935b-1661bc87da8d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
15882024-10-30T14:16:57.662ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bb156ffb-ae6f-490b-85c5-5ced79794b74 uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-10-30T14:16:57.662101532Z }
15892024-10-30T14:16:57.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bb156ffb-ae6f-490b-85c5-5ced79794b74 roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
15902024-10-30T14:16:57.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bb156ffb-ae6f-490b-85c5-5ced79794b74 resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
15912024-10-30T14:16:57.696ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:42639
15922024-10-30T14:16:57.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:42639 req_id = 6482588f-a2e3-4a3a-adca-7c379ab1d53d roles = RoleSet { roles: {} } uri = /metrics/producers
15932024-10-30T14:16:57.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:42639 req_id = 6482588f-a2e3-4a3a-adca-7c379ab1d53d resource = Database result = Ok(()) uri = /metrics/producers
15942024-10-30T14:16:57.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51320 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bb156ffb-ae6f-490b-85c5-5ced79794b74 response_code = 204 uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
15952024-10-30T14:16:57.714ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 remote_addr = [fd00:1122:3344:101::1]:33537 req_id = abe8d3bb-94b4-4407-b25d-63eabe97329f uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-30T14:16:57.714054036Z }
15962024-10-30T14:16:57.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = abe8d3bb-94b4-4407-b25d-63eabe97329f roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
15972024-10-30T14:16:57.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = abe8d3bb-94b4-4407-b25d-63eabe97329f resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
15982024-10-30T14:16:57.735ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f
15992024-10-30T14:16:57.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39769 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:42639 req_id = 6482588f-a2e3-4a3a-adca-7c379ab1d53d response_code = 201 uri = /metrics/producers
16002024-10-30T14:16:57.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60342 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = abe8d3bb-94b4-4407-b25d-63eabe97329f response_code = 204 uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
16012024-10-30T14:16:58.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3f46b45d-f0b8-44fd-b21a-1bbade0fd14c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
16022024-10-30T14:16:58.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3f46b45d-f0b8-44fd-b21a-1bbade0fd14c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
16032024-10-30T14:16:58.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3f46b45d-f0b8-44fd-b21a-1bbade0fd14c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
16042024-10-30T14:16:58.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = e167eef8-3ebf-4f28-90e8-eea97269dd5c roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
16052024-10-30T14:16:58.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = e167eef8-3ebf-4f28-90e8-eea97269dd5c resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
16062024-10-30T14:16:58.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = e167eef8-3ebf-4f28-90e8-eea97269dd5c response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
16072024-10-30T14:16:58.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = d8b08891-bfb1-41cd-ab56-55f0f0cc4d97 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
16082024-10-30T14:16:58.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = d8b08891-bfb1-41cd-ab56-55f0f0cc4d97 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
16092024-10-30T14:16:58.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = d8b08891-bfb1-41cd-ab56-55f0f0cc4d97 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
16102024-10-30T14:16:59.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 766d6b4c-e648-45b2-94d5-f535570a998c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
16112024-10-30T14:16:59.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 766d6b4c-e648-45b2-94d5-f535570a998c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
16122024-10-30T14:16:59.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2525 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 766d6b4c-e648-45b2-94d5-f535570a998c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
16132024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
16142024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
16152024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16162024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16172024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
16182024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16192024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
16202024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
16212024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16222024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16232024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
16242024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
16252024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16262024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16272024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16282024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16292024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16302024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16312024-10-30T14:16:59.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16322024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
16332024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
16342024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16352024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16362024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
16372024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16382024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
16392024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16402024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
16412024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16422024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16432024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16442024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16452024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16462024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16472024-10-30T14:16:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16482024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
16492024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
16502024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.441\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
16512024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.571\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
16522024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
16532024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
16542024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
16552024-10-30T14:16:59.430ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16562024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.78\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16572024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16582024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.47\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16592024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16602024-10-30T14:16:59.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16612024-10-30T14:16:59.431ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16622024-10-30T14:16:59.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16632024-10-30T14:16:59.432ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33380, tv_nsec: 612538375 } })
16642024-10-30T14:16:59.432ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33380, tv_nsec: 612720770 } })
16652024-10-30T14:16:59.432ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
16662024-10-30T14:16:59.433ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
16672024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16682024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16692024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16702024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16712024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16722024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16732024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16742024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16752024-10-30T14:16:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16762024-10-30T14:16:59.436ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16772024-10-30T14:16:59.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16782024-10-30T14:16:59.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16792024-10-30T14:16:59.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16802024-10-30T14:16:59.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16812024-10-30T14:16:59.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16822024-10-30T14:16:59.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33380, tv_nsec: 620502811 } })
16832024-10-30T14:16:59.440ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
16842024-10-30T14:16:59.441ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16852024-10-30T14:16:59.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.448909ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16862024-10-30T14:16:59.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16872024-10-30T14:16:59.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16882024-10-30T14:16:59.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16892024-10-30T14:16:59.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16902024-10-30T14:16:59.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16912024-10-30T14:16:59.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16922024-10-30T14:16:59.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16932024-10-30T14:16:59.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16942024-10-30T14:16:59.473ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16952024-10-30T14:16:59.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16962024-10-30T14:16:59.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16972024-10-30T14:16:59.477ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16982024-10-30T14:16:59.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16992024-10-30T14:16:59.480ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17002024-10-30T14:16:59.482ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17012024-10-30T14:16:59.482ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17022024-10-30T14:16:59.482ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17032024-10-30T14:16:59.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17042024-10-30T14:16:59.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
17052024-10-30T14:16:59.483ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17062024-10-30T14:16:59.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17072024-10-30T14:16:59.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17082024-10-30T14:16:59.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17092024-10-30T14:16:59.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17102024-10-30T14:16:59.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17112024-10-30T14:16:59.493ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
17122024-10-30T14:16:59.493ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.031829ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
17132024-10-30T14:16:59.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17142024-10-30T14:16:59.513ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17152024-10-30T14:16:59.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17162024-10-30T14:16:59.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17172024-10-30T14:16:59.517ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17182024-10-30T14:16:59.517ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17192024-10-30T14:16:59.517ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17202024-10-30T14:16:59.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17212024-10-30T14:16:59.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.988713ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17222024-10-30T14:16:59.537ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 109.789777ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17232024-10-30T14:16:59.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17242024-10-30T14:16:59.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17252024-10-30T14:16:59.553ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 125.295378ms iteration = 13 status = {"physical_disks_added":0}
17262024-10-30T14:16:59.559ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
17272024-10-30T14:16:59.559ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17282024-10-30T14:16:59.559ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1987702-75bc-4521-b561-def1ebf45b00", "content-length": "26", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
17292024-10-30T14:16:59.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17302024-10-30T14:16:59.561ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17312024-10-30T14:16:59.609ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/00af02f0-a728-46fd-a799-2482036b2b50/state
17322024-10-30T14:16:59.609ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/00af02f0-a728-46fd-a799-2482036b2b50/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a68e1f6-8abd-42c1-bca1-c5e6a749af86", "content-length": "130", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
17332024-10-30T14:16:59.609ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f sled_id = 963ac472-284b-4429-931a-df4a09f45485 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-30T14:16:57.714054036Z }, migration_in: None, migration_out: None } vmm_id = 00af02f0-a728-46fd-a799-2482036b2b50
17342024-10-30T14:16:59.609ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 sled_id = 963ac472-284b-4429-931a-df4a09f45485 vmm_id = 00af02f0-a728-46fd-a799-2482036b2b50 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-30T14:16:57.714054036Z }
17352024-10-30T14:16:59.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f roles = RoleSet { roles: {} } sled_id = 963ac472-284b-4429-931a-df4a09f45485 vmm_id = 00af02f0-a728-46fd-a799-2482036b2b50
17362024-10-30T14:16:59.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f resource = Database result = Ok(()) sled_id = 963ac472-284b-4429-931a-df4a09f45485 vmm_id = 00af02f0-a728-46fd-a799-2482036b2b50
17372024-10-30T14:16:59.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17382024-10-30T14:16:59.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17392024-10-30T14:16:59.633ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
17402024-10-30T14:16:59.633ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17412024-10-30T14:16:59.633ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "266cf0c9-debf-476d-a3bb-a49be07aea87", "content-length": "26", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
17422024-10-30T14:16:59.633ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17432024-10-30T14:16:59.635ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17442024-10-30T14:16:59.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17452024-10-30T14:16:59.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17462024-10-30T14:16:59.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17472024-10-30T14:16:59.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17482024-10-30T14:16:59.646ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17492024-10-30T14:16:59.646ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17502024-10-30T14:16:59.646ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 216.92182ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17512024-10-30T14:16:59.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17522024-10-30T14:16:59.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 963ac472-284b-4429-931a-df4a09f45485, lookup_type: ById(963ac472-284b-4429-931a-df4a09f45485) } result = Ok(())
17532024-10-30T14:16:59.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17542024-10-30T14:16:59.650ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
17552024-10-30T14:16:59.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17562024-10-30T14:16:59.651ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 222.690077ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
17572024-10-30T14:16:59.652ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 224.768523ms iteration = 10 status = 0
17582024-10-30T14:16:59.653ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 zone_address = fd00:1122:3344:101::2
17592024-10-30T14:16:59.653ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17602024-10-30T14:16:59.653ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73d94d89-2e0a-4ec4-9486-0dad8f166497", "content-length": "26", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
17612024-10-30T14:16:59.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17622024-10-30T14:16:59.654ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
17632024-10-30T14:16:59.663ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 235.629138ms iteration = 10 status = {}
17642024-10-30T14:16:59.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17652024-10-30T14:16:59.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17662024-10-30T14:16:59.709ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17672024-10-30T14:16:59.710ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b62129ec-73ea-4f45-91d3-d213f6317ed8", "content-length": "1", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
17682024-10-30T14:16:59.711ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17692024-10-30T14:16:59.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17702024-10-30T14:16:59.713ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 285.431534ms iteration = 10 status = null
17712024-10-30T14:16:59.740ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17722024-10-30T14:16:59.740ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17732024-10-30T14:16:59.741ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f8344e7-cb7c-41e0-a166-9f1fa6387959", "content-length": "585", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
17742024-10-30T14:16:59.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17752024-10-30T14:16:59.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17762024-10-30T14:16:59.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17772024-10-30T14:16:59.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17782024-10-30T14:16:59.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17792024-10-30T14:16:59.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17802024-10-30T14:16:59.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17812024-10-30T14:16:59.785ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17822024-10-30T14:16:59.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17832024-10-30T14:16:59.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17842024-10-30T14:16:59.792ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {19a54f77-1816-4356-928d-0cfe703f774e: {10.151.1.176: {b86ca62a-0fe7-483b-9883-7d0170f852df}, 10.151.1.175: {b86ca62a-0fe7-483b-9883-7d0170f852df}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
17852024-10-30T14:16:59.792ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17862024-10-30T14:16:59.793ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5336b2bb-e071-4b74-b30f-df73776aaeaa", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
17872024-10-30T14:16:59.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17882024-10-30T14:16:59.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17892024-10-30T14:16:59.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17902024-10-30T14:16:59.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17912024-10-30T14:16:59.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17922024-10-30T14:16:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17932024-10-30T14:16:59.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17942024-10-30T14:16:59.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17952024-10-30T14:16:59.800ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9704a443-267a-4c29-90f6-c5d616116fea, rack_id: 1e7155fc-ddca-45d5-a711-7b3b989aed61, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(498615ba-af90-4d49-8ca5-0cf4d1a30c69) } rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
17962024-10-30T14:16:59.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17972024-10-30T14:16:59.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17982024-10-30T14:16:59.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17992024-10-30T14:16:59.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18002024-10-30T14:16:59.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18012024-10-30T14:16:59.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18022024-10-30T14:16:59.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18032024-10-30T14:16:59.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18042024-10-30T14:16:59.810ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18052024-10-30T14:16:59.810ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18062024-10-30T14:16:59.810ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18072024-10-30T14:16:59.811ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5a3ccfd8-3315-406a-9bb5-1b67cd5c161f", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
18082024-10-30T14:16:59.812ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 382.223806ms iteration = 11 status = {}
18092024-10-30T14:16:59.814ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18102024-10-30T14:16:59.814ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccb5e8c4-9897-43b8-a628-b33a95bfffe1", "content-length": "121", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
18112024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
18122024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 498615ba-af90-4d49-8ca5-0cf4d1a30c69
18132024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18142024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18152024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18162024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18172024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18182024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18192024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18202024-10-30T14:16:59.814ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18212024-10-30T14:16:59.815ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
18222024-10-30T14:16:59.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18232024-10-30T14:16:59.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18242024-10-30T14:16:59.816ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18252024-10-30T14:16:59.816ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6825118-f670-48d4-b743-dea18bd18a34", "content-length": "2", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
18262024-10-30T14:16:59.816ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18272024-10-30T14:16:59.816ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ebc7fc0-f978-4503-8961-6b88672cc509", "content-length": "52", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
18282024-10-30T14:16:59.816ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
18292024-10-30T14:16:59.816ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18302024-10-30T14:16:59.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18312024-10-30T14:16:59.916ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bccb5436-6233-4190-956e-1400f500f724", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
18322024-10-30T14:16:59.916ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch = Switch0
18332024-10-30T14:16:59.916ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18342024-10-30T14:16:59.917ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f72a6812-907b-4e37-8d42-169eb16a194f", "content-length": "669", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
18352024-10-30T14:16:59.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18362024-10-30T14:16:59.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18372024-10-30T14:16:59.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18382024-10-30T14:16:59.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18392024-10-30T14:16:59.921ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "faebcc05-c161-4561-8dca-8fbb7caa9ac5", "content-length": "811", "date": "Wed, 30 Oct 2024 14:16:59 GMT"} })
18402024-10-30T14:16:59.921ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(13246480) }} sled = buskin
18412024-10-30T14:16:59.921ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
18422024-10-30T14:16:59.921ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
18432024-10-30T14:16:59.922ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.231926ms iteration = 10 status = {}
18442024-10-30T14:16:59.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18452024-10-30T14:16:59.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18462024-10-30T14:16:59.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18472024-10-30T14:16:59.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18482024-10-30T14:16:59.934ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 505.976572ms iteration = 10 status = {}
18492024-10-30T14:17:00.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 22d66244-4936-479e-84f5-8e9208784db1 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18502024-10-30T14:17:00.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 22d66244-4936-479e-84f5-8e9208784db1 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18512024-10-30T14:17:00.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 22d66244-4936-479e-84f5-8e9208784db1 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18522024-10-30T14:17:01.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 86351f2b-1ed6-4d5e-9d74-8df7d73b2401 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18532024-10-30T14:17:01.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 86351f2b-1ed6-4d5e-9d74-8df7d73b2401 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18542024-10-30T14:17:01.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 86351f2b-1ed6-4d5e-9d74-8df7d73b2401 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18552024-10-30T14:17:02.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4d690507-f982-476c-9c8a-5691b8e9d125 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18562024-10-30T14:17:02.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4d690507-f982-476c-9c8a-5691b8e9d125 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18572024-10-30T14:17:02.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4d690507-f982-476c-9c8a-5691b8e9d125 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18582024-10-30T14:17:03.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f8d5a34b-54b4-4cdd-be38-9af1fe1f6f1c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18592024-10-30T14:17:03.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f8d5a34b-54b4-4cdd-be38-9af1fe1f6f1c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18602024-10-30T14:17:03.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f8d5a34b-54b4-4cdd-be38-9af1fe1f6f1c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18612024-10-30T14:17:04.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b5c3b25-ca5c-4310-bda7-19149a63aff7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18622024-10-30T14:17:04.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b5c3b25-ca5c-4310-bda7-19149a63aff7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18632024-10-30T14:17:04.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b5c3b25-ca5c-4310-bda7-19149a63aff7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18642024-10-30T14:17:05.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 60c169d2-176e-4404-ac04-9ea1a455ea61 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18652024-10-30T14:17:05.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 60c169d2-176e-4404-ac04-9ea1a455ea61 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18662024-10-30T14:17:05.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 60c169d2-176e-4404-ac04-9ea1a455ea61 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18672024-10-30T14:17:06.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2f4237c2-fd00-4d9b-b70e-92da9953db57 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18682024-10-30T14:17:06.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2f4237c2-fd00-4d9b-b70e-92da9953db57 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18692024-10-30T14:17:06.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2f4237c2-fd00-4d9b-b70e-92da9953db57 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18702024-10-30T14:17:07.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9ccecd47-1850-4e3c-9d9b-1c97a2c35fc8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18712024-10-30T14:17:07.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9ccecd47-1850-4e3c-9d9b-1c97a2c35fc8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18722024-10-30T14:17:07.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9ccecd47-1850-4e3c-9d9b-1c97a2c35fc8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18732024-10-30T14:17:07.793ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3da6166c-4d78-4870-b0f2-73323513a3c9 uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-10-30T14:17:07.792858889Z }
18742024-10-30T14:17:07.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3da6166c-4d78-4870-b0f2-73323513a3c9 roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
18752024-10-30T14:17:07.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3da6166c-4d78-4870-b0f2-73323513a3c9 resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
18762024-10-30T14:17:07.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54147 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3da6166c-4d78-4870-b0f2-73323513a3c9 response_code = 204 uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
18772024-10-30T14:17:08.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 6692335c-df87-41c3-b761-5a355b8679fc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
18782024-10-30T14:17:08.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 6692335c-df87-41c3-b761-5a355b8679fc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
18792024-10-30T14:17:08.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 6692335c-df87-41c3-b761-5a355b8679fc response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
18802024-10-30T14:17:08.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 7d913288-5995-46ad-b912-553f61c263f9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
18812024-10-30T14:17:08.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 7d913288-5995-46ad-b912-553f61c263f9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
18822024-10-30T14:17:08.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 7d913288-5995-46ad-b912-553f61c263f9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
18832024-10-30T14:17:08.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 525de205-7099-4b19-9282-56983e036425 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18842024-10-30T14:17:08.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 525de205-7099-4b19-9282-56983e036425 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18852024-10-30T14:17:08.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 525de205-7099-4b19-9282-56983e036425 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
18862024-10-30T14:17:08.490ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3723 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 094669c9-a9d2-4b68-830d-4f3240551061 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
18872024-10-30T14:17:09.428ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
18882024-10-30T14:17:09.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18892024-10-30T14:17:09.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18902024-10-30T14:17:09.428ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
18912024-10-30T14:17:09.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18922024-10-30T14:17:09.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18932024-10-30T14:17:09.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18942024-10-30T14:17:09.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18952024-10-30T14:17:09.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18962024-10-30T14:17:09.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18972024-10-30T14:17:09.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18982024-10-30T14:17:09.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18992024-10-30T14:17:09.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19002024-10-30T14:17:09.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
19012024-10-30T14:17:09.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19022024-10-30T14:17:09.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19032024-10-30T14:17:09.447ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
19042024-10-30T14:17:09.447ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.615024ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
19052024-10-30T14:17:09.459ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19062024-10-30T14:17:09.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19072024-10-30T14:17:09.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.996918ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19082024-10-30T14:17:09.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1e43a55c-6868-4cf8-bc63-edb78b8b36aa roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
19092024-10-30T14:17:09.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1e43a55c-6868-4cf8-bc63-edb78b8b36aa resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
19102024-10-30T14:17:09.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1e43a55c-6868-4cf8-bc63-edb78b8b36aa response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
19112024-10-30T14:17:10.272ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-30T14:17:10.271863951Z }
19122024-10-30T14:17:10.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19132024-10-30T14:17:10.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19142024-10-30T14:17:10.312ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50 vmm_needs_update = true
19152024-10-30T14:17:10.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19162024-10-30T14:17:10.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19172024-10-30T14:17:10.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19182024-10-30T14:17:10.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19192024-10-30T14:17:10.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19202024-10-30T14:17:10.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19212024-10-30T14:17:10.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19222024-10-30T14:17:10.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19232024-10-30T14:17:10.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19242024-10-30T14:17:10.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19252024-10-30T14:17:10.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19262024-10-30T14:17:10.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19272024-10-30T14:17:10.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19282024-10-30T14:17:10.355ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, lookup_type: ById(22dad6d2-ee23-4f02-97b3-ce34a7d929db) }, key: 12d88248-8c11-439c-a75f-0864ab2ea45f, lookup_type: ById(12d88248-8c11-439c-a75f-0864ab2ea45f) }, key: 20bfe61f-21a1-45db-aa03-6fa40736aa8f, lookup_type: ById(20bfe61f-21a1-45db-aa03-6fa40736aa8f) } result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19292024-10-30T14:17:10.355ZINFOnexus (dropshot_internal): starting update saga for 20bfe61f-21a1-45db-aa03-6fa40736aa8f actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-30T14:17:10.271863951Z }
19302024-10-30T14:17:10.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83341 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce response_code = 204 uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19312024-10-30T14:17:10.355ZDEBGnexus (dropshot_internal): preparing instance-update saga for 20bfe61f-21a1-45db-aa03-6fa40736aa8f... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 781d7785-eaa5-4d28-a600-d5fa9bdb07ce uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19322024-10-30T14:17:10.355ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update
19332024-10-30T14:17:10.355ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"20bfe61f-21a1-45db-aa03-6fa40736aa8f","lookup_type":{"ById":"20bfe61f-21a1-45db-aa03-6fa40736aa8f"},"parent":{"key":"12d88248-8c11-439c-a75f-0864ab2ea45f","lookup_type":{"ById":"12d88248-8c11-439c-a75f-0864ab2ea45f"},"parent":{"key":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","lookup_type":{"ById":"22dad6d2-ee23-4f02-97b3-ce34a7d929db"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19342024-10-30T14:17:10.355ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update
19352024-10-30T14:17:10.355ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1fdefc4c-9855-49e3-8b22-508e8e19d38f uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-30T14:17:10.271863951Z }
19362024-10-30T14:17:10.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1fdefc4c-9855-49e3-8b22-508e8e19d38f roles = RoleSet { roles: {} } uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19372024-10-30T14:17:10.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1fdefc4c-9855-49e3-8b22-508e8e19d38f resource = Database result = Ok(()) uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19382024-10-30T14:17:10.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27577 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1fdefc4c-9855-49e3-8b22-508e8e19d38f response_code = 204 uri = /vmms/00af02f0-a728-46fd-a799-2482036b2b50
19392024-10-30T14:17:10.385ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update
19402024-10-30T14:17:10.385ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19412024-10-30T14:17:10.385ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19422024-10-30T14:17:10.385ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
19432024-10-30T14:17:10.393ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19442024-10-30T14:17:10.393ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
19452024-10-30T14:17:10.397ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19462024-10-30T14:17:10.397ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
19472024-10-30T14:17:10.401ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19482024-10-30T14:17:10.401ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("1a572152-9ce2-4d12-affc-c33b0ffa9869")) node_id = 0 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
19492024-10-30T14:17:10.406ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19502024-10-30T14:17:10.406ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
19512024-10-30T14:17:10.413ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update
19522024-10-30T14:17:10.413ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19532024-10-30T14:17:10.413ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19542024-10-30T14:17:10.420ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19552024-10-30T14:17:10.420ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19562024-10-30T14:17:10.422ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19572024-10-30T14:17:10.422ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19582024-10-30T14:17:10.423ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19592024-10-30T14:17:10.424ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19602024-10-30T14:17:10.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 3b7e9cd6-e808-4ef9-94b5-30b5a3352a69 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
19612024-10-30T14:17:10.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 3b7e9cd6-e808-4ef9-94b5-30b5a3352a69 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
19622024-10-30T14:17:10.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 3b7e9cd6-e808-4ef9-94b5-30b5a3352a69 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
19632024-10-30T14:17:10.458ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19642024-10-30T14:17:10.458ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19652024-10-30T14:17:10.460ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19662024-10-30T14:17:10.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19672024-10-30T14:17:10.462ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19682024-10-30T14:17:10.465ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, lookup_type: ById(22dad6d2-ee23-4f02-97b3-ce34a7d929db) }, key: 12d88248-8c11-439c-a75f-0864ab2ea45f, lookup_type: ById(12d88248-8c11-439c-a75f-0864ab2ea45f) }, key: 20bfe61f-21a1-45db-aa03-6fa40736aa8f, lookup_type: ById(20bfe61f-21a1-45db-aa03-6fa40736aa8f) } result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19692024-10-30T14:17:10.465ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance updater_id = 1a572152-9ce2-4d12-affc-c33b0ffa9869
19702024-10-30T14:17:10.465ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19712024-10-30T14:17:10.465ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19722024-10-30T14:17:10.480ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance updater_id = 1a572152-9ce2-4d12-affc-c33b0ffa9869
19732024-10-30T14:17:10.480ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19742024-10-30T14:17:10.480ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance
19752024-10-30T14:17:10.485ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f locked_gen = Generation(Generation(2)) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = LockInstance updater_id = 1a572152-9ce2-4d12-affc-c33b0ffa9869
19762024-10-30T14:17:10.485ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19772024-10-30T14:17:10.485ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("1a572152-9ce2-4d12-affc-c33b0ffa9869")}) node_id = 1 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
19782024-10-30T14:17:10.489ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19792024-10-30T14:17:10.489ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
19802024-10-30T14:17:10.495ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19812024-10-30T14:17:10.495ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19822024-10-30T14:17:10.497ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19832024-10-30T14:17:10.497ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19842024-10-30T14:17:10.498ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19852024-10-30T14:17:10.498ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19862024-10-30T14:17:10.499ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19872024-10-30T14:17:10.502ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, lookup_type: ById(22dad6d2-ee23-4f02-97b3-ce34a7d929db) }, key: 12d88248-8c11-439c-a75f-0864ab2ea45f, lookup_type: ById(12d88248-8c11-439c-a75f-0864ab2ea45f) }, key: 20bfe61f-21a1-45db-aa03-6fa40736aa8f, lookup_type: ById(20bfe61f-21a1-45db-aa03-6fa40736aa8f) } result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19882024-10-30T14:17:10.502ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19892024-10-30T14:17:10.503ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19902024-10-30T14:17:10.508ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 00af02f0-a728-46fd-a799-2482036b2b50, time_created: 2024-10-30T14:16:49.452707Z, time_deleted: None, instance_id: 20bfe61f-21a1-45db-aa03-6fa40736aa8f, sled_id: 963ac472-284b-4429-931a-df4a09f45485, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-10-30T14:17:10.271863Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-10-30T14:16:46.225655Z, gen: Generation(Generation(3)), propolis_id: Some(00af02f0-a728-46fd-a799-2482036b2b50), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(00af02f0-a728-46fd-a799-2482036b2b50 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-10-30T14:17:10.508282422Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
19912024-10-30T14:17:10.513ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
19922024-10-30T14:17:10.515ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"20bfe61f-21a1-45db-aa03-6fa40736aa8f","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"00af02f0-a728-46fd-a799-2482036b2b50"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"20bfe61f-21a1-45db-aa03-6fa40736aa8f","lookup_type":{"ById":"20bfe61f-21a1-45db-aa03-6fa40736aa8f"},"parent":{"key":"12d88248-8c11-439c-a75f-0864ab2ea45f","lookup_type":{"ById":"12d88248-8c11-439c-a75f-0864ab2ea45f"},"parent":{"key":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","lookup_type":{"ById":"22dad6d2-ee23-4f02-97b3-ce34a7d929db"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"1a572152-9ce2-4d12-affc-c33b0ffa9869"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"12d88248-8c11-439c-a75f-0864ab2ea45f","ram_diff":1073741824},"destroy_active_vmm":"00af02f0-a728-46fd-a799-2482036b2b50","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-10-30T14:17:10.508282422Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19932024-10-30T14:17:10.515ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
19942024-10-30T14:17:10.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9f803c84-9e14-4a46-8766-bb971ee439e8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
19952024-10-30T14:17:10.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9f803c84-9e14-4a46-8766-bb971ee439e8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
19962024-10-30T14:17:10.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9f803c84-9e14-4a46-8766-bb971ee439e8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
19972024-10-30T14:17:10.546ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
19982024-10-30T14:17:10.546ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
19992024-10-30T14:17:10.546ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20002024-10-30T14:17:10.546ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20012024-10-30T14:17:10.553ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20022024-10-30T14:17:10.553ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20032024-10-30T14:17:10.559ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20042024-10-30T14:17:10.559ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20052024-10-30T14:17:10.563ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20062024-10-30T14:17:10.563ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("cac7f278-da67-4f76-a94a-d28614389487")) node_id = 0 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20072024-10-30T14:17:10.566ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20082024-10-30T14:17:10.566ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20092024-10-30T14:17:10.572ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f parent_lock = UpdaterLock { updater_id: 1a572152-9ce2-4d12-affc-c33b0ffa9869, locked_gen: Generation(Generation(2)) } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20102024-10-30T14:17:10.572ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = BecomeUpdater
20112024-10-30T14:17:10.572ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = BecomeUpdater
20122024-10-30T14:17:10.583ZDEBGnexus (SagaExecutor): inherited lock from 1a572152-9ce2-4d12-affc-c33b0ffa9869 to cac7f278-da67-4f76-a94a-d28614389487 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 1a572152-9ce2-4d12-affc-c33b0ffa9869 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = BecomeUpdater updater_id = cac7f278-da67-4f76-a94a-d28614389487
20132024-10-30T14:17:10.584ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20142024-10-30T14:17:10.584ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20152024-10-30T14:17:10.584ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("cac7f278-da67-4f76-a94a-d28614389487")}) node_id = 1 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20162024-10-30T14:17:10.588ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20172024-10-30T14:17:10.588ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20182024-10-30T14:17:10.593ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20192024-10-30T14:17:10.593ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20202024-10-30T14:17:10.597ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20212024-10-30T14:17:10.597ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20222024-10-30T14:17:10.603ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20232024-10-30T14:17:10.605ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f
20242024-10-30T14:17:10.607ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UpdateNetworkConfig
20252024-10-30T14:17:10.608ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UpdateNetworkConfig
20262024-10-30T14:17:10.611ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UpdateNetworkConfig
20272024-10-30T14:17:10.611ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UpdateNetworkConfig
20282024-10-30T14:17:10.616ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
20292024-10-30T14:17:10.616ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UpdateNetworkConfig
20302024-10-30T14:17:10.616ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UpdateNetworkConfig
20312024-10-30T14:17:10.617ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
20322024-10-30T14:17:10.617ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
20332024-10-30T14:17:10.618ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
20342024-10-30T14:17:10.619ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
20352024-10-30T14:17:10.620ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
20362024-10-30T14:17:10.620ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
20372024-10-30T14:17:10.620ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
20382024-10-30T14:17:10.624ZDEBGnexus: notifying dendrite of updates instance_id = Some(20bfe61f-21a1-45db-aa03-6fa40736aa8f (instance)) switch = switch0
20392024-10-30T14:17:10.625ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33391, tv_nsec: 805148524 } })
20402024-10-30T14:17:10.625ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
20412024-10-30T14:17:10.654ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
20422024-10-30T14:17:10.654ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20432024-10-30T14:17:10.655ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4435db3-e6df-4ea9-b724-a9e03f90a55f", "content-length": "26", "date": "Wed, 30 Oct 2024 14:17:10 GMT"} })
20442024-10-30T14:17:10.655ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20452024-10-30T14:17:10.655ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20462024-10-30T14:17:10.684ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
20472024-10-30T14:17:10.684ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0930439-0bc4-455b-8b69-29cee2d7d4e1", "content-length": "4", "date": "Wed, 30 Oct 2024 14:17:09 GMT"} })
20482024-10-30T14:17:10.686ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20492024-10-30T14:17:10.687ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20502024-10-30T14:17:10.692ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20512024-10-30T14:17:10.692ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20522024-10-30T14:17:10.697ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ReleaseVirtualProvisioning
20532024-10-30T14:17:10.697ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ReleaseVirtualProvisioning
20542024-10-30T14:17:10.717ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-10-30T14:17:10.700195Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 12d88248-8c11-439c-a75f-0864ab2ea45f, time_modified: Some(2024-10-30T14:17:10.700195Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, time_modified: Some(2024-10-30T14:17:10.700195Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20552024-10-30T14:17:10.717ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20562024-10-30T14:17:10.717ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20572024-10-30T14:17:10.724ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20582024-10-30T14:17:10.724ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20592024-10-30T14:17:10.730ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20602024-10-30T14:17:10.730ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UnassignOximeterProducer
20612024-10-30T14:17:10.730ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UnassignOximeterProducer
20622024-10-30T14:17:10.736ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c producer_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20632024-10-30T14:17:10.736ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UnassignOximeterProducer
20642024-10-30T14:17:10.736ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = UnassignOximeterProducer
20652024-10-30T14:17:10.771ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20662024-10-30T14:17:10.774ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/20bfe61f-21a1-45db-aa03-6fa40736aa8f
20672024-10-30T14:17:10.788ZDEBGnexus (SagaExecutor): client response oximeter-collector = 20bfe61f-21a1-45db-aa03-6fa40736aa8f result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/20bfe61f-21a1-45db-aa03-6fa40736aa8f", status: 204, headers: {"x-request-id": "0bdfeb7e-e8e4-4524-ac0f-fef7536ed061", "date": "Wed, 30 Oct 2024 14:17:10 GMT"} }) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20682024-10-30T14:17:10.788ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c producer_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20692024-10-30T14:17:10.789ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20702024-10-30T14:17:10.789ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20712024-10-30T14:17:10.795ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20722024-10-30T14:17:10.795ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20732024-10-30T14:17:10.799ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f lock = UpdaterLock { updater_id: cac7f278-da67-4f76-a94a-d28614389487, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-10-30T14:17:10.508282422Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20742024-10-30T14:17:10.799ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = CommitInstanceUpdates
20752024-10-30T14:17:10.799ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = CommitInstanceUpdates
20762024-10-30T14:17:10.848ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f new_runtime = InstanceRuntimeState { time_updated: 2024-10-30T14:17:10.508282422Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
20772024-10-30T14:17:10.848ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20782024-10-30T14:17:10.848ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20792024-10-30T14:17:10.848ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Signaled
20802024-10-30T14:17:10.848ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20812024-10-30T14:17:10.848ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Signaled
20822024-10-30T14:17:10.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20832024-10-30T14:17:10.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20842024-10-30T14:17:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20852024-10-30T14:17:10.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20862024-10-30T14:17:10.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20872024-10-30T14:17:10.851ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20882024-10-30T14:17:10.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20892024-10-30T14:17:10.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20902024-10-30T14:17:10.851ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20912024-10-30T14:17:10.851ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20922024-10-30T14:17:10.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20932024-10-30T14:17:10.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20942024-10-30T14:17:10.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20952024-10-30T14:17:10.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20962024-10-30T14:17:10.857ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20972024-10-30T14:17:10.857ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("20bfe61f-21a1-45db-aa03-6fa40736aa8f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("00af02f0-a728-46fd-a799-2482036b2b50")}) node_id = 7 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
20982024-10-30T14:17:10.871ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
20992024-10-30T14:17:10.871ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21002024-10-30T14:17:10.883ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21012024-10-30T14:17:10.883ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21022024-10-30T14:17:10.891ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21032024-10-30T14:17:10.891ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21042024-10-30T14:17:10.898ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
21052024-10-30T14:17:10.898ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ReleaseSledResources
21062024-10-30T14:17:10.898ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ReleaseSledResources
21072024-10-30T14:17:10.910ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21082024-10-30T14:17:10.910ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21092024-10-30T14:17:10.918ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21102024-10-30T14:17:10.918ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21112024-10-30T14:17:10.928ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f propolis_id = 00af02f0-a728-46fd-a799-2482036b2b50 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
21122024-10-30T14:17:10.928ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = MarkVmmDeleted
21132024-10-30T14:17:10.929ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = MarkVmmDeleted
21142024-10-30T14:17:10.937ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21152024-10-30T14:17:10.937ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21162024-10-30T14:17:10.937ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e467e0de-5cc8-4883-b9f3-7c6462d2468f", "content-length": "372", "date": "Wed, 30 Oct 2024 14:17:10 GMT"} })
21172024-10-30T14:17:10.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21182024-10-30T14:17:10.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21192024-10-30T14:17:10.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21202024-10-30T14:17:10.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21212024-10-30T14:17:10.958ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21222024-10-30T14:17:10.958ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21232024-10-30T14:17:10.971ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
21242024-10-30T14:17:10.971ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21252024-10-30T14:17:10.972ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "db996264-4e87-40ee-a27b-8659fc240d75", "date": "Wed, 30 Oct 2024 14:17:10 GMT"} })
21262024-10-30T14:17:10.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21272024-10-30T14:17:10.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21282024-10-30T14:17:10.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21292024-10-30T14:17:10.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21302024-10-30T14:17:10.974ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21312024-10-30T14:17:10.974ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21322024-10-30T14:17:10.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21332024-10-30T14:17:10.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21342024-10-30T14:17:10.980ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21352024-10-30T14:17:10.980ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21362024-10-30T14:17:10.981ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a3a7f8a6-77da-47a7-ab95-018ef891ff96", "date": "Wed, 30 Oct 2024 14:17:10 GMT"} })
21372024-10-30T14:17:10.982ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 134.116668ms iteration = 12 status = {}
21382024-10-30T14:17:10.983ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21392024-10-30T14:17:10.983ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21402024-10-30T14:17:10.990ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21412024-10-30T14:17:10.990ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21422024-10-30T14:17:10.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21432024-10-30T14:17:10.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21442024-10-30T14:17:10.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452024-10-30T14:17:10.997ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21462024-10-30T14:17:10.997ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21472024-10-30T14:17:10.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21482024-10-30T14:17:10.998ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21492024-10-30T14:17:10.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21502024-10-30T14:17:10.998ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21512024-10-30T14:17:10.998ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21522024-10-30T14:17:10.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21532024-10-30T14:17:10.999ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21542024-10-30T14:17:11.000ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21552024-10-30T14:17:11.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21562024-10-30T14:17:11.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21572024-10-30T14:17:11.001ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21582024-10-30T14:17:11.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21592024-10-30T14:17:11.004ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, lookup_type: ById(22dad6d2-ee23-4f02-97b3-ce34a7d929db) }, key: 12d88248-8c11-439c-a75f-0864ab2ea45f, lookup_type: ById(12d88248-8c11-439c-a75f-0864ab2ea45f) }, key: 20bfe61f-21a1-45db-aa03-6fa40736aa8f, lookup_type: ById(20bfe61f-21a1-45db-aa03-6fa40736aa8f) } result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21602024-10-30T14:17:11.004ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21612024-10-30T14:17:11.004ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_node = ChainSuccessorSaga
21622024-10-30T14:17:11.010ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update
21632024-10-30T14:17:11.010ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21642024-10-30T14:17:11.010ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21652024-10-30T14:17:11.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Signaled
21662024-10-30T14:17:11.010ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21672024-10-30T14:17:11.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21682024-10-30T14:17:11.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21692024-10-30T14:17:11.013ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21702024-10-30T14:17:11.013ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21712024-10-30T14:17:11.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21722024-10-30T14:17:11.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21732024-10-30T14:17:11.016ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21742024-10-30T14:17:11.016ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21752024-10-30T14:17:11.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21762024-10-30T14:17:11.016ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21772024-10-30T14:17:11.016ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21782024-10-30T14:17:11.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21792024-10-30T14:17:11.020ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21802024-10-30T14:17:11.020ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21812024-10-30T14:17:11.026ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21822024-10-30T14:17:11.026ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a
21832024-10-30T14:17:11.036ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21842024-10-30T14:17:11.036ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a saga_name = instance-update saga_result = SagaResult { saga_id: 2f0ec878-a773-41ee-a27c-2cc7be923e4a, saga_log: SagaLog { saga_id: 2f0ec878-a773-41ee-a27c-2cc7be923e4a, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("cac7f278-da67-4f76-a94a-d28614389487")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("cac7f278-da67-4f76-a94a-d28614389487")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("20bfe61f-21a1-45db-aa03-6fa40736aa8f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("00af02f0-a728-46fd-a799-2482036b2b50")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("20bfe61f-21a1-45db-aa03-6fa40736aa8f"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("00af02f0-a728-46fd-a799-2482036b2b50")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("cac7f278-da67-4f76-a94a-d28614389487"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("cac7f278-da67-4f76-a94a-d28614389487")}} }) }
21852024-10-30T14:17:11.036ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 2f0ec878-a773-41ee-a27c-2cc7be923e4a instance_id = 20bfe61f-21a1-45db-aa03-6fa40736aa8f saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update
21862024-10-30T14:17:11.036ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21872024-10-30T14:17:11.036ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
21882024-10-30T14:17:11.043ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21892024-10-30T14:17:11.043ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
21902024-10-30T14:17:11.046ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21912024-10-30T14:17:11.046ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21922024-10-30T14:17:11.046ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 36.265466ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21932024-10-30T14:17:11.053ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21942024-10-30T14:17:11.053ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
21952024-10-30T14:17:11.065ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
21962024-10-30T14:17:11.065ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c
21972024-10-30T14:17:11.094ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21982024-10-30T14:17:11.094ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd55c16b-5a59-4dfe-b6e4-cb976b6b5108", "content-length": "691", "date": "Wed, 30 Oct 2024 14:17:10 GMT"} })
21992024-10-30T14:17:11.094ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22002024-10-30T14:17:11.094ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22012024-10-30T14:17:11.094ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
22022024-10-30T14:17:11.096ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 248.787798ms iteration = 11 status = {}
22032024-10-30T14:17:11.106ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update sec_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
22042024-10-30T14:17:11.106ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c saga_name = start-instance-update saga_result = SagaResult { saga_id: 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c, saga_log: SagaLog { saga_id: 1ae40031-3d67-45f5-b33b-fe4cf1d18d4c, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("1a572152-9ce2-4d12-affc-c33b0ffa9869")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("1a572152-9ce2-4d12-affc-c33b0ffa9869")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("1a572152-9ce2-4d12-affc-c33b0ffa9869"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("1a572152-9ce2-4d12-affc-c33b0ffa9869")}} }) }
22052024-10-30T14:17:11.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 4a0cb6d1-b2d2-4aca-a553-855b46e04a55 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
22062024-10-30T14:17:11.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 4a0cb6d1-b2d2-4aca-a553-855b46e04a55 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
22072024-10-30T14:17:11.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 4a0cb6d1-b2d2-4aca-a553-855b46e04a55 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
22082024-10-30T14:17:11.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 21f4c237-5701-4772-a040-68e2d7dadbdd roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22092024-10-30T14:17:11.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 21f4c237-5701-4772-a040-68e2d7dadbdd resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22102024-10-30T14:17:11.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 21f4c237-5701-4772-a040-68e2d7dadbdd response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22112024-10-30T14:17:12.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5e3643d5-d445-4fc9-ad82-c2bb5e890362 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22122024-10-30T14:17:12.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5e3643d5-d445-4fc9-ad82-c2bb5e890362 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22132024-10-30T14:17:12.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5e3643d5-d445-4fc9-ad82-c2bb5e890362 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22142024-10-30T14:17:13.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 67f174ce-4616-461a-ad2d-7ef152e74c61 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22152024-10-30T14:17:13.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 67f174ce-4616-461a-ad2d-7ef152e74c61 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22162024-10-30T14:17:13.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 67f174ce-4616-461a-ad2d-7ef152e74c61 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22172024-10-30T14:17:14.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = de3ee9aa-c6a5-4f4c-832b-615003cb1314 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22182024-10-30T14:17:14.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = de3ee9aa-c6a5-4f4c-832b-615003cb1314 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22192024-10-30T14:17:14.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = de3ee9aa-c6a5-4f4c-832b-615003cb1314 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22202024-10-30T14:17:15.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bc319fdd-da01-4cad-9b0c-17cf95336463 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22212024-10-30T14:17:15.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bc319fdd-da01-4cad-9b0c-17cf95336463 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22222024-10-30T14:17:15.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bc319fdd-da01-4cad-9b0c-17cf95336463 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22232024-10-30T14:17:16.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a3bc0ef4-317a-473f-8c66-b8630d3376d8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22242024-10-30T14:17:16.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a3bc0ef4-317a-473f-8c66-b8630d3376d8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22252024-10-30T14:17:16.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a3bc0ef4-317a-473f-8c66-b8630d3376d8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22262024-10-30T14:17:17.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d7bc055b-b704-4dfc-b9e6-1b9fbe1810cb roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22272024-10-30T14:17:17.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d7bc055b-b704-4dfc-b9e6-1b9fbe1810cb resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22282024-10-30T14:17:17.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d7bc055b-b704-4dfc-b9e6-1b9fbe1810cb response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22292024-10-30T14:17:18.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 77ebc110-3b20-41f8-bf1c-e41d4eeb1e3e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22302024-10-30T14:17:18.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 77ebc110-3b20-41f8-bf1c-e41d4eeb1e3e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22312024-10-30T14:17:18.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 77ebc110-3b20-41f8-bf1c-e41d4eeb1e3e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22322024-10-30T14:17:19.425ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
22332024-10-30T14:17:19.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22342024-10-30T14:17:19.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22352024-10-30T14:17:19.425ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
22362024-10-30T14:17:19.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22372024-10-30T14:17:19.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22382024-10-30T14:17:19.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22392024-10-30T14:17:19.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22402024-10-30T14:17:19.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22412024-10-30T14:17:19.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22422024-10-30T14:17:19.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22432024-10-30T14:17:19.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22442024-10-30T14:17:19.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22452024-10-30T14:17:19.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
22462024-10-30T14:17:19.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22472024-10-30T14:17:19.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22482024-10-30T14:17:19.446ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
22492024-10-30T14:17:19.446ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.194797ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
22502024-10-30T14:17:19.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22512024-10-30T14:17:19.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22522024-10-30T14:17:19.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.914517ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22532024-10-30T14:17:19.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f35f91fb-90dc-4ce2-a54f-1f7824acacf3 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22542024-10-30T14:17:19.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f35f91fb-90dc-4ce2-a54f-1f7824acacf3 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22552024-10-30T14:17:19.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f35f91fb-90dc-4ce2-a54f-1f7824acacf3 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22562024-10-30T14:17:20.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ef241e8d-55b6-476e-b4bf-89d9e246ac43 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22572024-10-30T14:17:20.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ef241e8d-55b6-476e-b4bf-89d9e246ac43 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22582024-10-30T14:17:20.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ef241e8d-55b6-476e-b4bf-89d9e246ac43 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22592024-10-30T14:17:21.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 76a73d3a-4afb-4cab-9929-744912fbc722 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22602024-10-30T14:17:21.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 76a73d3a-4afb-4cab-9929-744912fbc722 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22612024-10-30T14:17:21.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 76a73d3a-4afb-4cab-9929-744912fbc722 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22622024-10-30T14:17:22.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 428c0bac-5cf8-43d9-880e-67aa1c7725af roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22632024-10-30T14:17:22.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 428c0bac-5cf8-43d9-880e-67aa1c7725af resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22642024-10-30T14:17:22.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 428c0bac-5cf8-43d9-880e-67aa1c7725af response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22652024-10-30T14:17:23.486ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 3ed0a53a-6bcc-4f4a-9657-f01382a0c28d response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
22662024-10-30T14:17:23.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0724f8bb-cf00-4dd8-9ac2-f6c945f1851f roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22672024-10-30T14:17:23.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0724f8bb-cf00-4dd8-9ac2-f6c945f1851f resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22682024-10-30T14:17:23.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0724f8bb-cf00-4dd8-9ac2-f6c945f1851f response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22692024-10-30T14:17:24.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 022661d6-276f-4295-8370-25e0b8b8ab1f roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22702024-10-30T14:17:24.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 022661d6-276f-4295-8370-25e0b8b8ab1f resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22712024-10-30T14:17:24.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 022661d6-276f-4295-8370-25e0b8b8ab1f response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22722024-10-30T14:17:25.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4f5cf992-fdd5-42ec-9112-ffdbf3ae32a5 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22732024-10-30T14:17:25.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4f5cf992-fdd5-42ec-9112-ffdbf3ae32a5 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22742024-10-30T14:17:25.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4f5cf992-fdd5-42ec-9112-ffdbf3ae32a5 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22752024-10-30T14:17:26.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7141f4d0-7b8b-45f5-b660-c085ad401b13 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22762024-10-30T14:17:26.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7141f4d0-7b8b-45f5-b660-c085ad401b13 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22772024-10-30T14:17:26.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7141f4d0-7b8b-45f5-b660-c085ad401b13 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22782024-10-30T14:17:27.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 352e453a-7991-43b2-bf09-9bc2e08d5a6b roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22792024-10-30T14:17:27.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 352e453a-7991-43b2-bf09-9bc2e08d5a6b resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22802024-10-30T14:17:27.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 352e453a-7991-43b2-bf09-9bc2e08d5a6b response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22812024-10-30T14:17:28.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e4da0c68-0c21-4e12-8605-361c594fb825 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22822024-10-30T14:17:28.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e4da0c68-0c21-4e12-8605-361c594fb825 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22832024-10-30T14:17:28.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e4da0c68-0c21-4e12-8605-361c594fb825 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
22842024-10-30T14:17:29.285ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:65196
22852024-10-30T14:17:29.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65196 req_id = 33244477-e243-4e95-97a8-382d4953e906 roles = RoleSet { roles: {} } uri = /metrics/producers
22862024-10-30T14:17:29.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65196 req_id = 33244477-e243-4e95-97a8-382d4953e906 resource = Database result = Ok(()) uri = /metrics/producers
22872024-10-30T14:17:29.324ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 963ac472-284b-4429-931a-df4a09f45485
22882024-10-30T14:17:29.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39530 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65196 req_id = 33244477-e243-4e95-97a8-382d4953e906 response_code = 201 uri = /metrics/producers
22892024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
22902024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
22912024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22922024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22932024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
22942024-10-30T14:17:29.422ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22952024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
22962024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22972024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22982024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
22992024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
23002024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
23012024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23022024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
23032024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23042024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
23052024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
23062024-10-30T14:17:29.422ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854
23072024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.27\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854"}
23082024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
23092024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
23102024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23112024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23122024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
23132024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23142024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
23152024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23162024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23172024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
23182024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
23192024-10-30T14:17:29.422ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-30 14:07:29.422407598 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23202024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
23212024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23222024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23232024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
23242024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
23252024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23262024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23272024-10-30T14:17:29.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
23282024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23292024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
23302024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23312024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23322024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23332024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23342024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23352024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23362024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23372024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23382024-10-30T14:17:29.423ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d63b0d7-b7b2-4bc1-b329-13e53ae58f30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d00dc1a3-b063-4364-8a39-247d9fd1eb38.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40e7162-26ca-4c45-932d-9e6f8cedacab.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40e7162-26ca-4c45-932d-9e6f8cedacab.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 33410, tv_nsec: 608915166 } })
23392024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23402024-10-30T14:17:29.423ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62825ae7-d0e8-4554-b47e-377bf9997852.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a5a8b395-0169-4688-a9f0-b29d7a7c4214.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a5a8b395-0169-4688-a9f0-b29d7a7c4214.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33410, tv_nsec: 608956947 } })
23412024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23422024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23432024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23442024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23452024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23462024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23472024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23482024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
23492024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23502024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
23512024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23522024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23532024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
23542024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.242654ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
23552024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23562024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23572024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
23582024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.355067ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
23592024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23602024-10-30T14:17:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23612024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
23622024-10-30T14:17:29.425ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
23632024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
23642024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
23652024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
23662024-10-30T14:17:29.425ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23672024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.52\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
23682024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
23692024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
23702024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23712024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.9\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23722024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
23732024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.67\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23742024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.94\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
23752024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
23762024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
23772024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23782024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23792024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23802024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
23812024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23822024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
23832024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23842024-10-30T14:17:29.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23852024-10-30T14:17:29.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23862024-10-30T14:17:29.428ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-30 14:07:29.422407598 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
23872024-10-30T14:17:29.428ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.661944ms iteration = 6 status = {"expiration":"2024-10-30T14:07:29.422407598Z","pruned":[]}
23882024-10-30T14:17:29.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23892024-10-30T14:17:29.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23902024-10-30T14:17:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23912024-10-30T14:17:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23922024-10-30T14:17:29.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23932024-10-30T14:17:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23942024-10-30T14:17:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23952024-10-30T14:17:29.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23962024-10-30T14:17:29.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23972024-10-30T14:17:29.431ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33410, tv_nsec: 617853319 } })
23982024-10-30T14:17:29.432ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
23992024-10-30T14:17:29.432ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33410, tv_nsec: 618544838 } })
24002024-10-30T14:17:29.432ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
24012024-10-30T14:17:29.436ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24022024-10-30T14:17:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24032024-10-30T14:17:29.439ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24042024-10-30T14:17:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24052024-10-30T14:17:29.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24062024-10-30T14:17:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24072024-10-30T14:17:29.442ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24082024-10-30T14:17:29.442ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24092024-10-30T14:17:29.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24102024-10-30T14:17:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24112024-10-30T14:17:29.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24122024-10-30T14:17:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24132024-10-30T14:17:29.444ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.355077ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
24142024-10-30T14:17:29.445ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24152024-10-30T14:17:29.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24162024-10-30T14:17:29.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24172024-10-30T14:17:29.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24182024-10-30T14:17:29.446ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24192024-10-30T14:17:29.446ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24202024-10-30T14:17:29.446ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.464074ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
24212024-10-30T14:17:29.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24222024-10-30T14:17:29.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24232024-10-30T14:17:29.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24242024-10-30T14:17:29.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24252024-10-30T14:17:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24262024-10-30T14:17:29.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24272024-10-30T14:17:29.451ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24282024-10-30T14:17:29.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24292024-10-30T14:17:29.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24302024-10-30T14:17:29.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24312024-10-30T14:17:29.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24322024-10-30T14:17:29.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24332024-10-30T14:17:29.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24342024-10-30T14:17:29.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24352024-10-30T14:17:29.471ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33410, tv_nsec: 657357824 } })
24362024-10-30T14:17:29.471ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
24372024-10-30T14:17:29.473ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24382024-10-30T14:17:29.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24392024-10-30T14:17:29.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24402024-10-30T14:17:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24412024-10-30T14:17:29.484ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24422024-10-30T14:17:29.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24432024-10-30T14:17:29.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24442024-10-30T14:17:29.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24452024-10-30T14:17:29.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24462024-10-30T14:17:29.488ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.569144ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24472024-10-30T14:17:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24482024-10-30T14:17:29.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24492024-10-30T14:17:29.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24502024-10-30T14:17:29.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24512024-10-30T14:17:29.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24522024-10-30T14:17:29.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24532024-10-30T14:17:29.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24542024-10-30T14:17:29.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24552024-10-30T14:17:29.502ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24562024-10-30T14:17:29.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24572024-10-30T14:17:29.504ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
24582024-10-30T14:17:29.504ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
24592024-10-30T14:17:29.504ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
24602024-10-30T14:17:29.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24612024-10-30T14:17:29.504ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24622024-10-30T14:17:29.504ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24632024-10-30T14:17:29.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24642024-10-30T14:17:29.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24652024-10-30T14:17:29.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24662024-10-30T14:17:29.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
24672024-10-30T14:17:29.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24682024-10-30T14:17:29.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24692024-10-30T14:17:29.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24702024-10-30T14:17:29.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24712024-10-30T14:17:29.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24722024-10-30T14:17:29.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
24732024-10-30T14:17:29.508ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24742024-10-30T14:17:29.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24752024-10-30T14:17:29.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24762024-10-30T14:17:29.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
24772024-10-30T14:17:29.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
24782024-10-30T14:17:29.509ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
24792024-10-30T14:17:29.509ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
24802024-10-30T14:17:29.509ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.13594ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
24812024-10-30T14:17:29.510ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24822024-10-30T14:17:29.510ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24832024-10-30T14:17:29.510ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24842024-10-30T14:17:29.510ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 87.415548ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24852024-10-30T14:17:29.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24862024-10-30T14:17:29.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24872024-10-30T14:17:29.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24882024-10-30T14:17:29.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24892024-10-30T14:17:29.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24902024-10-30T14:17:29.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24912024-10-30T14:17:29.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24922024-10-30T14:17:29.515ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24932024-10-30T14:17:29.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24942024-10-30T14:17:29.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24952024-10-30T14:17:29.517ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24962024-10-30T14:17:29.517ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24972024-10-30T14:17:29.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24982024-10-30T14:17:29.519ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24992024-10-30T14:17:29.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25002024-10-30T14:17:29.522ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
25012024-10-30T14:17:29.522ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.951348ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
25022024-10-30T14:17:29.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25032024-10-30T14:17:29.522ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25042024-10-30T14:17:29.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25052024-10-30T14:17:29.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25062024-10-30T14:17:29.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25072024-10-30T14:17:29.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25082024-10-30T14:17:29.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25092024-10-30T14:17:29.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25102024-10-30T14:17:29.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25112024-10-30T14:17:29.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25122024-10-30T14:17:29.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25132024-10-30T14:17:29.530ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25142024-10-30T14:17:29.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25152024-10-30T14:17:29.535ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25162024-10-30T14:17:29.536ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25172024-10-30T14:17:29.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 115.174483ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25182024-10-30T14:17:29.541ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25192024-10-30T14:17:29.541ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25202024-10-30T14:17:29.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25212024-10-30T14:17:29.542ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 120.328783ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25222024-10-30T14:17:29.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25232024-10-30T14:17:29.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25242024-10-30T14:17:29.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25252024-10-30T14:17:29.548ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 963ac472-284b-4429-931a-df4a09f45485, lookup_type: ById(963ac472-284b-4429-931a-df4a09f45485) } result = Ok(())
25262024-10-30T14:17:29.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25272024-10-30T14:17:29.549ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25282024-10-30T14:17:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25292024-10-30T14:17:29.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25302024-10-30T14:17:29.550ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25312024-10-30T14:17:29.550ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25322024-10-30T14:17:29.550ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25332024-10-30T14:17:29.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25342024-10-30T14:17:29.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25352024-10-30T14:17:29.551ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.721758ms iteration = 11 status = 0
25362024-10-30T14:17:29.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25372024-10-30T14:17:29.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25382024-10-30T14:17:29.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25392024-10-30T14:17:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25402024-10-30T14:17:29.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25412024-10-30T14:17:29.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25422024-10-30T14:17:29.559ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25432024-10-30T14:17:29.560ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25442024-10-30T14:17:29.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25452024-10-30T14:17:29.562ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25462024-10-30T14:17:29.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25472024-10-30T14:17:29.563ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
25482024-10-30T14:17:29.563ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25492024-10-30T14:17:29.564ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c778aa2b-0471-4633-a554-ab7bee6041a3", "content-length": "26", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
25502024-10-30T14:17:29.564ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25512024-10-30T14:17:29.566ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25522024-10-30T14:17:29.567ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25532024-10-30T14:17:29.567ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 144.983844ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
25542024-10-30T14:17:29.575ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25552024-10-30T14:17:29.575ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7aaf8c85-7de8-4dba-ba3c-bea52a7650b0 dns_zone_name = oxide.test found_so_far = 0 version = 2
25562024-10-30T14:17:29.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25572024-10-30T14:17:29.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25582024-10-30T14:17:29.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25592024-10-30T14:17:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25602024-10-30T14:17:29.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25612024-10-30T14:17:29.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25622024-10-30T14:17:29.585ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-30T14:12:28.404860Z, time_modified: 2024-10-30T14:12:28.404860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, db_silo: Silo { identity: SiloIdentity { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-30T14:12:59.312829Z, time_modified: 2024-10-30T14:12:59.312829Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, db_silo: Silo { identity: SiloIdentity { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-30T14:12:59.312829Z, time_modified: 2024-10-30T14:12:59.312829Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
25632024-10-30T14:17:29.585ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 163.094666ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","tls_certs":["1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48"]}},"default_endpoint":{"silo_id":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","tls_certs":["1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
25642024-10-30T14:17:29.587ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7aaf8c85-7de8-4dba-ba3c-bea52a7650b0 dns_zone_name = oxide.test found_so_far = 1 version = 2
25652024-10-30T14:17:29.587ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
25662024-10-30T14:17:29.587ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-30 14:12:59.359161 UTC dns_group = external generation = 2
25672024-10-30T14:17:29.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 165.091341ms iteration = 7 status = {"generation":2}
25682024-10-30T14:17:29.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 zone_address = fd00:1122:3344:101::2
25692024-10-30T14:17:29.590ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25702024-10-30T14:17:29.590ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ae5a25a-9699-47d8-9660-2af4a21fe793", "content-length": "26", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
25712024-10-30T14:17:29.590ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25722024-10-30T14:17:29.592ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
25732024-10-30T14:17:29.595ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
25742024-10-30T14:17:29.595ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25752024-10-30T14:17:29.596ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d915cf4a-1414-45ad-9310-bc8097284c56", "content-length": "26", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
25762024-10-30T14:17:29.596ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25772024-10-30T14:17:29.598ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25782024-10-30T14:17:29.611ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25792024-10-30T14:17:29.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25802024-10-30T14:17:29.613ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25812024-10-30T14:17:29.613ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 036a00d3-1b62-4bb7-8512-8a6cf898e068 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25822024-10-30T14:17:29.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25832024-10-30T14:17:29.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25842024-10-30T14:17:29.615ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25852024-10-30T14:17:29.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25862024-10-30T14:17:29.617ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25872024-10-30T14:17:29.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25882024-10-30T14:17:29.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25892024-10-30T14:17:29.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25902024-10-30T14:17:29.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25912024-10-30T14:17:29.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25922024-10-30T14:17:29.623ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
25932024-10-30T14:17:29.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
25942024-10-30T14:17:29.625ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25952024-10-30T14:17:29.625ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 036a00d3-1b62-4bb7-8512-8a6cf898e068 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
25962024-10-30T14:17:29.625ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
25972024-10-30T14:17:29.625ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-30 14:12:58.822178 UTC dns_group = internal generation = 1
25982024-10-30T14:17:29.625ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 203.381201ms iteration = 7 status = {"generation":1}
25992024-10-30T14:17:29.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26002024-10-30T14:17:29.625ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26012024-10-30T14:17:29.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26022024-10-30T14:17:29.628ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26032024-10-30T14:17:29.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26042024-10-30T14:17:29.630ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26052024-10-30T14:17:29.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26062024-10-30T14:17:29.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26072024-10-30T14:17:29.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26082024-10-30T14:17:29.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26092024-10-30T14:17:29.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26102024-10-30T14:17:29.637ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26112024-10-30T14:17:29.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26122024-10-30T14:17:29.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26132024-10-30T14:17:29.641ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26142024-10-30T14:17:29.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 218.236735ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26152024-10-30T14:17:29.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26162024-10-30T14:17:29.644ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26172024-10-30T14:17:29.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26182024-10-30T14:17:29.645ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26192024-10-30T14:17:29.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26202024-10-30T14:17:29.647ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26212024-10-30T14:17:29.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26222024-10-30T14:17:29.649ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26232024-10-30T14:17:29.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
26242024-10-30T14:17:29.654ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26252024-10-30T14:17:29.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26262024-10-30T14:17:29.662ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 240.349857ms iteration = 14 status = {"physical_disks_added":0}
26272024-10-30T14:17:29.663ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26282024-10-30T14:17:29.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26292024-10-30T14:17:29.665ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26302024-10-30T14:17:29.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26312024-10-30T14:17:29.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26322024-10-30T14:17:29.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26332024-10-30T14:17:29.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26342024-10-30T14:17:29.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26352024-10-30T14:17:29.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26362024-10-30T14:17:29.669ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26372024-10-30T14:17:29.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26382024-10-30T14:17:29.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26392024-10-30T14:17:29.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26402024-10-30T14:17:29.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26412024-10-30T14:17:29.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26422024-10-30T14:17:29.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26432024-10-30T14:17:29.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26442024-10-30T14:17:29.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26452024-10-30T14:17:29.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26462024-10-30T14:17:29.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26472024-10-30T14:17:29.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26482024-10-30T14:17:29.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26492024-10-30T14:17:29.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26502024-10-30T14:17:29.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26512024-10-30T14:17:29.676ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26522024-10-30T14:17:29.680ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
26532024-10-30T14:17:29.680ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26542024-10-30T14:17:29.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26552024-10-30T14:17:29.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26562024-10-30T14:17:29.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26572024-10-30T14:17:29.683ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26582024-10-30T14:17:29.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26592024-10-30T14:17:29.684ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26602024-10-30T14:17:29.688ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
26612024-10-30T14:17:29.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26622024-10-30T14:17:29.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26632024-10-30T14:17:29.709ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 287.12114ms iteration = 11 status = {}
26642024-10-30T14:17:29.731ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26652024-10-30T14:17:29.731ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "97812a7d-c50f-4b8b-b8a0-dae1fe5151c5", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26662024-10-30T14:17:29.731ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26672024-10-30T14:17:29.733ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "29848a77-32f4-451e-981c-8f03b6951c06", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26682024-10-30T14:17:29.733ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26692024-10-30T14:17:29.734ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
26702024-10-30T14:17:29.735ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.789608ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26712024-10-30T14:17:29.755ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26722024-10-30T14:17:29.755ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "59fb48bc-3925-4dae-90e7-8a283165d67f", "content-length": "2", "date": "Wed, 30 Oct 2024 14:17:28 GMT"} })
26732024-10-30T14:17:29.757ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26742024-10-30T14:17:29.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26752024-10-30T14:17:29.816ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26762024-10-30T14:17:29.817ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26772024-10-30T14:17:29.817ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0bf1a18-03e6-4876-b7d7-1649b4d20d52", "content-length": "691", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
26782024-10-30T14:17:29.817ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26792024-10-30T14:17:29.817ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26802024-10-30T14:17:29.817ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26812024-10-30T14:17:29.819ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 397.709418ms iteration = 11 status = null
26822024-10-30T14:17:29.819ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 397.600074ms iteration = 12 status = {}
26832024-10-30T14:17:29.824ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 7d10ae2e-69a6-4779-9c0e-98ad16a7de7c, kind: Service { id: 84aef213-b004-4a64-a47a-f4c08301a325 }, name: Name("nexus-84aef213-b004-4a64-a47a-f4c08301a325"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 84])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8f215d46-9f84-4c8b-817c-d8906a80c5a3, kind: Service { id: 62f94fcd-b9d8-4397-9be2-9288fe2e213e }, name: Name("nexus-62f94fcd-b9d8-4397-9be2-9288fe2e213e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa536a9e-d366-41a2-a0f4-9fca0b340bcd, kind: Service { id: f2b56f91-b260-4c00-a784-3971c52ebfe0 }, name: Name("nexus-f2b56f91-b260-4c00-a784-3971c52ebfe0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 220b881a-40f9-484a-adaa-cb54d2e53504, kind: Service { id: 62825ae7-d0e8-4554-b47e-377bf9997852 }, name: Name("external-dns-62825ae7-d0e8-4554-b47e-377bf9997852"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 690158eb-8d70-45e0-85ec-6fb1c1b5ddb7, kind: Service { id: a5a8b395-0169-4688-a9f0-b29d7a7c4214 }, name: Name("external-dns-a5a8b395-0169-4688-a9f0-b29d7a7c4214"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 37])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
26842024-10-30T14:17:29.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26852024-10-30T14:17:29.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26862024-10-30T14:17:29.826ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26872024-10-30T14:17:29.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
26882024-10-30T14:17:29.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
26892024-10-30T14:17:29.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
26902024-10-30T14:17:29.830ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
26912024-10-30T14:17:29.830ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 220b881a-40f9-484a-adaa-cb54d2e53504, kind: Service { id: 62825ae7-d0e8-4554-b47e-377bf9997852 }, name: Name("external-dns-62825ae7-d0e8-4554-b47e-377bf9997852"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 202])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 690158eb-8d70-45e0-85ec-6fb1c1b5ddb7, kind: Service { id: a5a8b395-0169-4688-a9f0-b29d7a7c4214 }, name: Name("external-dns-a5a8b395-0169-4688-a9f0-b29d7a7c4214"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 37])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7d10ae2e-69a6-4779-9c0e-98ad16a7de7c, kind: Service { id: 84aef213-b004-4a64-a47a-f4c08301a325 }, name: Name("nexus-84aef213-b004-4a64-a47a-f4c08301a325"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 84])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8f215d46-9f84-4c8b-817c-d8906a80c5a3, kind: Service { id: 62f94fcd-b9d8-4397-9be2-9288fe2e213e }, name: Name("nexus-62f94fcd-b9d8-4397-9be2-9288fe2e213e"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 218])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: aa536a9e-d366-41a2-a0f4-9fca0b340bcd, kind: Service { id: f2b56f91-b260-4c00-a784-3971c52ebfe0 }, name: Name("nexus-f2b56f91-b260-4c00-a784-3971c52ebfe0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 74])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
26922024-10-30T14:17:29.830ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
26932024-10-30T14:17:29.877ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26942024-10-30T14:17:29.877ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26952024-10-30T14:17:29.878ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5273eadd-ec4a-4d08-afb6-10966eec2e1c", "content-length": "372", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
26962024-10-30T14:17:29.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26972024-10-30T14:17:29.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26982024-10-30T14:17:29.891ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 963ac472-284b-4429-931a-df4a09f45485, time_created: 2024-10-30T14:12:53.553887Z, time_modified: 2024-10-30T14:12:53.553887Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 1e7155fc-ddca-45d5-a711-7b3b989aed61, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
26992024-10-30T14:17:29.891ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
27002024-10-30T14:17:29.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27012024-10-30T14:17:29.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27022024-10-30T14:17:29.891ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27032024-10-30T14:17:29.891ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27042024-10-30T14:17:29.892ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "91f9235c-b59b-47dc-9654-5ec2fdb5c628", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
27052024-10-30T14:17:29.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27062024-10-30T14:17:29.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27072024-10-30T14:17:29.893ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
27082024-10-30T14:17:29.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
27092024-10-30T14:17:29.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27102024-10-30T14:17:29.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27112024-10-30T14:17:29.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27122024-10-30T14:17:29.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27132024-10-30T14:17:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27142024-10-30T14:17:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 963ac472-284b-4429-931a-df4a09f45485, lookup_type: ById(963ac472-284b-4429-931a-df4a09f45485) } result = Ok(())
27152024-10-30T14:17:29.899ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27162024-10-30T14:17:29.899ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27172024-10-30T14:17:29.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "915088e5-206e-45f3-a720-05d3f2cc8023", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
27182024-10-30T14:17:29.901ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 476.591973ms iteration = 13 status = {}
27192024-10-30T14:17:29.944ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27202024-10-30T14:17:29.944ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ef0dec05-cc12-4215-9593-2c173f0c3393", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27212024-10-30T14:17:29.944ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27222024-10-30T14:17:29.945ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "18a306ae-578b-4b89-b9e8-de2bcc1acc3f", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27232024-10-30T14:17:29.945ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27242024-10-30T14:17:29.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 821b9738-cc5c-48d4-a0fb-eb4af7f70edb roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27252024-10-30T14:17:29.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 821b9738-cc5c-48d4-a0fb-eb4af7f70edb resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27262024-10-30T14:17:29.947ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7aeedfaa-50b8-4b06-9d3d-19d88bb42954", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27272024-10-30T14:17:29.947ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27282024-10-30T14:17:29.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 821b9738-cc5c-48d4-a0fb-eb4af7f70edb response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27292024-10-30T14:17:29.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27302024-10-30T14:17:29.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27312024-10-30T14:17:29.949ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27322024-10-30T14:17:29.949ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 527.645122ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27332024-10-30T14:17:29.950ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9704a443-267a-4c29-90f6-c5d616116fea, rack_id: 1e7155fc-ddca-45d5-a711-7b3b989aed61, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(498615ba-af90-4d49-8ca5-0cf4d1a30c69) } rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
27342024-10-30T14:17:29.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27352024-10-30T14:17:29.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27362024-10-30T14:17:29.960ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27372024-10-30T14:17:29.961ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "9066a893-406c-49bc-8b65-4855f533e1d4", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
27382024-10-30T14:17:29.963ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
27392024-10-30T14:17:29.963ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 538.254391ms
27402024-10-30T14:17:29.963ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 538.264381ms iteration = 2 status = {}
27412024-10-30T14:17:29.970ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27422024-10-30T14:17:29.970ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "020fcd3b-473c-466c-a498-47eecb317d82", "content-length": "121", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
27432024-10-30T14:17:29.970ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
27442024-10-30T14:17:29.970ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 498615ba-af90-4d49-8ca5-0cf4d1a30c69
27452024-10-30T14:17:29.970ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27462024-10-30T14:17:29.970ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27472024-10-30T14:17:29.970ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27482024-10-30T14:17:29.970ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27492024-10-30T14:17:29.970ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27502024-10-30T14:17:29.970ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27512024-10-30T14:17:29.971ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27522024-10-30T14:17:29.971ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27532024-10-30T14:17:29.971ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
27542024-10-30T14:17:29.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27552024-10-30T14:17:29.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27562024-10-30T14:17:29.973ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27572024-10-30T14:17:29.973ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "59a56a47-34f1-4be1-ab6a-c310738fa285", "content-length": "2", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
27582024-10-30T14:17:29.973ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27592024-10-30T14:17:29.973ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "18007f78-e656-46f5-aa75-ddb9f684ec7c", "content-length": "52", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
27602024-10-30T14:17:29.973ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
27612024-10-30T14:17:29.973ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27622024-10-30T14:17:30.081ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "30df79b6-fba8-48d4-9047-209148b1ddd8", "date": "Wed, 30 Oct 2024 14:17:29 GMT"} })
27632024-10-30T14:17:30.081ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch = Switch0
27642024-10-30T14:17:30.081ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27652024-10-30T14:17:30.082ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fc31d3d-80cc-4bf9-8c38-1fd1e501d6f0", "content-length": "669", "date": "Wed, 30 Oct 2024 14:17:30 GMT"} })
27662024-10-30T14:17:30.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27672024-10-30T14:17:30.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27682024-10-30T14:17:30.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27692024-10-30T14:17:30.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27702024-10-30T14:17:30.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27712024-10-30T14:17:30.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27722024-10-30T14:17:30.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27732024-10-30T14:17:30.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27742024-10-30T14:17:30.098ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 676.637024ms iteration = 11 status = {}
27752024-10-30T14:17:30.942ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44233
27762024-10-30T14:17:30.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44233 req_id = a02f2a17-5f0f-4574-94fa-f3624f61faeb roles = RoleSet { roles: {} } uri = /metrics/producers
27772024-10-30T14:17:30.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44233 req_id = a02f2a17-5f0f-4574-94fa-f3624f61faeb resource = Database result = Ok(()) uri = /metrics/producers
27782024-10-30T14:17:31.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b1c30ade-8fbb-4971-bb6a-c053952db3a8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27792024-10-30T14:17:31.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b1c30ade-8fbb-4971-bb6a-c053952db3a8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27802024-10-30T14:17:31.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b1c30ade-8fbb-4971-bb6a-c053952db3a8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27812024-10-30T14:17:31.102ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = a2da6817-ca4e-49a7-97c4-d0e11c495db8
27822024-10-30T14:17:31.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159561 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44233 req_id = a02f2a17-5f0f-4574-94fa-f3624f61faeb response_code = 201 uri = /metrics/producers
27832024-10-30T14:17:32.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1f66ada-1272-42f0-92de-9944520f7690 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27842024-10-30T14:17:32.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1f66ada-1272-42f0-92de-9944520f7690 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27852024-10-30T14:17:32.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f1f66ada-1272-42f0-92de-9944520f7690 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27862024-10-30T14:17:33.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3f756370-ee52-4d5d-9433-cd5da4bffc38 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27872024-10-30T14:17:33.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3f756370-ee52-4d5d-9433-cd5da4bffc38 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27882024-10-30T14:17:33.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3f756370-ee52-4d5d-9433-cd5da4bffc38 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27892024-10-30T14:17:34.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 04fb0b11-b504-48c9-bb6e-b7230e428463 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27902024-10-30T14:17:34.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 04fb0b11-b504-48c9-bb6e-b7230e428463 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27912024-10-30T14:17:34.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2678 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 04fb0b11-b504-48c9-bb6e-b7230e428463 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27922024-10-30T14:17:35.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 70808887-1f4e-4781-a13b-013cbaaed422 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27932024-10-30T14:17:35.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 70808887-1f4e-4781-a13b-013cbaaed422 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27942024-10-30T14:17:35.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 70808887-1f4e-4781-a13b-013cbaaed422 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27952024-10-30T14:17:36.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b408dbd-caf3-425e-80c0-9e5686088221 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27962024-10-30T14:17:36.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b408dbd-caf3-425e-80c0-9e5686088221 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27972024-10-30T14:17:36.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b408dbd-caf3-425e-80c0-9e5686088221 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27982024-10-30T14:17:37.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6058b32d-013f-4fea-9115-1a0ac3dab376 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
27992024-10-30T14:17:37.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6058b32d-013f-4fea-9115-1a0ac3dab376 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28002024-10-30T14:17:37.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6058b32d-013f-4fea-9115-1a0ac3dab376 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28012024-10-30T14:17:38.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e78b8d20-90be-4fd8-851f-fb1310f06bec roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28022024-10-30T14:17:38.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e78b8d20-90be-4fd8-851f-fb1310f06bec resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28032024-10-30T14:17:38.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e78b8d20-90be-4fd8-851f-fb1310f06bec response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28042024-10-30T14:17:38.481ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1343 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 2bf411b3-50e3-437e-b42c-05a1db6b430d response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
28052024-10-30T14:17:39.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 806d65f9-2464-42e6-8d15-ea7eb5f1dabb roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28062024-10-30T14:17:39.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 806d65f9-2464-42e6-8d15-ea7eb5f1dabb resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28072024-10-30T14:17:39.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 806d65f9-2464-42e6-8d15-ea7eb5f1dabb response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28082024-10-30T14:17:39.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
28092024-10-30T14:17:39.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28102024-10-30T14:17:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28112024-10-30T14:17:39.419ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
28122024-10-30T14:17:39.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28132024-10-30T14:17:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28142024-10-30T14:17:39.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28152024-10-30T14:17:39.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28162024-10-30T14:17:39.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28172024-10-30T14:17:39.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.504482ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28182024-10-30T14:17:39.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28192024-10-30T14:17:39.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28202024-10-30T14:17:39.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28212024-10-30T14:17:39.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28222024-10-30T14:17:39.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28232024-10-30T14:17:39.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28242024-10-30T14:17:39.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
28252024-10-30T14:17:39.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28262024-10-30T14:17:39.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28272024-10-30T14:17:39.440ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
28282024-10-30T14:17:39.440ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.445653ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
28292024-10-30T14:17:40.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5e2fc83b-35d2-4222-9348-d828cfeb24fb roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28302024-10-30T14:17:40.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5e2fc83b-35d2-4222-9348-d828cfeb24fb resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28312024-10-30T14:17:40.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5e2fc83b-35d2-4222-9348-d828cfeb24fb response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28322024-10-30T14:17:40.847ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36487
28332024-10-30T14:17:40.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36487 req_id = 7d4f0ce1-940b-4747-bc43-186317c040d1 roles = RoleSet { roles: {} } uri = /metrics/producers
28342024-10-30T14:17:40.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36487 req_id = 7d4f0ce1-940b-4747-bc43-186317c040d1 resource = Database result = Ok(()) uri = /metrics/producers
28352024-10-30T14:17:40.884ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 8b1f385c-ab41-4fc7-98ed-4c3cf5f8458d
28362024-10-30T14:17:40.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37470 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36487 req_id = 7d4f0ce1-940b-4747-bc43-186317c040d1 response_code = 201 uri = /metrics/producers
28372024-10-30T14:17:41.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e3ba6a6a-0333-4b7f-a331-bcd7de46b3e5 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28382024-10-30T14:17:41.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e3ba6a6a-0333-4b7f-a331-bcd7de46b3e5 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28392024-10-30T14:17:41.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e3ba6a6a-0333-4b7f-a331-bcd7de46b3e5 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28402024-10-30T14:17:41.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 77e7d2c4-3d3c-4c44-b81d-4fb014535b6e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
28412024-10-30T14:17:41.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 77e7d2c4-3d3c-4c44-b81d-4fb014535b6e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
28422024-10-30T14:17:41.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3451 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 77e7d2c4-3d3c-4c44-b81d-4fb014535b6e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
28432024-10-30T14:17:42.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 056519d4-226c-4617-a8bd-ec2afff16510 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28442024-10-30T14:17:42.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 056519d4-226c-4617-a8bd-ec2afff16510 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28452024-10-30T14:17:42.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 056519d4-226c-4617-a8bd-ec2afff16510 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28462024-10-30T14:17:43.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ff2e01ec-7af4-4b1c-8970-343f8ab445e0 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28472024-10-30T14:17:43.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ff2e01ec-7af4-4b1c-8970-343f8ab445e0 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28482024-10-30T14:17:43.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ff2e01ec-7af4-4b1c-8970-343f8ab445e0 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28492024-10-30T14:17:43.403ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:49201
28502024-10-30T14:17:43.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49201 req_id = f59892ed-8f80-4671-8df9-1e501d8afa0a roles = RoleSet { roles: {} } uri = /metrics/producers
28512024-10-30T14:17:43.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49201 req_id = f59892ed-8f80-4671-8df9-1e501d8afa0a resource = Database result = Ok(()) uri = /metrics/producers
28522024-10-30T14:17:43.412ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = e1387952-eca6-4979-9c49-a3d6657c9659
28532024-10-30T14:17:43.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9197 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49201 req_id = f59892ed-8f80-4671-8df9-1e501d8afa0a response_code = 201 uri = /metrics/producers
28542024-10-30T14:17:43.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 3b6bb343-256b-4fd9-9d03-44423ecaccd2 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
28552024-10-30T14:17:43.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 3b6bb343-256b-4fd9-9d03-44423ecaccd2 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
28562024-10-30T14:17:43.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 3b6bb343-256b-4fd9-9d03-44423ecaccd2 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
28572024-10-30T14:17:43.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 129c3ff1-f3c8-43e9-bccc-154e7f08df81 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
28582024-10-30T14:17:43.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 129c3ff1-f3c8-43e9-bccc-154e7f08df81 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
28592024-10-30T14:17:43.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 129c3ff1-f3c8-43e9-bccc-154e7f08df81 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
28602024-10-30T14:17:43.723ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:56016
28612024-10-30T14:17:43.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56016 req_id = 379ba526-6e4f-4e6e-be1e-0f0a86c7aadb roles = RoleSet { roles: {} } uri = /metrics/producers
28622024-10-30T14:17:43.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56016 req_id = 379ba526-6e4f-4e6e-be1e-0f0a86c7aadb resource = Database result = Ok(()) uri = /metrics/producers
28632024-10-30T14:17:43.731ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 25ed936f-01bc-4d77-82c8-0c6af0320a9a
28642024-10-30T14:17:43.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8647 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56016 req_id = 379ba526-6e4f-4e6e-be1e-0f0a86c7aadb response_code = 201 uri = /metrics/producers
28652024-10-30T14:17:44.339ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53133
28662024-10-30T14:17:44.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53133 req_id = 55eaa3e1-31e0-4e53-b198-8daada022470 roles = RoleSet { roles: {} } uri = /metrics/producers
28672024-10-30T14:17:44.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53133 req_id = 55eaa3e1-31e0-4e53-b198-8daada022470 resource = Database result = Ok(()) uri = /metrics/producers
28682024-10-30T14:17:44.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c838765d-8686-4ca1-9589-a313cc06306d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28692024-10-30T14:17:44.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c838765d-8686-4ca1-9589-a313cc06306d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28702024-10-30T14:17:44.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c838765d-8686-4ca1-9589-a313cc06306d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28712024-10-30T14:17:44.381ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 8e3800e0-4cba-4ddc-97e5-4f101c72290f
28722024-10-30T14:17:44.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41544 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53133 req_id = 55eaa3e1-31e0-4e53-b198-8daada022470 response_code = 201 uri = /metrics/producers
28732024-10-30T14:17:45.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cb180a6d-0d63-47f5-a1c1-287ea085d650 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28742024-10-30T14:17:45.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cb180a6d-0d63-47f5-a1c1-287ea085d650 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28752024-10-30T14:17:45.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cb180a6d-0d63-47f5-a1c1-287ea085d650 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28762024-10-30T14:17:46.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9430cf10-d48d-4b79-841e-326dd4b8a9b9 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28772024-10-30T14:17:46.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9430cf10-d48d-4b79-841e-326dd4b8a9b9 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28782024-10-30T14:17:46.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9430cf10-d48d-4b79-841e-326dd4b8a9b9 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28792024-10-30T14:17:47.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 112d42eb-8dd2-4cdd-a021-53d13d01582f roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28802024-10-30T14:17:47.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 112d42eb-8dd2-4cdd-a021-53d13d01582f resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28812024-10-30T14:17:47.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 112d42eb-8dd2-4cdd-a021-53d13d01582f response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28822024-10-30T14:17:48.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 39236d0c-f225-475f-851e-ec2f6cb8c7ac roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28832024-10-30T14:17:48.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 39236d0c-f225-475f-851e-ec2f6cb8c7ac resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28842024-10-30T14:17:48.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 39236d0c-f225-475f-851e-ec2f6cb8c7ac response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
28852024-10-30T14:17:49.418ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
28862024-10-30T14:17:49.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28872024-10-30T14:17:49.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28882024-10-30T14:17:49.418ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
28892024-10-30T14:17:49.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28902024-10-30T14:17:49.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28912024-10-30T14:17:49.420ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28922024-10-30T14:17:49.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28932024-10-30T14:17:49.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28942024-10-30T14:17:49.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28952024-10-30T14:17:49.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28962024-10-30T14:17:49.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28972024-10-30T14:17:49.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.843205ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28982024-10-30T14:17:49.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28992024-10-30T14:17:49.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29002024-10-30T14:17:49.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29012024-10-30T14:17:49.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
29022024-10-30T14:17:49.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29032024-10-30T14:17:49.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29042024-10-30T14:17:49.440ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
29052024-10-30T14:17:49.440ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.285227ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
29062024-10-30T14:17:49.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bdb6d8a8-d750-44d3-9911-0c52cca410c8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29072024-10-30T14:17:49.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bdb6d8a8-d750-44d3-9911-0c52cca410c8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29082024-10-30T14:17:49.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bdb6d8a8-d750-44d3-9911-0c52cca410c8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29092024-10-30T14:17:50.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = af1d5466-9c9e-4a2f-b3d0-9529db113ebe roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29102024-10-30T14:17:50.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = af1d5466-9c9e-4a2f-b3d0-9529db113ebe resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29112024-10-30T14:17:50.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1620 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = af1d5466-9c9e-4a2f-b3d0-9529db113ebe response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29122024-10-30T14:17:51.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = de671a3e-ffc3-4c2f-a9b1-9b776daeec41 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29132024-10-30T14:17:51.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = de671a3e-ffc3-4c2f-a9b1-9b776daeec41 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29142024-10-30T14:17:51.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = de671a3e-ffc3-4c2f-a9b1-9b776daeec41 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29152024-10-30T14:17:52.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8c91d443-7c61-4673-b6cf-1e96b4a75f22 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29162024-10-30T14:17:52.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8c91d443-7c61-4673-b6cf-1e96b4a75f22 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29172024-10-30T14:17:52.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8c91d443-7c61-4673-b6cf-1e96b4a75f22 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29182024-10-30T14:17:53.480ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1515 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 2e56a1d0-6a13-43d1-875e-31ec5a556036 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
29192024-10-30T14:17:53.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ced4b395-c3f1-44e8-88bb-a87fa5c77ee5 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29202024-10-30T14:17:53.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ced4b395-c3f1-44e8-88bb-a87fa5c77ee5 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29212024-10-30T14:17:53.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = ced4b395-c3f1-44e8-88bb-a87fa5c77ee5 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29222024-10-30T14:17:54.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6662c9ac-5316-49a1-bdce-fb0f4f929dc6 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29232024-10-30T14:17:54.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6662c9ac-5316-49a1-bdce-fb0f4f929dc6 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29242024-10-30T14:17:54.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6662c9ac-5316-49a1-bdce-fb0f4f929dc6 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29252024-10-30T14:17:55.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3063da18-a78a-4555-987f-b1c7e5baa093 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29262024-10-30T14:17:55.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3063da18-a78a-4555-987f-b1c7e5baa093 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29272024-10-30T14:17:55.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3063da18-a78a-4555-987f-b1c7e5baa093 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29282024-10-30T14:17:56.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7f767675-69ab-4ac1-b379-3ba0dcfe3b5a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29292024-10-30T14:17:56.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7f767675-69ab-4ac1-b379-3ba0dcfe3b5a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29302024-10-30T14:17:56.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7f767675-69ab-4ac1-b379-3ba0dcfe3b5a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29312024-10-30T14:17:57.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b4de35f-ab59-4d82-b04b-47e5f80ff10d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29322024-10-30T14:17:57.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b4de35f-ab59-4d82-b04b-47e5f80ff10d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29332024-10-30T14:17:57.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8b4de35f-ab59-4d82-b04b-47e5f80ff10d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29342024-10-30T14:17:58.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 697bf6d5-1188-41d2-81d0-9fc5c6a2da9a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29352024-10-30T14:17:58.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 697bf6d5-1188-41d2-81d0-9fc5c6a2da9a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29362024-10-30T14:17:58.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 697bf6d5-1188-41d2-81d0-9fc5c6a2da9a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
29372024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
29382024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
29392024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29402024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
29412024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29422024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
29432024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
29442024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29452024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
29462024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29472024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
29482024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29492024-10-30T14:17:59.419ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29502024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29512024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29522024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29532024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29542024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29552024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29562024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
29572024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
29582024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29592024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29602024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
29612024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29622024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
29632024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29642024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
29652024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29662024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29672024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29682024-10-30T14:17:59.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29692024-10-30T14:17:59.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29702024-10-30T14:17:59.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29712024-10-30T14:17:59.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29722024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
29732024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.22\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29742024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
29752024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
29762024-10-30T14:17:59.422ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29772024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29782024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.3\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
29792024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
29802024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
29812024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.21\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
29822024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.551\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
29832024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29842024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29852024-10-30T14:17:59.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29862024-10-30T14:17:59.423ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.894026ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29872024-10-30T14:17:59.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29882024-10-30T14:17:59.423ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33440, tv_nsec: 612090202 } })
29892024-10-30T14:17:59.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902024-10-30T14:17:59.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
29912024-10-30T14:17:59.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29922024-10-30T14:17:59.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29932024-10-30T14:17:59.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29942024-10-30T14:17:59.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29952024-10-30T14:17:59.426ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29962024-10-30T14:17:59.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29972024-10-30T14:17:59.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29982024-10-30T14:17:59.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29992024-10-30T14:17:59.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30002024-10-30T14:17:59.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30012024-10-30T14:17:59.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30022024-10-30T14:17:59.427ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33440, tv_nsec: 615809184 } })
30032024-10-30T14:17:59.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30042024-10-30T14:17:59.427ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
30052024-10-30T14:17:59.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30062024-10-30T14:17:59.429ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30072024-10-30T14:17:59.429ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30082024-10-30T14:17:59.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30092024-10-30T14:17:59.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30102024-10-30T14:17:59.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30112024-10-30T14:17:59.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30122024-10-30T14:17:59.430ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30132024-10-30T14:17:59.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30142024-10-30T14:17:59.430ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30152024-10-30T14:17:59.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30162024-10-30T14:17:59.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30172024-10-30T14:17:59.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30182024-10-30T14:17:59.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30192024-10-30T14:17:59.431ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30202024-10-30T14:17:59.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30212024-10-30T14:17:59.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30222024-10-30T14:17:59.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30232024-10-30T14:17:59.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30242024-10-30T14:17:59.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30252024-10-30T14:17:59.434ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33440, tv_nsec: 622591438 } })
30262024-10-30T14:17:59.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30272024-10-30T14:17:59.434ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
30282024-10-30T14:17:59.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.180786ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30292024-10-30T14:17:59.435ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30302024-10-30T14:17:59.435ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30312024-10-30T14:17:59.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30322024-10-30T14:17:59.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30332024-10-30T14:17:59.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30342024-10-30T14:17:59.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30352024-10-30T14:17:59.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30362024-10-30T14:17:59.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30372024-10-30T14:17:59.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30382024-10-30T14:17:59.437ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30392024-10-30T14:17:59.437ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30402024-10-30T14:17:59.437ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 16.519119ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30412024-10-30T14:17:59.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30422024-10-30T14:17:59.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30432024-10-30T14:17:59.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30442024-10-30T14:17:59.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30452024-10-30T14:17:59.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30462024-10-30T14:17:59.438ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30472024-10-30T14:17:59.438ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.103082ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30482024-10-30T14:17:59.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
30492024-10-30T14:17:59.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30502024-10-30T14:17:59.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30512024-10-30T14:17:59.446ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
30522024-10-30T14:17:59.446ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.532552ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
30532024-10-30T14:17:59.455ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30542024-10-30T14:17:59.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30552024-10-30T14:17:59.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30562024-10-30T14:17:59.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.565284ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30572024-10-30T14:17:59.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30582024-10-30T14:17:59.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30592024-10-30T14:17:59.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30602024-10-30T14:17:59.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30612024-10-30T14:17:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 963ac472-284b-4429-931a-df4a09f45485, lookup_type: ById(963ac472-284b-4429-931a-df4a09f45485) } result = Ok(())
30622024-10-30T14:17:59.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30632024-10-30T14:17:59.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30642024-10-30T14:17:59.465ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 45.882129ms iteration = 12 status = 0
30652024-10-30T14:17:59.535ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
30662024-10-30T14:17:59.535ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30672024-10-30T14:17:59.535ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41d80424-3b86-4491-b38a-8eba22ef3e24", "content-length": "26", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
30682024-10-30T14:17:59.535ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30692024-10-30T14:17:59.538ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30702024-10-30T14:17:59.555ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 zone_address = fd00:1122:3344:101::2
30712024-10-30T14:17:59.555ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30722024-10-30T14:17:59.555ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20248a57-c055-4f49-8835-55b46803e509", "content-length": "26", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
30732024-10-30T14:17:59.555ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30742024-10-30T14:17:59.556ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 136.365059ms iteration = 15 status = {"physical_disks_added":0}
30752024-10-30T14:17:59.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30762024-10-30T14:17:59.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30772024-10-30T14:17:59.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
30782024-10-30T14:17:59.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30792024-10-30T14:17:59.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30802024-10-30T14:17:59.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30812024-10-30T14:17:59.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30822024-10-30T14:17:59.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30832024-10-30T14:17:59.564ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30842024-10-30T14:17:59.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30852024-10-30T14:17:59.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30862024-10-30T14:17:59.654ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
30872024-10-30T14:17:59.654ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30882024-10-30T14:17:59.654ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "72d5f174-c9ef-496a-b917-f127bd096e7d", "content-length": "26", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
30892024-10-30T14:17:59.654ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30902024-10-30T14:17:59.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30912024-10-30T14:17:59.656ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30922024-10-30T14:17:59.656ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30932024-10-30T14:17:59.656ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30942024-10-30T14:17:59.657ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fb34f0e-bec4-49a3-8897-c95dd4c28c11", "content-length": "2", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
30952024-10-30T14:17:59.657ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7b0f0d7-0b0a-46b9-90ce-ea79922889f6", "content-length": "372", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
30962024-10-30T14:17:59.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30972024-10-30T14:17:59.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30982024-10-30T14:17:59.658ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30992024-10-30T14:17:59.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31002024-10-30T14:17:59.665ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 245.568459ms iteration = 12 status = null
31012024-10-30T14:17:59.672ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
31022024-10-30T14:17:59.672ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
31032024-10-30T14:17:59.673ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "31936518-42c4-43b7-89df-4ae456ec1aa5", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
31042024-10-30T14:17:59.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31052024-10-30T14:17:59.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31062024-10-30T14:17:59.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31072024-10-30T14:17:59.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31082024-10-30T14:17:59.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 77cda0bc-a330-4571-8b74-9a7afae01dc4 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31092024-10-30T14:17:59.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 77cda0bc-a330-4571-8b74-9a7afae01dc4 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31102024-10-30T14:17:59.680ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31112024-10-30T14:17:59.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31122024-10-30T14:17:59.727ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.210746ms iteration = 12 status = {}
31132024-10-30T14:17:59.730ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31142024-10-30T14:17:59.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 77cda0bc-a330-4571-8b74-9a7afae01dc4 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31152024-10-30T14:17:59.734ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31162024-10-30T14:17:59.734ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31172024-10-30T14:17:59.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31182024-10-30T14:17:59.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31192024-10-30T14:17:59.766ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9704a443-267a-4c29-90f6-c5d616116fea, rack_id: 1e7155fc-ddca-45d5-a711-7b3b989aed61, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(498615ba-af90-4d49-8ca5-0cf4d1a30c69) } rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
31202024-10-30T14:17:59.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31212024-10-30T14:17:59.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31222024-10-30T14:17:59.776ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31232024-10-30T14:17:59.776ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f93c75f-14ee-4776-9df0-169b12bb791b", "content-length": "121", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
31242024-10-30T14:17:59.776ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
31252024-10-30T14:17:59.776ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 498615ba-af90-4d49-8ca5-0cf4d1a30c69
31262024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31272024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31282024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31292024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31302024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31312024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31322024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31332024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31342024-10-30T14:17:59.777ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
31352024-10-30T14:17:59.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31362024-10-30T14:17:59.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31372024-10-30T14:17:59.778ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31382024-10-30T14:17:59.778ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c594eac4-df1c-4da3-99e6-e82aea0832d1", "content-length": "2", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
31392024-10-30T14:17:59.778ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31402024-10-30T14:17:59.779ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7896f821-9efb-4756-9b3e-4bcd7bfebbe6", "content-length": "52", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
31412024-10-30T14:17:59.779ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
31422024-10-30T14:17:59.779ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31432024-10-30T14:17:59.819ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3c26fbff-252a-4d6d-8340-dcc9d29a1128", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
31442024-10-30T14:17:59.821ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 398.246192ms iteration = 14 status = {}
31452024-10-30T14:17:59.821ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea5beb02-fcce-4de3-83e3-2b4f2e5b69b0", "content-length": "691", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
31462024-10-30T14:17:59.821ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31472024-10-30T14:17:59.821ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31482024-10-30T14:17:59.821ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31492024-10-30T14:17:59.822ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 400.966857ms iteration = 13 status = {}
31502024-10-30T14:17:59.915ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c7703e11-9285-4770-8bf1-f5154f4fc32a", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
31512024-10-30T14:17:59.915ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch = Switch0
31522024-10-30T14:17:59.915ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31532024-10-30T14:17:59.916ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "03c59a3b-4a3a-4fd3-8e71-6c2d949a37c7", "content-length": "669", "date": "Wed, 30 Oct 2024 14:17:59 GMT"} })
31542024-10-30T14:17:59.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31552024-10-30T14:17:59.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31562024-10-30T14:17:59.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31572024-10-30T14:17:59.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31582024-10-30T14:17:59.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31592024-10-30T14:17:59.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31602024-10-30T14:17:59.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31612024-10-30T14:17:59.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31622024-10-30T14:17:59.930ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 509.858138ms iteration = 12 status = {}
31632024-10-30T14:18:00.816ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
31642024-10-30T14:18:00.816ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
31652024-10-30T14:18:00.846ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
31662024-10-30T14:18:00.847ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:39870
31672024-10-30T14:18:00.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8af25820-d826-419e-914d-1f4738d04bf1 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31682024-10-30T14:18:00.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39870 req_id = b05ff3b2-9b78-4eec-aaa3-ca9a88a93863 roles = RoleSet { roles: {} } uri = /metrics/producers
31692024-10-30T14:18:00.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8af25820-d826-419e-914d-1f4738d04bf1 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31702024-10-30T14:18:00.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39870 req_id = b05ff3b2-9b78-4eec-aaa3-ca9a88a93863 resource = Database result = Ok(()) uri = /metrics/producers
31712024-10-30T14:18:00.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 8af25820-d826-419e-914d-1f4738d04bf1 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31722024-10-30T14:18:00.865ZINFOnexus: assigned collector to new producer collector_id = c94cb0fe-1cb2-41d6-85b5-5d16177d879c file = nexus/src/app/oximeter.rs:76 producer_id = 62f94fcd-b9d8-4397-9be2-9288fe2e213e
31732024-10-30T14:18:00.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 17842 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39870 req_id = b05ff3b2-9b78-4eec-aaa3-ca9a88a93863 response_code = 201 uri = /metrics/producers
31742024-10-30T14:18:00.865ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b05ff3b2-9b78-4eec-aaa3-ca9a88a93863", "content-length": "41", "date": "Wed, 30 Oct 2024 14:18:00 GMT"} })
31752024-10-30T14:18:00.866ZDEBGnexus (producer-registration-task): registered with nexus successfully
31762024-10-30T14:18:00.866ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
31772024-10-30T14:18:01.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bd208b53-f364-4626-88cb-174676585a10 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31782024-10-30T14:18:01.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bd208b53-f364-4626-88cb-174676585a10 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31792024-10-30T14:18:01.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = bd208b53-f364-4626-88cb-174676585a10 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31802024-10-30T14:18:02.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1694698a-6455-4e5a-ae82-ab047ab916c4 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31812024-10-30T14:18:02.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1694698a-6455-4e5a-ae82-ab047ab916c4 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31822024-10-30T14:18:02.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1694698a-6455-4e5a-ae82-ab047ab916c4 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31832024-10-30T14:18:03.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a6d28dfb-6fa9-4dd5-b4a4-9afc3491dfb1 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31842024-10-30T14:18:03.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a6d28dfb-6fa9-4dd5-b4a4-9afc3491dfb1 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31852024-10-30T14:18:03.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a6d28dfb-6fa9-4dd5-b4a4-9afc3491dfb1 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31862024-10-30T14:18:04.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = dabf7f52-4c20-465e-80d0-da3d9ed40f1a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31872024-10-30T14:18:04.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = dabf7f52-4c20-465e-80d0-da3d9ed40f1a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31882024-10-30T14:18:04.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = dabf7f52-4c20-465e-80d0-da3d9ed40f1a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31892024-10-30T14:18:05.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5657506a-cb20-4c7b-acce-d503f518aff8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31902024-10-30T14:18:05.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5657506a-cb20-4c7b-acce-d503f518aff8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31912024-10-30T14:18:05.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5657506a-cb20-4c7b-acce-d503f518aff8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31922024-10-30T14:18:06.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d70c7b91-c9bc-4cfe-a49e-8acf2f0900b4 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31932024-10-30T14:18:06.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d70c7b91-c9bc-4cfe-a49e-8acf2f0900b4 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31942024-10-30T14:18:06.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d70c7b91-c9bc-4cfe-a49e-8acf2f0900b4 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31952024-10-30T14:18:08.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7d936401-71c6-4926-b6e7-c910b6c6cb97 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31962024-10-30T14:18:08.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7d936401-71c6-4926-b6e7-c910b6c6cb97 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31972024-10-30T14:18:08.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 7d936401-71c6-4926-b6e7-c910b6c6cb97 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
31982024-10-30T14:18:08.487ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1706 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = 89367712-9933-4ccd-9bdf-446f4cae2978 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
31992024-10-30T14:18:09.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3edc6c9d-63e2-4c9d-b073-52f2570e76d5 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32002024-10-30T14:18:09.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3edc6c9d-63e2-4c9d-b073-52f2570e76d5 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32012024-10-30T14:18:09.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 3edc6c9d-63e2-4c9d-b073-52f2570e76d5 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32022024-10-30T14:18:09.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
32032024-10-30T14:18:09.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32042024-10-30T14:18:09.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32052024-10-30T14:18:09.427ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
32062024-10-30T14:18:09.427ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32072024-10-30T14:18:09.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32082024-10-30T14:18:09.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32092024-10-30T14:18:09.428ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32102024-10-30T14:18:09.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32112024-10-30T14:18:09.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.698171ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32122024-10-30T14:18:09.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32132024-10-30T14:18:09.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32142024-10-30T14:18:09.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32152024-10-30T14:18:09.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32162024-10-30T14:18:09.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32172024-10-30T14:18:09.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182024-10-30T14:18:09.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
32192024-10-30T14:18:09.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32202024-10-30T14:18:09.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32212024-10-30T14:18:09.443ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
32222024-10-30T14:18:09.443ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.750423ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
32232024-10-30T14:18:10.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0242f343-5b7e-421c-b35b-665c7ed59bb2 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32242024-10-30T14:18:10.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0242f343-5b7e-421c-b35b-665c7ed59bb2 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32252024-10-30T14:18:10.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 0242f343-5b7e-421c-b35b-665c7ed59bb2 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32262024-10-30T14:18:11.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d81407c3-435e-40e9-aa77-556d3cf08a9c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32272024-10-30T14:18:11.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d81407c3-435e-40e9-aa77-556d3cf08a9c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32282024-10-30T14:18:11.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1714 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d81407c3-435e-40e9-aa77-556d3cf08a9c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32292024-10-30T14:18:11.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 2f480daa-0df1-4c9e-ad4a-05bd6ca33cec roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
32302024-10-30T14:18:11.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 2f480daa-0df1-4c9e-ad4a-05bd6ca33cec resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
32312024-10-30T14:18:11.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 2f480daa-0df1-4c9e-ad4a-05bd6ca33cec response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
32322024-10-30T14:18:12.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f3cd59fd-689c-4843-9cec-14855c3437c0 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32332024-10-30T14:18:12.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f3cd59fd-689c-4843-9cec-14855c3437c0 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32342024-10-30T14:18:12.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f3cd59fd-689c-4843-9cec-14855c3437c0 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32352024-10-30T14:18:13.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 746f5e84-1c2a-453a-aa1e-2971ec1ee077 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32362024-10-30T14:18:13.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 746f5e84-1c2a-453a-aa1e-2971ec1ee077 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32372024-10-30T14:18:13.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 746f5e84-1c2a-453a-aa1e-2971ec1ee077 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32382024-10-30T14:18:14.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9d046097-6806-4d04-bfa4-a278344b02f4 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32392024-10-30T14:18:14.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9d046097-6806-4d04-bfa4-a278344b02f4 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32402024-10-30T14:18:14.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2591 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9d046097-6806-4d04-bfa4-a278344b02f4 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32412024-10-30T14:18:15.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a09e1add-fdd6-4d40-babd-2e18998b0f04 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32422024-10-30T14:18:15.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a09e1add-fdd6-4d40-babd-2e18998b0f04 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32432024-10-30T14:18:15.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a09e1add-fdd6-4d40-babd-2e18998b0f04 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32442024-10-30T14:18:16.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b42533a8-f5eb-4ca8-b8a0-4c60c8393092 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32452024-10-30T14:18:16.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b42533a8-f5eb-4ca8-b8a0-4c60c8393092 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32462024-10-30T14:18:16.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b42533a8-f5eb-4ca8-b8a0-4c60c8393092 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32472024-10-30T14:18:17.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2b418cac-c106-42c6-b1ab-13f628cca10a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32482024-10-30T14:18:17.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2b418cac-c106-42c6-b1ab-13f628cca10a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32492024-10-30T14:18:17.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2b418cac-c106-42c6-b1ab-13f628cca10a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32502024-10-30T14:18:18.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 688fe35b-ae46-46ac-8dd2-30e700d2812d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32512024-10-30T14:18:18.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 688fe35b-ae46-46ac-8dd2-30e700d2812d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32522024-10-30T14:18:18.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 688fe35b-ae46-46ac-8dd2-30e700d2812d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32532024-10-30T14:18:19.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b1ea8236-3de2-45f0-b64d-4c05c4799634 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32542024-10-30T14:18:19.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b1ea8236-3de2-45f0-b64d-4c05c4799634 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32552024-10-30T14:18:19.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = b1ea8236-3de2-45f0-b64d-4c05c4799634 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32562024-10-30T14:18:19.423ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
32572024-10-30T14:18:19.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32582024-10-30T14:18:19.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32592024-10-30T14:18:19.424ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
32602024-10-30T14:18:19.424ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32612024-10-30T14:18:19.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32622024-10-30T14:18:19.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32632024-10-30T14:18:19.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32642024-10-30T14:18:19.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32652024-10-30T14:18:19.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.918036ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32662024-10-30T14:18:19.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32672024-10-30T14:18:19.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32682024-10-30T14:18:19.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32692024-10-30T14:18:19.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32702024-10-30T14:18:19.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32712024-10-30T14:18:19.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32722024-10-30T14:18:19.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
32732024-10-30T14:18:19.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32742024-10-30T14:18:19.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32752024-10-30T14:18:19.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
32762024-10-30T14:18:19.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.212686ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
32772024-10-30T14:18:20.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c440fe93-b952-40c8-ae5e-dec9f546561c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32782024-10-30T14:18:20.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c440fe93-b952-40c8-ae5e-dec9f546561c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32792024-10-30T14:18:20.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c440fe93-b952-40c8-ae5e-dec9f546561c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32802024-10-30T14:18:21.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f8d65062-8995-49dd-9781-16b51a17b8e1 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32812024-10-30T14:18:21.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f8d65062-8995-49dd-9781-16b51a17b8e1 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32822024-10-30T14:18:21.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = f8d65062-8995-49dd-9781-16b51a17b8e1 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32832024-10-30T14:18:22.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 61e98ddf-e31c-4a83-b4ba-8da21c711e1c roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32842024-10-30T14:18:22.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 61e98ddf-e31c-4a83-b4ba-8da21c711e1c resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32852024-10-30T14:18:22.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 61e98ddf-e31c-4a83-b4ba-8da21c711e1c response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32862024-10-30T14:18:23.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 83f74d5b-bebd-4fe8-abc4-7aa11ca2ad1d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32872024-10-30T14:18:23.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 83f74d5b-bebd-4fe8-abc4-7aa11ca2ad1d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32882024-10-30T14:18:23.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 83f74d5b-bebd-4fe8-abc4-7aa11ca2ad1d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32892024-10-30T14:18:23.483ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1655 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = d649f17e-0491-41c0-8185-9becb81023ae response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
32902024-10-30T14:18:24.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5165f3a8-51c2-4b5c-be08-e29195ffd985 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32912024-10-30T14:18:24.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5165f3a8-51c2-4b5c-be08-e29195ffd985 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32922024-10-30T14:18:24.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5165f3a8-51c2-4b5c-be08-e29195ffd985 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32932024-10-30T14:18:25.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d32b913d-1675-45be-bcea-dd72e1d86341 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32942024-10-30T14:18:25.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d32b913d-1675-45be-bcea-dd72e1d86341 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32952024-10-30T14:18:25.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d32b913d-1675-45be-bcea-dd72e1d86341 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32962024-10-30T14:18:26.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a8ffb292-7d3c-45a7-9710-348668bc0177 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32972024-10-30T14:18:26.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a8ffb292-7d3c-45a7-9710-348668bc0177 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32982024-10-30T14:18:26.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a8ffb292-7d3c-45a7-9710-348668bc0177 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
32992024-10-30T14:18:27.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d6ab38a9-3063-4d33-924a-cc74890418c8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
33002024-10-30T14:18:27.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d6ab38a9-3063-4d33-924a-cc74890418c8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
33012024-10-30T14:18:27.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d6ab38a9-3063-4d33-924a-cc74890418c8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
33022024-10-30T14:18:28.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1074d12e-f594-4fd3-a4f5-b0e8080de48d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
33032024-10-30T14:18:28.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1074d12e-f594-4fd3-a4f5-b0e8080de48d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
33042024-10-30T14:18:28.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1074d12e-f594-4fd3-a4f5-b0e8080de48d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
33052024-10-30T14:18:28.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 84b03e8a-26c8-41db-9911-1e10df33ff9c roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
33062024-10-30T14:18:28.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 84b03e8a-26c8-41db-9911-1e10df33ff9c resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
33072024-10-30T14:18:28.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2659 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 84b03e8a-26c8-41db-9911-1e10df33ff9c response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
33082024-10-30T14:18:28.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 1eccc715-96fd-4cd6-af66-8326a3711676 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
33092024-10-30T14:18:28.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 1eccc715-96fd-4cd6-af66-8326a3711676 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
33102024-10-30T14:18:28.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = 1eccc715-96fd-4cd6-af66-8326a3711676 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
33112024-10-30T14:18:29.421ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
33122024-10-30T14:18:29.421ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
33132024-10-30T14:18:29.421ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
33142024-10-30T14:18:29.421ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33152024-10-30T14:18:29.421ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33162024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
33172024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
33182024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33192024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33202024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
33212024-10-30T14:18:29.422ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854
33222024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
33232024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33242024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.551\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854"}
33252024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
33262024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33272024-10-30T14:18:29.422ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33282024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
33292024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33302024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33312024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
33322024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
33332024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
33342024-10-30T14:18:29.422ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-30 14:08:29.422048559 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33352024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33362024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
33372024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
33382024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33392024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33402024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33412024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33422024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
33432024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
33442024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33452024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
33462024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
33472024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33482024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33492024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33502024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33512024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33522024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33532024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33542024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33552024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33562024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33572024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33582024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33592024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33602024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33612024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33622024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
33632024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
33642024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33652024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33662024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
33672024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33682024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
33692024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33702024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33712024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33722024-10-30T14:18:29.422ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("62825ae7-d0e8-4554-b47e-377bf9997852.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a5a8b395-0169-4688-a9f0-b29d7a7c4214.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a5a8b395-0169-4688-a9f0-b29d7a7c4214.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 33470, tv_nsec: 608402782 } })
33732024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33742024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33752024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33762024-10-30T14:18:29.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33772024-10-30T14:18:29.422ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d63b0d7-b7b2-4bc1-b329-13e53ae58f30.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d00dc1a3-b063-4364-8a39-247d9fd1eb38.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d40e7162-26ca-4c45-932d-9e6f8cedacab.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d40e7162-26ca-4c45-932d-9e6f8cedacab.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 33470, tv_nsec: 608584937 } })
33782024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33792024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33802024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33812024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
33822024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.182662ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
33832024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
33842024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.347727ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
33852024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
33862024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33872024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33882024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
33892024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33902024-10-30T14:18:29.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33912024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33922024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33932024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
33942024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
33952024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.8\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
33962024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.96\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
33972024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
33982024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
33992024-10-30T14:18:29.424ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
34002024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
34012024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.23\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34022024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.04\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34032024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34042024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
34052024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
34062024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
34072024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
34082024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34092024-10-30T14:18:29.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34102024-10-30T14:18:29.425ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33470, tv_nsec: 610582511 } })
34112024-10-30T14:18:29.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34122024-10-30T14:18:29.425ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
34132024-10-30T14:18:29.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34142024-10-30T14:18:29.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34152024-10-30T14:18:29.426ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34162024-10-30T14:18:29.426ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.232405ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34172024-10-30T14:18:29.426ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33470, tv_nsec: 612204836 } })
34182024-10-30T14:18:29.426ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
34192024-10-30T14:18:29.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34202024-10-30T14:18:29.428ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34212024-10-30T14:18:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34222024-10-30T14:18:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34232024-10-30T14:18:29.428ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34242024-10-30T14:18:29.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34252024-10-30T14:18:29.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34262024-10-30T14:18:29.429ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34272024-10-30T14:18:29.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34282024-10-30T14:18:29.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34292024-10-30T14:18:29.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34302024-10-30T14:18:29.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34312024-10-30T14:18:29.433ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34322024-10-30T14:18:29.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34332024-10-30T14:18:29.435ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34342024-10-30T14:18:29.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34352024-10-30T14:18:29.435ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-30 14:08:29.422048559 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34362024-10-30T14:18:29.435ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.771175ms iteration = 7 status = {"expiration":"2024-10-30T14:08:29.422048559Z","pruned":[]}
34372024-10-30T14:18:29.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34382024-10-30T14:18:29.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34392024-10-30T14:18:29.438ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34402024-10-30T14:18:29.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34412024-10-30T14:18:29.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34422024-10-30T14:18:29.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34432024-10-30T14:18:29.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34442024-10-30T14:18:29.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34452024-10-30T14:18:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34462024-10-30T14:18:29.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34472024-10-30T14:18:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34482024-10-30T14:18:29.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34492024-10-30T14:18:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34502024-10-30T14:18:29.440ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34512024-10-30T14:18:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34522024-10-30T14:18:29.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34532024-10-30T14:18:29.440ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34542024-10-30T14:18:29.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34552024-10-30T14:18:29.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34562024-10-30T14:18:29.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34572024-10-30T14:18:29.442ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34582024-10-30T14:18:29.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34592024-10-30T14:18:29.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34602024-10-30T14:18:29.444ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34612024-10-30T14:18:29.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34622024-10-30T14:18:29.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34632024-10-30T14:18:29.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34642024-10-30T14:18:29.446ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34652024-10-30T14:18:29.446ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34662024-10-30T14:18:29.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34672024-10-30T14:18:29.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34682024-10-30T14:18:29.446ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34692024-10-30T14:18:29.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34702024-10-30T14:18:29.446ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34712024-10-30T14:18:29.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34722024-10-30T14:18:29.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34732024-10-30T14:18:29.447ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.634046ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
34742024-10-30T14:18:29.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34752024-10-30T14:18:29.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34762024-10-30T14:18:29.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34772024-10-30T14:18:29.448ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34782024-10-30T14:18:29.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34792024-10-30T14:18:29.450ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34802024-10-30T14:18:29.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34812024-10-30T14:18:29.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34822024-10-30T14:18:29.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34832024-10-30T14:18:29.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34842024-10-30T14:18:29.454ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-963ac472-284b-4429-931a-df4a09f45485.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 33470, tv_nsec: 639913859 } })
34852024-10-30T14:18:29.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
34862024-10-30T14:18:29.457ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34872024-10-30T14:18:29.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34882024-10-30T14:18:29.457ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
34892024-10-30T14:18:29.457ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
34902024-10-30T14:18:29.457ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
34912024-10-30T14:18:29.457ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34922024-10-30T14:18:29.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34932024-10-30T14:18:29.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34942024-10-30T14:18:29.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34952024-10-30T14:18:29.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34962024-10-30T14:18:29.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34972024-10-30T14:18:29.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34982024-10-30T14:18:29.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34992024-10-30T14:18:29.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.632715ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35002024-10-30T14:18:29.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35012024-10-30T14:18:29.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35022024-10-30T14:18:29.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35032024-10-30T14:18:29.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35042024-10-30T14:18:29.466ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35052024-10-30T14:18:29.466ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35062024-10-30T14:18:29.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35072024-10-30T14:18:29.466ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 44.817669ms iteration = 4 status = {"nsuccess":5}
35082024-10-30T14:18:29.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35092024-10-30T14:18:29.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35102024-10-30T14:18:29.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35112024-10-30T14:18:29.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35122024-10-30T14:18:29.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35132024-10-30T14:18:29.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35142024-10-30T14:18:29.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35152024-10-30T14:18:29.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35162024-10-30T14:18:29.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35172024-10-30T14:18:29.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35182024-10-30T14:18:29.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35192024-10-30T14:18:29.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35202024-10-30T14:18:29.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35212024-10-30T14:18:29.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35222024-10-30T14:18:29.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
35232024-10-30T14:18:29.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35242024-10-30T14:18:29.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35252024-10-30T14:18:29.476ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35262024-10-30T14:18:29.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1c4f91df-6387-4230-bbdf-44eda6408705 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
35272024-10-30T14:18:29.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1c4f91df-6387-4230-bbdf-44eda6408705 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
35282024-10-30T14:18:29.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1c4f91df-6387-4230-bbdf-44eda6408705 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
35292024-10-30T14:18:29.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35302024-10-30T14:18:29.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35312024-10-30T14:18:29.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35322024-10-30T14:18:29.492ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
35332024-10-30T14:18:29.492ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
35342024-10-30T14:18:29.492ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 68.142094ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
35352024-10-30T14:18:29.495ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
35362024-10-30T14:18:29.495ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.273983ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
35372024-10-30T14:18:29.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35382024-10-30T14:18:29.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35392024-10-30T14:18:29.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35402024-10-30T14:18:29.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35412024-10-30T14:18:29.517ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35422024-10-30T14:18:29.517ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35432024-10-30T14:18:29.517ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 95.061746ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35442024-10-30T14:18:29.526ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35452024-10-30T14:18:29.526ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35462024-10-30T14:18:29.526ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35472024-10-30T14:18:29.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35482024-10-30T14:18:29.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35492024-10-30T14:18:29.531ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35502024-10-30T14:18:29.531ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 108.765919ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35512024-10-30T14:18:29.531ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35522024-10-30T14:18:29.531ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35532024-10-30T14:18:29.531ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.765792ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35542024-10-30T14:18:29.533ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35552024-10-30T14:18:29.533ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 7aaf8c85-7de8-4dba-ba3c-bea52a7650b0 dns_zone_name = oxide.test found_so_far = 0 version = 2
35562024-10-30T14:18:29.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35572024-10-30T14:18:29.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35582024-10-30T14:18:29.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35592024-10-30T14:18:29.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35602024-10-30T14:18:29.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.415552ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35612024-10-30T14:18:29.595ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35622024-10-30T14:18:29.595ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 172.093491ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35632024-10-30T14:18:29.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35642024-10-30T14:18:29.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35652024-10-30T14:18:29.613ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.864069ms iteration = 16 status = {"physical_disks_added":0}
35662024-10-30T14:18:29.677ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35672024-10-30T14:18:29.677ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35682024-10-30T14:18:29.677ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b25ec495-5a0b-4d58-aaa5-818776d0fd02", "content-length": "372", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
35692024-10-30T14:18:29.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35702024-10-30T14:18:29.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35712024-10-30T14:18:29.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35722024-10-30T14:18:29.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35732024-10-30T14:18:29.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35742024-10-30T14:18:29.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35752024-10-30T14:18:29.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35762024-10-30T14:18:29.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35772024-10-30T14:18:29.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35782024-10-30T14:18:29.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35792024-10-30T14:18:29.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35802024-10-30T14:18:29.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35812024-10-30T14:18:29.686ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 7aaf8c85-7de8-4dba-ba3c-bea52a7650b0 dns_zone_name = oxide.test found_so_far = 1 version = 2
35822024-10-30T14:18:29.686ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35832024-10-30T14:18:29.686ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-30 14:12:59.359161 UTC dns_group = external generation = 2
35842024-10-30T14:18:29.686ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 264.840943ms iteration = 8 status = {"generation":2}
35852024-10-30T14:18:29.694ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
35862024-10-30T14:18:29.694ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
35872024-10-30T14:18:29.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4366ee96-3d48-452f-a7bc-12c7b316bafe", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
35882024-10-30T14:18:29.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35892024-10-30T14:18:29.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35902024-10-30T14:18:29.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35912024-10-30T14:18:29.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35922024-10-30T14:18:29.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35932024-10-30T14:18:29.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35942024-10-30T14:18:29.703ZINFOnexus (BackgroundTasks): VPC route manager sled 963ac472-284b-4429-931a-df4a09f45485 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
35952024-10-30T14:18:29.703ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35962024-10-30T14:18:29.704ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bef58f91-5594-4d93-bc06-fb46bb39e733", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
35972024-10-30T14:18:29.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35982024-10-30T14:18:29.706ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 281.683612ms iteration = 15 status = {}
35992024-10-30T14:18:29.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36002024-10-30T14:18:29.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36012024-10-30T14:18:29.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36022024-10-30T14:18:29.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36032024-10-30T14:18:29.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36042024-10-30T14:18:29.708ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36052024-10-30T14:18:29.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36062024-10-30T14:18:29.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36072024-10-30T14:18:29.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36082024-10-30T14:18:29.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 963ac472-284b-4429-931a-df4a09f45485, lookup_type: ById(963ac472-284b-4429-931a-df4a09f45485) } result = Ok(())
36092024-10-30T14:18:29.713ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36102024-10-30T14:18:29.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36112024-10-30T14:18:29.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36122024-10-30T14:18:29.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36132024-10-30T14:18:29.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36142024-10-30T14:18:29.715ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 293.929845ms iteration = 13 status = 0
36152024-10-30T14:18:29.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36162024-10-30T14:18:29.726ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36172024-10-30T14:18:29.742ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
36182024-10-30T14:18:29.742ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 036a00d3-1b62-4bb7-8512-8a6cf898e068 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
36192024-10-30T14:18:29.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36202024-10-30T14:18:29.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36212024-10-30T14:18:29.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36222024-10-30T14:18:29.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36232024-10-30T14:18:29.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36242024-10-30T14:18:29.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36252024-10-30T14:18:29.749ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 036a00d3-1b62-4bb7-8512-8a6cf898e068 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
36262024-10-30T14:18:29.749ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36272024-10-30T14:18:29.749ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-30 14:12:58.822178 UTC dns_group = internal generation = 1
36282024-10-30T14:18:29.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 327.423436ms iteration = 8 status = {"generation":1}
36292024-10-30T14:18:29.754ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-30T14:12:28.404860Z, time_modified: 2024-10-30T14:12:28.404860Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, db_silo: Silo { identity: SiloIdentity { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-30T14:12:59.312829Z, time_modified: 2024-10-30T14:12:59.312829Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, db_silo: Silo { identity: SiloIdentity { id: 22dad6d2-ee23-4f02-97b3-ce34a7d929db, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-30T14:12:59.312829Z, time_modified: 2024-10-30T14:12:59.312829Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48" }] }) }
36302024-10-30T14:18:29.754ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 332.146575ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","tls_certs":["1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48"]}},"default_endpoint":{"silo_id":"22dad6d2-ee23-4f02-97b3-ce34a7d929db","tls_certs":["1f81dbbac9b6a6e8f009b82680d8c941005a72e7aa3a87bb95bb00d8958b3c48"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36312024-10-30T14:18:29.804ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
36322024-10-30T14:18:29.804ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36332024-10-30T14:18:29.804ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c5ba6a5-45cf-4f32-b6a7-741bd0a863c9", "content-length": "26", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
36342024-10-30T14:18:29.804ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36352024-10-30T14:18:29.806ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36362024-10-30T14:18:29.827ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
36372024-10-30T14:18:29.827ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36382024-10-30T14:18:29.827ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "527e3706-6f3a-41ee-bb26-d1161024bdd0", "content-length": "26", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
36392024-10-30T14:18:29.827ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36402024-10-30T14:18:29.829ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36412024-10-30T14:18:29.853ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 zone_address = fd00:1122:3344:101::2
36422024-10-30T14:18:29.853ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36432024-10-30T14:18:29.853ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dd223fa-ab9f-4595-8b59-a8f9d5cecad6", "content-length": "26", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
36442024-10-30T14:18:29.853ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36452024-10-30T14:18:29.854ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
36462024-10-30T14:18:30.000ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 578.821594ms iteration = 13 status = {}
36472024-10-30T14:18:30.042ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36482024-10-30T14:18:30.047ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
36492024-10-30T14:18:30.047ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f7b02369-7044-4c45-9b4d-a1c2c60f7b9d", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36502024-10-30T14:18:30.047ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36512024-10-30T14:18:30.049ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "19ca84e6-7503-4a1d-a799-e90c70451460", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36522024-10-30T14:18:30.049ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36532024-10-30T14:18:30.050ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36542024-10-30T14:18:30.050ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 628.64795ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36552024-10-30T14:18:30.058ZDEBGnexus (BackgroundTasks): client request SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36562024-10-30T14:18:30.058ZDEBGnexus (BackgroundTasks): client response SledAgent = 963ac472-284b-4429-931a-df4a09f45485 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "369502c1-49eb-4624-850b-71e7047dcad8", "content-length": "691", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
36572024-10-30T14:18:30.058ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
36582024-10-30T14:18:30.058ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
36592024-10-30T14:18:30.058ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
36602024-10-30T14:18:30.060ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 638.058415ms iteration = 14 status = {}
36612024-10-30T14:18:30.077ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36622024-10-30T14:18:30.077ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f78880d7-00b7-4a62-a713-e480dfbed10b", "content-length": "2", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
36632024-10-30T14:18:30.078ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36642024-10-30T14:18:30.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36652024-10-30T14:18:30.080ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 659.129769ms iteration = 13 status = null
36662024-10-30T14:18:30.117ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36672024-10-30T14:18:30.117ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2e7a9a54-c6da-4df6-a602-1883395b7565", "date": "Wed, 30 Oct 2024 14:18:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36682024-10-30T14:18:30.117ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36692024-10-30T14:18:30.118ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "885d556d-49cc-438d-bde7-b4abb1a12e97", "date": "Wed, 30 Oct 2024 14:18:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36702024-10-30T14:18:30.118ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36712024-10-30T14:18:30.120ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3eaa44f9-494a-4838-b01c-bb3cafa6e529", "date": "Wed, 30 Oct 2024 14:18:30 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36722024-10-30T14:18:30.120ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36732024-10-30T14:18:30.122ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36742024-10-30T14:18:30.122ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 701.015768ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36752024-10-30T14:18:30.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36762024-10-30T14:18:30.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36772024-10-30T14:18:30.152ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 9704a443-267a-4c29-90f6-c5d616116fea, rack_id: 1e7155fc-ddca-45d5-a711-7b3b989aed61, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(498615ba-af90-4d49-8ca5-0cf4d1a30c69) } rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
36782024-10-30T14:18:30.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36792024-10-30T14:18:30.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36802024-10-30T14:18:30.165ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36812024-10-30T14:18:30.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e3b4548-93f5-4b5d-a234-4c5bd5e2f3a0", "content-length": "121", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
36822024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
36832024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 498615ba-af90-4d49-8ca5-0cf4d1a30c69
36842024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36852024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36862024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36872024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36882024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36892024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36902024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36912024-10-30T14:18:30.166ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36922024-10-30T14:18:30.167ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61
36932024-10-30T14:18:30.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36942024-10-30T14:18:30.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36952024-10-30T14:18:30.169ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36962024-10-30T14:18:30.169ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f9bc57e-95a7-43eb-ade4-be1fe04f0a5f", "content-length": "2", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
36972024-10-30T14:18:30.169ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36982024-10-30T14:18:30.169ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8960aff8-04ee-42e9-9236-6b581316dfe7", "content-length": "52", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
36992024-10-30T14:18:30.169ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch_location = Switch0
37002024-10-30T14:18:30.169ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37012024-10-30T14:18:30.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e1e7eec9-6665-4050-866a-bf2752dff399", "date": "Wed, 30 Oct 2024 14:18:30 GMT"} })
37022024-10-30T14:18:30.269ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 switch = Switch0
37032024-10-30T14:18:30.269ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37042024-10-30T14:18:30.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 1e7155fc-ddca-45d5-a711-7b3b989aed61 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5aeb926-3052-4612-9ca2-304b33f48a84", "content-length": "669", "date": "Wed, 30 Oct 2024 14:18:29 GMT"} })
37052024-10-30T14:18:30.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37062024-10-30T14:18:30.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37072024-10-30T14:18:30.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37082024-10-30T14:18:30.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37092024-10-30T14:18:30.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37102024-10-30T14:18:30.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37112024-10-30T14:18:30.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37122024-10-30T14:18:30.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37132024-10-30T14:18:30.286ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 864.677701ms iteration = 13 status = {}
37142024-10-30T14:18:30.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 44731aea-8ad5-47b5-a166-e999e8fd751a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37152024-10-30T14:18:30.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 44731aea-8ad5-47b5-a166-e999e8fd751a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37162024-10-30T14:18:30.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 44731aea-8ad5-47b5-a166-e999e8fd751a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37172024-10-30T14:18:31.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1b8660d0-24c6-436a-b207-fdf9e55a0b74 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37182024-10-30T14:18:31.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1b8660d0-24c6-436a-b207-fdf9e55a0b74 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37192024-10-30T14:18:31.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 1b8660d0-24c6-436a-b207-fdf9e55a0b74 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37202024-10-30T14:18:32.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d03a64cd-c616-4b02-a16a-00341ac3113d roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37212024-10-30T14:18:32.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d03a64cd-c616-4b02-a16a-00341ac3113d resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37222024-10-30T14:18:32.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = d03a64cd-c616-4b02-a16a-00341ac3113d response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37232024-10-30T14:18:33.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 49843c63-937b-4344-ab1b-f89cf9388c54 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37242024-10-30T14:18:33.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 49843c63-937b-4344-ab1b-f89cf9388c54 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37252024-10-30T14:18:33.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 49843c63-937b-4344-ab1b-f89cf9388c54 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37262024-10-30T14:18:34.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6d552e33-f93e-46fc-8abd-942f260e4f57 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37272024-10-30T14:18:34.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6d552e33-f93e-46fc-8abd-942f260e4f57 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37282024-10-30T14:18:34.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6d552e33-f93e-46fc-8abd-942f260e4f57 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37292024-10-30T14:18:35.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c928b5a8-8d6c-4cae-b4a7-083539c5be32 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37302024-10-30T14:18:35.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c928b5a8-8d6c-4cae-b4a7-083539c5be32 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37312024-10-30T14:18:35.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = c928b5a8-8d6c-4cae-b4a7-083539c5be32 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37322024-10-30T14:18:36.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2565938e-2be7-4569-a904-4c3e5a93f3e1 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37332024-10-30T14:18:36.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2565938e-2be7-4569-a904-4c3e5a93f3e1 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37342024-10-30T14:18:36.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2565938e-2be7-4569-a904-4c3e5a93f3e1 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37352024-10-30T14:18:37.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9bf7c186-c275-4426-a469-8e712343e91a roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37362024-10-30T14:18:37.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9bf7c186-c275-4426-a469-8e712343e91a resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37372024-10-30T14:18:37.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9bf7c186-c275-4426-a469-8e712343e91a response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37382024-10-30T14:18:38.486ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1725 local_addr = [fd00:1122:3344:101::b]:33916 method = GET remote_addr = [fd00:1122:3344:101::d]:47390 req_id = d96d05a4-4ba8-449c-9cb7-979f157c3029 response_code = 200 uri = /62f94fcd-b9d8-4397-9be2-9288fe2e213e
37392024-10-30T14:18:38.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 010fea4a-39ae-44cc-b85f-4da18a9a14d8 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37402024-10-30T14:18:38.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 010fea4a-39ae-44cc-b85f-4da18a9a14d8 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37412024-10-30T14:18:38.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 010fea4a-39ae-44cc-b85f-4da18a9a14d8 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37422024-10-30T14:18:39.425ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
37432024-10-30T14:18:39.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37442024-10-30T14:18:39.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37452024-10-30T14:18:39.426ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
37462024-10-30T14:18:39.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37472024-10-30T14:18:39.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37482024-10-30T14:18:39.427ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37492024-10-30T14:18:39.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37502024-10-30T14:18:39.430ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37512024-10-30T14:18:39.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37522024-10-30T14:18:39.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37532024-10-30T14:18:39.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37542024-10-30T14:18:39.433ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37552024-10-30T14:18:39.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
37562024-10-30T14:18:39.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37572024-10-30T14:18:39.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37582024-10-30T14:18:39.445ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
37592024-10-30T14:18:39.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.2333ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}
37602024-10-30T14:18:39.453ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37612024-10-30T14:18:39.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37622024-10-30T14:18:39.487ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.319668ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37632024-10-30T14:18:39.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2086f9c9-35a5-4e37-9810-015b5fad4582 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37642024-10-30T14:18:39.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2086f9c9-35a5-4e37-9810-015b5fad4582 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37652024-10-30T14:18:39.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 2086f9c9-35a5-4e37-9810-015b5fad4582 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37662024-10-30T14:18:40.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cb4d4c6e-2fe2-4fb7-bfa6-12ff6ee5638e roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37672024-10-30T14:18:40.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cb4d4c6e-2fe2-4fb7-bfa6-12ff6ee5638e resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37682024-10-30T14:18:40.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = cb4d4c6e-2fe2-4fb7-bfa6-12ff6ee5638e response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37692024-10-30T14:18:41.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 77422eb0-ce20-45f8-934a-4ee49cb68949 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
37702024-10-30T14:18:41.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 77422eb0-ce20-45f8-934a-4ee49cb68949 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
37712024-10-30T14:18:41.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:62644 req_id = 77422eb0-ce20-45f8-934a-4ee49cb68949 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
37722024-10-30T14:18:41.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a39c37e6-a559-4760-9f74-f5c12601d938 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37732024-10-30T14:18:41.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a39c37e6-a559-4760-9f74-f5c12601d938 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37742024-10-30T14:18:41.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = a39c37e6-a559-4760-9f74-f5c12601d938 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37752024-10-30T14:18:42.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6edb5f9d-9b56-45d2-8f85-0564cde44cc7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37762024-10-30T14:18:42.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6edb5f9d-9b56-45d2-8f85-0564cde44cc7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37772024-10-30T14:18:42.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 6edb5f9d-9b56-45d2-8f85-0564cde44cc7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37782024-10-30T14:18:43.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = c67bd383-5511-48da-9787-e0ae7b7f9879 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
37792024-10-30T14:18:43.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = c67bd383-5511-48da-9787-e0ae7b7f9879 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
37802024-10-30T14:18:43.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = c67bd383-5511-48da-9787-e0ae7b7f9879 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?sort_by=id_ascending
37812024-10-30T14:18:43.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = dfc1e7f9-144b-4f12-b777-4fe35a91e9c9 roles = RoleSet { roles: {} } uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
37822024-10-30T14:18:43.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = dfc1e7f9-144b-4f12-b777-4fe35a91e9c9 resource = Database result = Ok(()) uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
37832024-10-30T14:18:43.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40622 req_id = dfc1e7f9-144b-4f12-b777-4fe35a91e9c9 response_code = 200 uri = /metrics/collectors/c94cb0fe-1cb2-41d6-85b5-5d16177d879c/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMmI1NmY5MS1iMjYwLTRjMDAtYTc4NC0zOTcxYzUyZWJmZTAifX0%3D
37842024-10-30T14:18:43.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e30431d6-95ac-4bea-a855-4adf317fe3c5 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37852024-10-30T14:18:43.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e30431d6-95ac-4bea-a855-4adf317fe3c5 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37862024-10-30T14:18:43.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = e30431d6-95ac-4bea-a855-4adf317fe3c5 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37872024-10-30T14:18:44.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9a97bc2c-cfb8-449f-aa0b-3fbb34b8ea54 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37882024-10-30T14:18:44.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9a97bc2c-cfb8-449f-aa0b-3fbb34b8ea54 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37892024-10-30T14:18:44.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 9a97bc2c-cfb8-449f-aa0b-3fbb34b8ea54 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37902024-10-30T14:18:45.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4d8bc1be-fba3-4d7c-8d98-9069324bd861 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37912024-10-30T14:18:45.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4d8bc1be-fba3-4d7c-8d98-9069324bd861 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37922024-10-30T14:18:45.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 4d8bc1be-fba3-4d7c-8d98-9069324bd861 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37932024-10-30T14:18:46.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 46b6e396-4664-47f6-bdb5-8a3136a1bcf7 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37942024-10-30T14:18:46.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 46b6e396-4664-47f6-bdb5-8a3136a1bcf7 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37952024-10-30T14:18:46.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 46b6e396-4664-47f6-bdb5-8a3136a1bcf7 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37962024-10-30T14:18:47.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5a547173-be63-472d-8d7e-9b4e8147fc91 roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37972024-10-30T14:18:47.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5a547173-be63-472d-8d7e-9b4e8147fc91 resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37982024-10-30T14:18:47.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 5a547173-be63-472d-8d7e-9b4e8147fc91 response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
37992024-10-30T14:18:48.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 93994869-a9af-4625-b428-d749c5514fac roles = RoleSet { roles: {} } uri = /probes/963ac472-284b-4429-931a-df4a09f45485
38002024-10-30T14:18:48.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 93994869-a9af-4625-b428-d749c5514fac resource = Database result = Ok(()) uri = /probes/963ac472-284b-4429-931a-df4a09f45485
38012024-10-30T14:18:48.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33537 req_id = 93994869-a9af-4625-b428-d749c5514fac response_code = 200 uri = /probes/963ac472-284b-4429-931a-df4a09f45485
38022024-10-30T14:18:49.426ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
38032024-10-30T14:18:49.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042024-10-30T14:18:49.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38052024-10-30T14:18:49.426ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
38062024-10-30T14:18:49.426ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38072024-10-30T14:18:49.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38082024-10-30T14:18:49.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38092024-10-30T14:18:49.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38102024-10-30T14:18:49.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38112024-10-30T14:18:49.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.239165ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38122024-10-30T14:18:49.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38132024-10-30T14:18:49.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38142024-10-30T14:18:49.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38152024-10-30T14:18:49.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38162024-10-30T14:18:49.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38172024-10-30T14:18:49.434ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38182024-10-30T14:18:49.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 2bc39137-1f9f-496f-926a-f3641d4a8854, lookup_type: ById(2bc39137-1f9f-496f-926a-f3641d4a8854) } result = Ok(())
38192024-10-30T14:18:49.436ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38202024-10-30T14:18:49.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38212024-10-30T14:18:49.442ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 original_time_created = 2024-10-30 14:12:15.543544 UTC target_id = 2bc39137-1f9f-496f-926a-f3641d4a8854 time_created = 2024-10-30 14:12:15.543544 UTC
38222024-10-30T14:18:49.442ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.417037ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"2bc39137-1f9f-496f-926a-f3641d4a8854","time_created":"2024-10-30T14:12:15.543544Z"}