Max level shown:
12025-01-09T01:45:01.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5e752c9-8dc4-4aac-b4ef-639d223819ab roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22025-01-09T01:45:01.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5e752c9-8dc4-4aac-b4ef-639d223819ab resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
32025-01-09T01:45:01.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5e752c9-8dc4-4aac-b4ef-639d223819ab response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
42025-01-09T01:45:01.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f9f8404e-8c62-4bbc-afba-3dbbce8667a9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/7?limit=100
52025-01-09T01:45:01.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f9f8404e-8c62-4bbc-afba-3dbbce8667a9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/7?limit=100
62025-01-09T01:45:01.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = f9f8404e-8c62-4bbc-afba-3dbbce8667a9 response_code = 200 uri = /nat/ipv4/changeset/7?limit=100
72025-01-09T01:45:01.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = d5f1d21e-21d6-4751-88bd-d59e7f1cff2c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
82025-01-09T01:45:01.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = d5f1d21e-21d6-4751-88bd-d59e7f1cff2c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
92025-01-09T01:45:01.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = d5f1d21e-21d6-4751-88bd-d59e7f1cff2c response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
102025-01-09T01:45:02.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 571ef368-38c5-41e2-b547-6b067e1dd760 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
112025-01-09T01:45:02.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 571ef368-38c5-41e2-b547-6b067e1dd760 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
122025-01-09T01:45:02.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 571ef368-38c5-41e2-b547-6b067e1dd760 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
132025-01-09T01:45:03.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3f89890d-5ad2-4c1c-a0ee-e536d6d8639b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
142025-01-09T01:45:03.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3f89890d-5ad2-4c1c-a0ee-e536d6d8639b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
152025-01-09T01:45:03.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3f89890d-5ad2-4c1c-a0ee-e536d6d8639b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
162025-01-09T01:45:04.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 638809fa-477b-4605-8d2e-18b37f1df909 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
172025-01-09T01:45:04.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 638809fa-477b-4605-8d2e-18b37f1df909 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
182025-01-09T01:45:04.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 638809fa-477b-4605-8d2e-18b37f1df909 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
192025-01-09T01:45:05.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3fe9649d-2431-40a5-bbb8-efef9bca81d1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
202025-01-09T01:45:05.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3fe9649d-2431-40a5-bbb8-efef9bca81d1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
212025-01-09T01:45:05.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3fe9649d-2431-40a5-bbb8-efef9bca81d1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
222025-01-09T01:45:06.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6cb9068e-8bab-4127-876f-9d7be2c813d0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
232025-01-09T01:45:06.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6cb9068e-8bab-4127-876f-9d7be2c813d0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
242025-01-09T01:45:06.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6cb9068e-8bab-4127-876f-9d7be2c813d0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
252025-01-09T01:45:06.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
262025-01-09T01:45:06.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
272025-01-09T01:45:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
282025-01-09T01:45:06.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
292025-01-09T01:45:06.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
302025-01-09T01:45:06.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
312025-01-09T01:45:06.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
322025-01-09T01:45:06.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
332025-01-09T01:45:06.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
342025-01-09T01:45:06.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352025-01-09T01:45:06.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362025-01-09T01:45:06.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
372025-01-09T01:45:06.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
382025-01-09T01:45:06.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
392025-01-09T01:45:06.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.817162ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
402025-01-09T01:45:06.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
412025-01-09T01:45:06.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
422025-01-09T01:45:06.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432025-01-09T01:45:06.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
442025-01-09T01:45:06.688ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
452025-01-09T01:45:06.688ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.857941ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
462025-01-09T01:45:07.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f9b0dbcf-9c29-42c4-a23a-5a4dd7ad10e8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
472025-01-09T01:45:07.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f9b0dbcf-9c29-42c4-a23a-5a4dd7ad10e8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
482025-01-09T01:45:07.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f9b0dbcf-9c29-42c4-a23a-5a4dd7ad10e8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
492025-01-09T01:45:08.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd0693e1-baf0-4a5f-b89a-d298341b48c3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
502025-01-09T01:45:08.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd0693e1-baf0-4a5f-b89a-d298341b48c3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
512025-01-09T01:45:08.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cd0693e1-baf0-4a5f-b89a-d298341b48c3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
522025-01-09T01:45:09.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 591 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = a6d285fc-5569-47b0-b2ca-f010ffe8ff42 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
532025-01-09T01:45:09.338ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 21332269-3433-4c4e-a1b8-e3fcb41c18ef uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-09T01:45:09.321701159Z }
542025-01-09T01:45:09.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 21332269-3433-4c4e-a1b8-e3fcb41c18ef roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
552025-01-09T01:45:09.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 21332269-3433-4c4e-a1b8-e3fcb41c18ef resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
562025-01-09T01:45:09.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35655 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 21332269-3433-4c4e-a1b8-e3fcb41c18ef response_code = 204 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
572025-01-09T01:45:09.357ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1165ec4c-912b-4f43-b5c8-d301081a4328 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-09T01:45:09.357769309Z }
582025-01-09T01:45:09.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1165ec4c-912b-4f43-b5c8-d301081a4328 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
592025-01-09T01:45:09.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1165ec4c-912b-4f43-b5c8-d301081a4328 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
602025-01-09T01:45:09.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38037 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1165ec4c-912b-4f43-b5c8-d301081a4328 response_code = 204 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
612025-01-09T01:45:09.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b76dc2de-808d-424b-9387-3c81f873173b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
622025-01-09T01:45:09.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b76dc2de-808d-424b-9387-3c81f873173b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
632025-01-09T01:45:09.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b76dc2de-808d-424b-9387-3c81f873173b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
642025-01-09T01:45:10.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d33f6437-4eee-48ac-8dc8-b30818fee017 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
652025-01-09T01:45:10.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d33f6437-4eee-48ac-8dc8-b30818fee017 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
662025-01-09T01:45:10.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d33f6437-4eee-48ac-8dc8-b30818fee017 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
672025-01-09T01:45:11.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f5936644-0a9b-47d2-aabc-d91a4619d45b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
682025-01-09T01:45:11.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f5936644-0a9b-47d2-aabc-d91a4619d45b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
692025-01-09T01:45:11.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f5936644-0a9b-47d2-aabc-d91a4619d45b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
702025-01-09T01:45:12.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d09c22c-fe28-4a57-8d24-142ec618d652 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
712025-01-09T01:45:12.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d09c22c-fe28-4a57-8d24-142ec618d652 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
722025-01-09T01:45:12.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d09c22c-fe28-4a57-8d24-142ec618d652 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
732025-01-09T01:45:13.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 21c66529-b77c-4a6c-89f5-0ecd96eb4883 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
742025-01-09T01:45:13.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 21c66529-b77c-4a6c-89f5-0ecd96eb4883 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
752025-01-09T01:45:13.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 21c66529-b77c-4a6c-89f5-0ecd96eb4883 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
762025-01-09T01:45:14.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = e5974f49-a741-44d7-975b-86e0d9bb6413 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
772025-01-09T01:45:14.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = e5974f49-a741-44d7-975b-86e0d9bb6413 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
782025-01-09T01:45:14.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = e5974f49-a741-44d7-975b-86e0d9bb6413 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
792025-01-09T01:45:14.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4571438d-e995-40e7-8465-4e54aa7c0630 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
802025-01-09T01:45:14.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4571438d-e995-40e7-8465-4e54aa7c0630 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
812025-01-09T01:45:14.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4571438d-e995-40e7-8465-4e54aa7c0630 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
822025-01-09T01:45:14.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 124c0712-d193-494c-8231-fd3f9f800913 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
832025-01-09T01:45:14.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 124c0712-d193-494c-8231-fd3f9f800913 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
842025-01-09T01:45:14.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 124c0712-d193-494c-8231-fd3f9f800913 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
852025-01-09T01:45:15.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7fdea6cd-b8d4-419b-bc89-47faf9a99671 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
862025-01-09T01:45:15.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7fdea6cd-b8d4-419b-bc89-47faf9a99671 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
872025-01-09T01:45:15.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7fdea6cd-b8d4-419b-bc89-47faf9a99671 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
882025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
892025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
902025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
912025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
922025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
942025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
952025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
962025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
972025-01-09T01:45:16.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
982025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
992025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
1002025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1012025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
1022025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1032025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
1042025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1052025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1062025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
1072025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1082025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1092025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
1102025-01-09T01:45:16.609ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1112025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1122025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
1132025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1142025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
1152025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1162025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
1172025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1182025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1192025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1202025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1212025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1222025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1232025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1242025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1252025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1262025-01-09T01:45:16.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1272025-01-09T01:45:16.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
1282025-01-09T01:45:16.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1292025-01-09T01:45:16.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
1302025-01-09T01:45:16.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1312025-01-09T01:45:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1322025-01-09T01:45:16.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1332025-01-09T01:45:16.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
1342025-01-09T01:45:16.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
1352025-01-09T01:45:16.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1362025-01-09T01:45:16.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1372025-01-09T01:45:16.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1649, tv_nsec: 8148252 } })
1382025-01-09T01:45:16.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1649, tv_nsec: 8240853 } })
1392025-01-09T01:45:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1402025-01-09T01:45:16.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1412025-01-09T01:45:16.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1422025-01-09T01:45:16.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1432025-01-09T01:45:16.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1442025-01-09T01:45:16.612ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.34262ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1452025-01-09T01:45:16.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1462025-01-09T01:45:16.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1472025-01-09T01:45:16.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1482025-01-09T01:45:16.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1492025-01-09T01:45:16.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1502025-01-09T01:45:16.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1512025-01-09T01:45:16.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1522025-01-09T01:45:16.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1532025-01-09T01:45:16.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1542025-01-09T01:45:16.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1552025-01-09T01:45:16.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1562025-01-09T01:45:16.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1572025-01-09T01:45:16.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1582025-01-09T01:45:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1592025-01-09T01:45:16.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1602025-01-09T01:45:16.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1612025-01-09T01:45:16.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1622025-01-09T01:45:16.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1632025-01-09T01:45:16.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1642025-01-09T01:45:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1652025-01-09T01:45:16.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1662025-01-09T01:45:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1672025-01-09T01:45:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1682025-01-09T01:45:16.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1692025-01-09T01:45:16.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1702025-01-09T01:45:16.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1712025-01-09T01:45:16.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1722025-01-09T01:45:16.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1732025-01-09T01:45:16.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1742025-01-09T01:45:16.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1752025-01-09T01:45:16.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1762025-01-09T01:45:16.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1772025-01-09T01:45:16.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1782025-01-09T01:45:16.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 16.467854ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1792025-01-09T01:45:16.627ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1649, tv_nsec: 23762923 } })
1802025-01-09T01:45:16.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812025-01-09T01:45:16.627ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
1822025-01-09T01:45:16.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1832025-01-09T01:45:16.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1842025-01-09T01:45:16.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1852025-01-09T01:45:16.650ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1862025-01-09T01:45:16.650ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1872025-01-09T01:45:16.650ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1882025-01-09T01:45:16.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1892025-01-09T01:45:16.653ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1902025-01-09T01:45:16.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1912025-01-09T01:45:16.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1922025-01-09T01:45:16.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932025-01-09T01:45:16.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1942025-01-09T01:45:16.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1952025-01-09T01:45:16.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1962025-01-09T01:45:16.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.388438ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1972025-01-09T01:45:16.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1982025-01-09T01:45:16.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.391122ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
1992025-01-09T01:45:16.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2002025-01-09T01:45:16.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
2012025-01-09T01:45:16.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2022025-01-09T01:45:16.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2032025-01-09T01:45:16.675ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2042025-01-09T01:45:16.677ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.616772ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
2052025-01-09T01:45:16.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2062025-01-09T01:45:16.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2072025-01-09T01:45:16.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2082025-01-09T01:45:16.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2092025-01-09T01:45:16.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2102025-01-09T01:45:16.688ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2112025-01-09T01:45:16.688ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2122025-01-09T01:45:16.689ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e104e87-7649-4db5-9753-e9acfce18833", "content-length": "26", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
2132025-01-09T01:45:16.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2142025-01-09T01:45:16.691ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2152025-01-09T01:45:16.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
2162025-01-09T01:45:16.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.201814ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
2172025-01-09T01:45:16.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2182025-01-09T01:45:16.702ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2192025-01-09T01:45:16.703ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "845a4388-d277-489e-85e8-90fbbd68d14f", "content-length": "26", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
2202025-01-09T01:45:16.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2212025-01-09T01:45:16.705ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2222025-01-09T01:45:16.706ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.431177ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2232025-01-09T01:45:16.709ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2242025-01-09T01:45:16.709ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2252025-01-09T01:45:16.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2262025-01-09T01:45:16.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2272025-01-09T01:45:16.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2282025-01-09T01:45:16.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2292025-01-09T01:45:16.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302025-01-09T01:45:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
2312025-01-09T01:45:16.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2322025-01-09T01:45:16.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2332025-01-09T01:45:16.737ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 128.427856ms iteration = 24 status = 0
2342025-01-09T01:45:16.752ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
2352025-01-09T01:45:16.752ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2362025-01-09T01:45:16.752ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a5db25e-ea88-4079-8307-f5bd8094531f", "content-length": "26", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
2372025-01-09T01:45:16.752ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2382025-01-09T01:45:16.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
2392025-01-09T01:45:16.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b573f41d-2646-48de-84fa-efec3f3a1802 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
2402025-01-09T01:45:16.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b573f41d-2646-48de-84fa-efec3f3a1802 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
2412025-01-09T01:45:16.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b573f41d-2646-48de-84fa-efec3f3a1802 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
2422025-01-09T01:45:16.764ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2432025-01-09T01:45:16.764ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2442025-01-09T01:45:16.764ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 155.4033ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2452025-01-09T01:45:16.773ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.865146ms iteration = 27 status = {"physical_disks_added":0}
2462025-01-09T01:45:16.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.423674ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2472025-01-09T01:45:16.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2482025-01-09T01:45:16.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2492025-01-09T01:45:16.820ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2502025-01-09T01:45:16.820ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a94daf0-f7c0-448e-bcff-fb6ac80258ba", "content-length": "1", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
2512025-01-09T01:45:16.821ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2522025-01-09T01:45:16.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2532025-01-09T01:45:16.852ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 244.30224ms iteration = 24 status = {}
2542025-01-09T01:45:16.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2552025-01-09T01:45:16.881ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602/state
2562025-01-09T01:45:16.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2572025-01-09T01:45:16.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2582025-01-09T01:45:16.882ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2592025-01-09T01:45:16.882ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2602025-01-09T01:45:16.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2612025-01-09T01:45:16.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "197e824d-ee1f-4e2c-9055-74652f7cab14", "content-length": "130", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
2622025-01-09T01:45:16.882ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d63f080-c56b-4a77-bea2-c37c241cb46d", "content-length": "583", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
2632025-01-09T01:45:16.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2642025-01-09T01:45:16.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2652025-01-09T01:45:16.884ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 276.574669ms iteration = 24 status = null
2662025-01-09T01:45:16.887ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-09T01:45:09.357769309Z }, migration_in: None, migration_out: None } vmm_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
2672025-01-09T01:45:16.887ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 vmm_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-09T01:45:09.357769309Z }
2682025-01-09T01:45:16.887ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a roles = RoleSet { roles: {} } sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 vmm_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
2692025-01-09T01:45:16.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a resource = Database result = Ok(()) sled_id = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 vmm_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602
2702025-01-09T01:45:16.894ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
2712025-01-09T01:45:16.896ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 287.350713ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
2722025-01-09T01:45:16.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2732025-01-09T01:45:16.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2742025-01-09T01:45:16.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2752025-01-09T01:45:16.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2762025-01-09T01:45:16.954ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {a09f8642-5806-4b50-b24c-be61c2f4d667: {10.151.1.175: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}, 10.151.1.176: {b8f6e2d2-b1ec-49ba-a531-b09470d7b292}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2772025-01-09T01:45:16.954ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2782025-01-09T01:45:16.954ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9d98153b-43e9-428b-9223-d987f2334f5b", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
2792025-01-09T01:45:16.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2802025-01-09T01:45:16.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2812025-01-09T01:45:16.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2822025-01-09T01:45:16.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2832025-01-09T01:45:16.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2842025-01-09T01:45:16.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2852025-01-09T01:45:16.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2862025-01-09T01:45:16.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2872025-01-09T01:45:16.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2882025-01-09T01:45:16.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2892025-01-09T01:45:17.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2902025-01-09T01:45:17.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2912025-01-09T01:45:17.011ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2922025-01-09T01:45:17.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "10feea23-bcf0-4fdb-a74c-8b86c66bd7a8", "content-length": "810", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
2932025-01-09T01:45:17.012ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(2554039) }} sled = buskin
2942025-01-09T01:45:17.012ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2952025-01-09T01:45:17.012ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2962025-01-09T01:45:17.013ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 404.279563ms iteration = 24 status = {}
2972025-01-09T01:45:17.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2982025-01-09T01:45:17.014ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
2992025-01-09T01:45:17.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3002025-01-09T01:45:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3012025-01-09T01:45:17.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3022025-01-09T01:45:17.017ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3032025-01-09T01:45:17.017ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3042025-01-09T01:45:17.018ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3052025-01-09T01:45:17.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "629415f5-202f-40a7-be70-1885736ede8e", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
3062025-01-09T01:45:17.020ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 410.803849ms iteration = 24 status = {}
3072025-01-09T01:45:17.024ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3082025-01-09T01:45:17.025ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "39c583e5-1196-4628-8b93-f7717bb6bbbf", "content-length": "134", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
3092025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3102025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
3112025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3122025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3132025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3142025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3152025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3162025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3172025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3182025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3192025-01-09T01:45:17.025ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
3202025-01-09T01:45:17.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3212025-01-09T01:45:17.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3222025-01-09T01:45:17.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3232025-01-09T01:45:17.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ea27924-c663-4650-8339-56a4ca35c057", "content-length": "2", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
3242025-01-09T01:45:17.031ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3252025-01-09T01:45:17.031ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "87885a08-38b6-48c6-a59c-d120041c7f9f", "content-length": "52", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
3262025-01-09T01:45:17.031ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
3272025-01-09T01:45:17.031ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3282025-01-09T01:45:17.128ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c2114265-e5bc-4f24-a950-2a5fddec6663", "date": "Thu, 09 Jan 2025 01:45:16 GMT"} })
3292025-01-09T01:45:17.128ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
3302025-01-09T01:45:17.128ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3312025-01-09T01:45:17.129ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e06dfedd-e42e-4acb-a49a-0e355f5a955c", "content-length": "682", "date": "Thu, 09 Jan 2025 01:45:17 GMT"} })
3322025-01-09T01:45:17.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3332025-01-09T01:45:17.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3342025-01-09T01:45:17.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3352025-01-09T01:45:17.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3362025-01-09T01:45:17.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3372025-01-09T01:45:17.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3382025-01-09T01:45:17.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3392025-01-09T01:45:17.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3402025-01-09T01:45:17.146ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 536.772344ms iteration = 24 status = {}
3412025-01-09T01:45:17.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59f3afe0-8251-4010-a595-4248d3f438fb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3422025-01-09T01:45:17.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59f3afe0-8251-4010-a595-4248d3f438fb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3432025-01-09T01:45:17.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59f3afe0-8251-4010-a595-4248d3f438fb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3442025-01-09T01:45:18.660ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be8f655c-7536-40a7-b202-9eb99eba3ecb uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-09T01:45:18.659806040Z }
3452025-01-09T01:45:18.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be8f655c-7536-40a7-b202-9eb99eba3ecb roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3462025-01-09T01:45:18.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be8f655c-7536-40a7-b202-9eb99eba3ecb resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3472025-01-09T01:45:18.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44252 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be8f655c-7536-40a7-b202-9eb99eba3ecb response_code = 204 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3482025-01-09T01:45:18.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab983945-9ad8-4410-b13b-aec7941e03ab roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3492025-01-09T01:45:18.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab983945-9ad8-4410-b13b-aec7941e03ab resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3502025-01-09T01:45:18.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab983945-9ad8-4410-b13b-aec7941e03ab response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3512025-01-09T01:45:19.302ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3130 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 5dedeabb-560c-4b61-916a-821c48a42255 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
3522025-01-09T01:45:19.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fb4c5c49-95ab-4bde-a74d-b440dec7a803 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/9?limit=100
3532025-01-09T01:45:19.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fb4c5c49-95ab-4bde-a74d-b440dec7a803 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/9?limit=100
3542025-01-09T01:45:19.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fb4c5c49-95ab-4bde-a74d-b440dec7a803 response_code = 200 uri = /nat/ipv4/changeset/9?limit=100
3552025-01-09T01:45:19.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = e72ef8e5-26b7-4aee-abf1-cb5bf7542960 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
3562025-01-09T01:45:19.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = e72ef8e5-26b7-4aee-abf1-cb5bf7542960 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
3572025-01-09T01:45:19.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = e72ef8e5-26b7-4aee-abf1-cb5bf7542960 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
3582025-01-09T01:45:19.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dac9d49b-4621-4439-a02f-3ed9f5bda427 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3592025-01-09T01:45:19.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dac9d49b-4621-4439-a02f-3ed9f5bda427 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3602025-01-09T01:45:19.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dac9d49b-4621-4439-a02f-3ed9f5bda427 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3612025-01-09T01:45:20.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b3040aee-c6fa-49eb-a9cb-acf7b25d58c1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
3622025-01-09T01:45:20.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b3040aee-c6fa-49eb-a9cb-acf7b25d58c1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
3632025-01-09T01:45:20.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = b3040aee-c6fa-49eb-a9cb-acf7b25d58c1 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
3642025-01-09T01:45:20.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 656cf20d-3f8b-4308-b8a6-393ab5840c76 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3652025-01-09T01:45:20.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 656cf20d-3f8b-4308-b8a6-393ab5840c76 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3662025-01-09T01:45:20.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 656cf20d-3f8b-4308-b8a6-393ab5840c76 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
3672025-01-09T01:45:21.096ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T01:45:21.096023188Z }
3682025-01-09T01:45:21.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3692025-01-09T01:45:21.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3702025-01-09T01:45:21.104ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_needs_update = true
3712025-01-09T01:45:21.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3722025-01-09T01:45:21.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3732025-01-09T01:45:21.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3742025-01-09T01:45:21.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3752025-01-09T01:45:21.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3762025-01-09T01:45:21.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3772025-01-09T01:45:21.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3782025-01-09T01:45:21.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3792025-01-09T01:45:21.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3802025-01-09T01:45:21.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3812025-01-09T01:45:21.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3822025-01-09T01:45:21.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3832025-01-09T01:45:21.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3842025-01-09T01:45:21.147ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f309fae8-595c-4a3f-a884-58b43b6636ce, lookup_type: ById(f309fae8-595c-4a3f-a884-58b43b6636ce) }, key: 223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7, lookup_type: ById(223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7) }, key: 2a287340-c2bb-444f-9fa5-21434d22199a, lookup_type: ById(2a287340-c2bb-444f-9fa5-21434d22199a) } result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3852025-01-09T01:45:21.162ZINFOnexus (dropshot_internal): starting update saga for 2a287340-c2bb-444f-9fa5-21434d22199a actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T01:45:21.096023188Z }
3862025-01-09T01:45:21.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66371 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 response_code = 204 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3872025-01-09T01:45:21.162ZDEBGnexus (dropshot_internal): preparing instance-update saga for 2a287340-c2bb-444f-9fa5-21434d22199a... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b39d452f-4a68-41e3-a52f-5cfe0f6b0ec6 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3882025-01-09T01:45:21.162ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update
3892025-01-09T01:45:21.163ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4191c858-021f-4b80-98b1-f00ea38f6590 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T01:45:21.096023188Z }
3902025-01-09T01:45:21.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4191c858-021f-4b80-98b1-f00ea38f6590 roles = RoleSet { roles: {} } uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3912025-01-09T01:45:21.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4191c858-021f-4b80-98b1-f00ea38f6590 resource = Database result = Ok(()) uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3922025-01-09T01:45:21.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4481 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4191c858-021f-4b80-98b1-f00ea38f6590 response_code = 204 uri = /vmms/3d2ea020-a9fd-4f71-ae3d-38fcefd12602
3932025-01-09T01:45:21.169ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"2a287340-c2bb-444f-9fa5-21434d22199a","lookup_type":{"ById":"2a287340-c2bb-444f-9fa5-21434d22199a"},"parent":{"key":"223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7","lookup_type":{"ById":"223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7"},"parent":{"key":"f309fae8-595c-4a3f-a884-58b43b6636ce","lookup_type":{"ById":"f309fae8-595c-4a3f-a884-58b43b6636ce"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
3942025-01-09T01:45:21.169ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update
3952025-01-09T01:45:21.202ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update
3962025-01-09T01:45:21.202ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
3972025-01-09T01:45:21.202ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
3982025-01-09T01:45:21.202ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
3992025-01-09T01:45:21.206ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4002025-01-09T01:45:21.206ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
4012025-01-09T01:45:21.210ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4022025-01-09T01:45:21.210ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
4032025-01-09T01:45:21.216ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4042025-01-09T01:45:21.216ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("80950f8c-e8b1-470d-8f04-ab68827b949a")) node_id = 0 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
4052025-01-09T01:45:21.219ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4062025-01-09T01:45:21.219ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
4072025-01-09T01:45:21.233ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update
4082025-01-09T01:45:21.238ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4092025-01-09T01:45:21.239ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4102025-01-09T01:45:21.241ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4112025-01-09T01:45:21.241ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4122025-01-09T01:45:21.242ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4132025-01-09T01:45:21.242ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4142025-01-09T01:45:21.246ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4152025-01-09T01:45:21.246ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4162025-01-09T01:45:21.248ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4172025-01-09T01:45:21.248ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4182025-01-09T01:45:21.249ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4192025-01-09T01:45:21.249ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4202025-01-09T01:45:21.251ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4212025-01-09T01:45:21.259ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f309fae8-595c-4a3f-a884-58b43b6636ce, lookup_type: ById(f309fae8-595c-4a3f-a884-58b43b6636ce) }, key: 223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7, lookup_type: ById(223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7) }, key: 2a287340-c2bb-444f-9fa5-21434d22199a, lookup_type: ById(2a287340-c2bb-444f-9fa5-21434d22199a) } result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4222025-01-09T01:45:21.259ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance updater_id = 80950f8c-e8b1-470d-8f04-ab68827b949a
4232025-01-09T01:45:21.259ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4242025-01-09T01:45:21.259ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4252025-01-09T01:45:21.268ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance updater_id = 80950f8c-e8b1-470d-8f04-ab68827b949a
4262025-01-09T01:45:21.268ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4272025-01-09T01:45:21.268ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance
4282025-01-09T01:45:21.273ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a locked_gen = Generation(Generation(2)) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = LockInstance updater_id = 80950f8c-e8b1-470d-8f04-ab68827b949a
4292025-01-09T01:45:21.273ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4302025-01-09T01:45:21.273ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("80950f8c-e8b1-470d-8f04-ab68827b949a")}) node_id = 1 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
4312025-01-09T01:45:21.277ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4322025-01-09T01:45:21.277ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
4332025-01-09T01:45:21.285ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4342025-01-09T01:45:21.285ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4352025-01-09T01:45:21.286ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4362025-01-09T01:45:21.287ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4372025-01-09T01:45:21.288ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4382025-01-09T01:45:21.288ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4392025-01-09T01:45:21.289ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4402025-01-09T01:45:21.292ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f309fae8-595c-4a3f-a884-58b43b6636ce, lookup_type: ById(f309fae8-595c-4a3f-a884-58b43b6636ce) }, key: 223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7, lookup_type: ById(223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7) }, key: 2a287340-c2bb-444f-9fa5-21434d22199a, lookup_type: ById(2a287340-c2bb-444f-9fa5-21434d22199a) } result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4412025-01-09T01:45:21.292ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4422025-01-09T01:45:21.293ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
4432025-01-09T01:45:21.298ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 3d2ea020-a9fd-4f71-ae3d-38fcefd12602, time_created: 2025-01-09T01:45:00.338198Z, time_deleted: None, instance_id: 2a287340-c2bb-444f-9fa5-21434d22199a, sled_id: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-09T01:45:21.096023Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-09T01:44:58.241127Z, gen: Generation(Generation(3)), propolis_id: Some(3d2ea020-a9fd-4f71-ae3d-38fcefd12602), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(3d2ea020-a9fd-4f71-ae3d-38fcefd12602 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-09T01:45:21.298392523Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
4442025-01-09T01:45:21.307ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
4452025-01-09T01:45:21.310ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"2a287340-c2bb-444f-9fa5-21434d22199a","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"3d2ea020-a9fd-4f71-ae3d-38fcefd12602"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"2a287340-c2bb-444f-9fa5-21434d22199a","lookup_type":{"ById":"2a287340-c2bb-444f-9fa5-21434d22199a"},"parent":{"key":"223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7","lookup_type":{"ById":"223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7"},"parent":{"key":"f309fae8-595c-4a3f-a884-58b43b6636ce","lookup_type":{"ById":"f309fae8-595c-4a3f-a884-58b43b6636ce"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"80950f8c-e8b1-470d-8f04-ab68827b949a"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7","ram_diff":1073741824},"destroy_active_vmm":"3d2ea020-a9fd-4f71-ae3d-38fcefd12602","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-09T01:45:21.298392523Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4462025-01-09T01:45:21.310ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
4472025-01-09T01:45:21.313ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
4482025-01-09T01:45:21.313ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4492025-01-09T01:45:21.313ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4502025-01-09T01:45:21.313ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4512025-01-09T01:45:21.317ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4522025-01-09T01:45:21.317ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4532025-01-09T01:45:21.321ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4542025-01-09T01:45:21.321ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4552025-01-09T01:45:21.324ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4562025-01-09T01:45:21.324ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3322ffd5-7913-4d67-87ce-0d2ab664feac")) node_id = 0 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4572025-01-09T01:45:21.328ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4582025-01-09T01:45:21.328ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4592025-01-09T01:45:21.336ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a parent_lock = UpdaterLock { updater_id: 80950f8c-e8b1-470d-8f04-ab68827b949a, locked_gen: Generation(Generation(2)) } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
4602025-01-09T01:45:21.336ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = BecomeUpdater
4612025-01-09T01:45:21.336ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = BecomeUpdater
4622025-01-09T01:45:21.351ZDEBGnexus (SagaExecutor): inherited lock from 80950f8c-e8b1-470d-8f04-ab68827b949a to 3322ffd5-7913-4d67-87ce-0d2ab664feac actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 80950f8c-e8b1-470d-8f04-ab68827b949a saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = BecomeUpdater updater_id = 3322ffd5-7913-4d67-87ce-0d2ab664feac
4632025-01-09T01:45:21.351ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
4642025-01-09T01:45:21.351ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4652025-01-09T01:45:21.351ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("3322ffd5-7913-4d67-87ce-0d2ab664feac")}) node_id = 1 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4662025-01-09T01:45:21.355ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4672025-01-09T01:45:21.355ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4682025-01-09T01:45:21.358ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4692025-01-09T01:45:21.358ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4702025-01-09T01:45:21.361ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4712025-01-09T01:45:21.361ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
4722025-01-09T01:45:21.365ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
4732025-01-09T01:45:21.368ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a
4742025-01-09T01:45:21.368ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UpdateNetworkConfig
4752025-01-09T01:45:21.368ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UpdateNetworkConfig
4762025-01-09T01:45:21.371ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UpdateNetworkConfig
4772025-01-09T01:45:21.371ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UpdateNetworkConfig
4782025-01-09T01:45:21.376ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
4792025-01-09T01:45:21.376ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UpdateNetworkConfig
4802025-01-09T01:45:21.376ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UpdateNetworkConfig
4812025-01-09T01:45:21.377ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
4822025-01-09T01:45:21.378ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
4832025-01-09T01:45:21.378ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
4842025-01-09T01:45:21.379ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
4852025-01-09T01:45:21.381ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
4862025-01-09T01:45:21.381ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
4872025-01-09T01:45:21.381ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
4882025-01-09T01:45:21.384ZDEBGnexus: notifying dendrite of updates instance_id = Some(2a287340-c2bb-444f-9fa5-21434d22199a (instance)) switch = switch0
4892025-01-09T01:45:21.384ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1653, tv_nsec: 781351773 } })
4902025-01-09T01:45:21.385ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
4912025-01-09T01:45:21.415ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
4922025-01-09T01:45:21.415ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4932025-01-09T01:45:21.415ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b43f2e62-5e91-4b10-aa70-8582a53a1d6d", "content-length": "26", "date": "Thu, 09 Jan 2025 01:45:20 GMT"} })
4942025-01-09T01:45:21.415ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4952025-01-09T01:45:21.416ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4962025-01-09T01:45:21.445ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
4972025-01-09T01:45:21.445ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a3daa57-6cfc-4498-8e61-b367fac3494d", "content-length": "4", "date": "Thu, 09 Jan 2025 01:45:20 GMT"} })
4982025-01-09T01:45:21.447ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
4992025-01-09T01:45:21.447ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5002025-01-09T01:45:21.451ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5012025-01-09T01:45:21.451ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5022025-01-09T01:45:21.460ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
5032025-01-09T01:45:21.460ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
5042025-01-09T01:45:21.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9846a9fc-72e5-40ce-ae1d-d3f327c1fee5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
5052025-01-09T01:45:21.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9846a9fc-72e5-40ce-ae1d-d3f327c1fee5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
5062025-01-09T01:45:21.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 9846a9fc-72e5-40ce-ae1d-d3f327c1fee5 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
5072025-01-09T01:45:21.471ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-09T01:45:21.462760Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7, time_modified: Some(2025-01-09T01:45:21.462760Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: f309fae8-595c-4a3f-a884-58b43b6636ce, time_modified: Some(2025-01-09T01:45:21.462760Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5082025-01-09T01:45:21.471ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5092025-01-09T01:45:21.471ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5102025-01-09T01:45:21.475ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5112025-01-09T01:45:21.476ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5122025-01-09T01:45:21.478ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5132025-01-09T01:45:21.479ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UnassignOximeterProducer
5142025-01-09T01:45:21.479ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UnassignOximeterProducer
5152025-01-09T01:45:21.483ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a producer_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5162025-01-09T01:45:21.483ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UnassignOximeterProducer
5172025-01-09T01:45:21.483ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = UnassignOximeterProducer
5182025-01-09T01:45:21.518ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5192025-01-09T01:45:21.521ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/2a287340-c2bb-444f-9fa5-21434d22199a
5202025-01-09T01:45:21.539ZDEBGnexus (SagaExecutor): client response oximeter-collector = 2a287340-c2bb-444f-9fa5-21434d22199a result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/2a287340-c2bb-444f-9fa5-21434d22199a", status: 204, headers: {"x-request-id": "c392c39a-833b-4051-8181-a9cfa08cf568", "date": "Thu, 09 Jan 2025 01:45:21 GMT"} }) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5212025-01-09T01:45:21.539ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a producer_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5222025-01-09T01:45:21.540ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5232025-01-09T01:45:21.540ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5242025-01-09T01:45:21.545ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5252025-01-09T01:45:21.545ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5262025-01-09T01:45:21.551ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a lock = UpdaterLock { updater_id: 3322ffd5-7913-4d67-87ce-0d2ab664feac, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-09T01:45:21.298392523Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5272025-01-09T01:45:21.551ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = CommitInstanceUpdates
5282025-01-09T01:45:21.551ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = CommitInstanceUpdates
5292025-01-09T01:45:21.599ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a new_runtime = InstanceRuntimeState { time_updated: 2025-01-09T01:45:21.298392523Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5302025-01-09T01:45:21.599ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5312025-01-09T01:45:21.599ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
5322025-01-09T01:45:21.599ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5332025-01-09T01:45:21.599ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
5342025-01-09T01:45:21.599ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5352025-01-09T01:45:21.599ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5362025-01-09T01:45:21.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5372025-01-09T01:45:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5382025-01-09T01:45:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5392025-01-09T01:45:21.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5402025-01-09T01:45:21.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5412025-01-09T01:45:21.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5422025-01-09T01:45:21.603ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5432025-01-09T01:45:21.603ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5442025-01-09T01:45:21.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5452025-01-09T01:45:21.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5462025-01-09T01:45:21.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5472025-01-09T01:45:21.606ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5482025-01-09T01:45:21.606ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5492025-01-09T01:45:21.606ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("2a287340-c2bb-444f-9fa5-21434d22199a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3d2ea020-a9fd-4f71-ae3d-38fcefd12602")}) node_id = 7 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5502025-01-09T01:45:21.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5512025-01-09T01:45:21.609ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5522025-01-09T01:45:21.609ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5532025-01-09T01:45:21.613ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5542025-01-09T01:45:21.613ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5552025-01-09T01:45:21.616ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5562025-01-09T01:45:21.616ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5572025-01-09T01:45:21.619ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5582025-01-09T01:45:21.619ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ReleaseSledResources
5592025-01-09T01:45:21.619ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ReleaseSledResources
5602025-01-09T01:45:21.634ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5612025-01-09T01:45:21.634ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5622025-01-09T01:45:21.640ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5632025-01-09T01:45:21.640ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5642025-01-09T01:45:21.643ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a propolis_id = 3d2ea020-a9fd-4f71-ae3d-38fcefd12602 saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5652025-01-09T01:45:21.643ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = MarkVmmDeleted
5662025-01-09T01:45:21.644ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = MarkVmmDeleted
5672025-01-09T01:45:21.654ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5682025-01-09T01:45:21.654ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5692025-01-09T01:45:21.658ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5702025-01-09T01:45:21.658ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5712025-01-09T01:45:21.661ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5722025-01-09T01:45:21.661ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5732025-01-09T01:45:21.664ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5742025-01-09T01:45:21.664ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5752025-01-09T01:45:21.668ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5762025-01-09T01:45:21.668ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5772025-01-09T01:45:21.670ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5782025-01-09T01:45:21.670ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5792025-01-09T01:45:21.671ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5802025-01-09T01:45:21.672ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5812025-01-09T01:45:21.673ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5822025-01-09T01:45:21.676ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f309fae8-595c-4a3f-a884-58b43b6636ce, lookup_type: ById(f309fae8-595c-4a3f-a884-58b43b6636ce) }, key: 223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7, lookup_type: ById(223ce87c-4d0d-44be-a8d7-f6d5bcd08cf7) }, key: 2a287340-c2bb-444f-9fa5-21434d22199a, lookup_type: ById(2a287340-c2bb-444f-9fa5-21434d22199a) } result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5832025-01-09T01:45:21.676ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5842025-01-09T01:45:21.676ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_node = ChainSuccessorSaga
5852025-01-09T01:45:21.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5862025-01-09T01:45:21.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5872025-01-09T01:45:21.700ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
5882025-01-09T01:45:21.700ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5892025-01-09T01:45:21.700ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2be18812-cbf9-4344-84d2-6721d1e94738", "content-length": "372", "date": "Thu, 09 Jan 2025 01:45:21 GMT"} })
5902025-01-09T01:45:21.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5912025-01-09T01:45:21.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5922025-01-09T01:45:21.705ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a karmic_state = WillReincarnate needs_reincarnation = false saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update
5932025-01-09T01:45:21.705ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5942025-01-09T01:45:21.705ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5952025-01-09T01:45:21.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5962025-01-09T01:45:21.708ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
5972025-01-09T01:45:21.708ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
5982025-01-09T01:45:21.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5992025-01-09T01:45:21.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002025-01-09T01:45:21.712ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6012025-01-09T01:45:21.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6022025-01-09T01:45:21.712ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
6032025-01-09T01:45:21.712ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 47be194f-f77e-495d-972b-65e1d108a619
6042025-01-09T01:45:21.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6052025-01-09T01:45:21.715ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 47be194f-f77e-495d-972b-65e1d108a619 sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
6062025-01-09T01:45:21.715ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 47be194f-f77e-495d-972b-65e1d108a619
6072025-01-09T01:45:21.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6082025-01-09T01:45:21.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6092025-01-09T01:45:21.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6102025-01-09T01:45:21.742ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
6112025-01-09T01:45:21.742ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
6122025-01-09T01:45:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6132025-01-09T01:45:21.742ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "86b6eb45-5fd4-4fe0-8b63-3a777917b6c0", "date": "Thu, 09 Jan 2025 01:45:21 GMT"} })
6142025-01-09T01:45:21.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6152025-01-09T01:45:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6162025-01-09T01:45:21.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6172025-01-09T01:45:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6182025-01-09T01:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6192025-01-09T01:45:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6202025-01-09T01:45:21.751ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
6212025-01-09T01:45:21.751ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 47be194f-f77e-495d-972b-65e1d108a619 saga_name = instance-update saga_result = SagaResult { saga_id: 47be194f-f77e-495d-972b-65e1d108a619, saga_log: SagaLog { saga_id: 47be194f-f77e-495d-972b-65e1d108a619, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("3322ffd5-7913-4d67-87ce-0d2ab664feac")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("3322ffd5-7913-4d67-87ce-0d2ab664feac")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("2a287340-c2bb-444f-9fa5-21434d22199a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3d2ea020-a9fd-4f71-ae3d-38fcefd12602")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("2a287340-c2bb-444f-9fa5-21434d22199a"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3d2ea020-a9fd-4f71-ae3d-38fcefd12602")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("3322ffd5-7913-4d67-87ce-0d2ab664feac"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("3322ffd5-7913-4d67-87ce-0d2ab664feac")}} }) }
6222025-01-09T01:45:21.751ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 47be194f-f77e-495d-972b-65e1d108a619 instance_id = 2a287340-c2bb-444f-9fa5-21434d22199a saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update
6232025-01-09T01:45:21.751ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
6242025-01-09T01:45:21.751ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
6252025-01-09T01:45:21.751ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
6262025-01-09T01:45:21.751ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6272025-01-09T01:45:21.752ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8749ba6d-6b18-40a5-a5ae-6513c761e26c", "date": "Thu, 09 Jan 2025 01:45:21 GMT"} })
6282025-01-09T01:45:21.754ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 155.053214ms iteration = 25 status = {}
6292025-01-09T01:45:21.755ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
6302025-01-09T01:45:21.755ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
6312025-01-09T01:45:21.758ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
6322025-01-09T01:45:21.758ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
6332025-01-09T01:45:21.762ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
6342025-01-09T01:45:21.762ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c
6352025-01-09T01:45:21.794ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update sec_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
6362025-01-09T01:45:21.794ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 3e75600a-c0ab-472b-86a0-faa83923a22c saga_name = start-instance-update saga_result = SagaResult { saga_id: 3e75600a-c0ab-472b-86a0-faa83923a22c, saga_log: SagaLog { saga_id: 3e75600a-c0ab-472b-86a0-faa83923a22c, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("80950f8c-e8b1-470d-8f04-ab68827b949a")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("80950f8c-e8b1-470d-8f04-ab68827b949a")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("80950f8c-e8b1-470d-8f04-ab68827b949a"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("80950f8c-e8b1-470d-8f04-ab68827b949a")}} }) }
6372025-01-09T01:45:21.823ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
6382025-01-09T01:45:21.823ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5f5b960-029e-4edd-9f7e-5571f2a8e6dc", "content-length": "691", "date": "Thu, 09 Jan 2025 01:45:21 GMT"} })
6392025-01-09T01:45:21.824ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
6402025-01-09T01:45:21.824ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
6412025-01-09T01:45:21.824ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
6422025-01-09T01:45:21.825ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 226.374832ms iteration = 25 status = {}
6432025-01-09T01:45:21.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d54b3aff-7607-4c93-b418-65d7fc14950a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6442025-01-09T01:45:21.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d54b3aff-7607-4c93-b418-65d7fc14950a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6452025-01-09T01:45:21.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d54b3aff-7607-4c93-b418-65d7fc14950a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6462025-01-09T01:45:22.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7a85cd00-c84b-46e3-9bf8-e201189915ec roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6472025-01-09T01:45:22.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7a85cd00-c84b-46e3-9bf8-e201189915ec resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6482025-01-09T01:45:22.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7a85cd00-c84b-46e3-9bf8-e201189915ec response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6492025-01-09T01:45:23.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c7f448ca-c764-40b9-9ff3-bf546b5d1744 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
6502025-01-09T01:45:23.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c7f448ca-c764-40b9-9ff3-bf546b5d1744 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
6512025-01-09T01:45:23.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = c7f448ca-c764-40b9-9ff3-bf546b5d1744 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
6522025-01-09T01:45:23.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 610a89a6-2c5f-403e-8dcf-748db0a59948 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6532025-01-09T01:45:23.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 610a89a6-2c5f-403e-8dcf-748db0a59948 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6542025-01-09T01:45:23.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 610a89a6-2c5f-403e-8dcf-748db0a59948 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6552025-01-09T01:45:24.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3d8ea40e-dc14-4229-8553-08cf7a7d37db roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6562025-01-09T01:45:24.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3d8ea40e-dc14-4229-8553-08cf7a7d37db resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6572025-01-09T01:45:24.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3d8ea40e-dc14-4229-8553-08cf7a7d37db response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6582025-01-09T01:45:25.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3bb349c9-360b-4148-82a8-a22d2799fa4b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6592025-01-09T01:45:25.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3bb349c9-360b-4148-82a8-a22d2799fa4b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6602025-01-09T01:45:25.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3bb349c9-360b-4148-82a8-a22d2799fa4b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6612025-01-09T01:45:26.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
6622025-01-09T01:45:26.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6632025-01-09T01:45:26.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6642025-01-09T01:45:26.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
6652025-01-09T01:45:26.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6662025-01-09T01:45:26.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6672025-01-09T01:45:26.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682025-01-09T01:45:26.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6692025-01-09T01:45:26.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6702025-01-09T01:45:26.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6712025-01-09T01:45:26.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6722025-01-09T01:45:26.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6732025-01-09T01:45:26.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6742025-01-09T01:45:26.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
6752025-01-09T01:45:26.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6762025-01-09T01:45:26.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6772025-01-09T01:45:26.632ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
6782025-01-09T01:45:26.632ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.932161ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
6792025-01-09T01:45:26.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6802025-01-09T01:45:26.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6812025-01-09T01:45:26.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.275446ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6822025-01-09T01:45:26.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4fefc4e-6c09-4ae4-b458-7c4cf88a803d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6832025-01-09T01:45:26.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4fefc4e-6c09-4ae4-b458-7c4cf88a803d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6842025-01-09T01:45:26.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f4fefc4e-6c09-4ae4-b458-7c4cf88a803d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6852025-01-09T01:45:28.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a4b9aec-011c-4987-b06d-3723e6cb38ac roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6862025-01-09T01:45:28.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a4b9aec-011c-4987-b06d-3723e6cb38ac resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6872025-01-09T01:45:28.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a4b9aec-011c-4987-b06d-3723e6cb38ac response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6882025-01-09T01:45:29.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 50fb7d9b-63fe-4dae-bb7f-cf9251788789 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6892025-01-09T01:45:29.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 50fb7d9b-63fe-4dae-bb7f-cf9251788789 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6902025-01-09T01:45:29.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 50fb7d9b-63fe-4dae-bb7f-cf9251788789 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6912025-01-09T01:45:29.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 686 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 9f66f717-b75f-4d4f-b6bd-c3438485b751 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
6922025-01-09T01:45:30.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 034d54f3-f2f8-40d3-8127-8af910d3161d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6932025-01-09T01:45:30.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 034d54f3-f2f8-40d3-8127-8af910d3161d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6942025-01-09T01:45:30.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 034d54f3-f2f8-40d3-8127-8af910d3161d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6952025-01-09T01:45:31.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11d23b4d-67dc-49d3-bf72-ee4441ea2e9a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6962025-01-09T01:45:31.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11d23b4d-67dc-49d3-bf72-ee4441ea2e9a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6972025-01-09T01:45:31.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11d23b4d-67dc-49d3-bf72-ee4441ea2e9a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6982025-01-09T01:45:32.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7a5c5a36-0944-40d3-918d-9c6594aad616 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
6992025-01-09T01:45:32.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7a5c5a36-0944-40d3-918d-9c6594aad616 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7002025-01-09T01:45:32.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7a5c5a36-0944-40d3-918d-9c6594aad616 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7012025-01-09T01:45:33.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81bca1e8-6b46-410d-88ec-b4de9ec2c551 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7022025-01-09T01:45:33.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81bca1e8-6b46-410d-88ec-b4de9ec2c551 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7032025-01-09T01:45:33.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81bca1e8-6b46-410d-88ec-b4de9ec2c551 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7042025-01-09T01:45:34.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 39709762-0e5a-4349-9446-c98fa92f02fc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7052025-01-09T01:45:34.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 39709762-0e5a-4349-9446-c98fa92f02fc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7062025-01-09T01:45:34.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 39709762-0e5a-4349-9446-c98fa92f02fc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7072025-01-09T01:45:35.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e36ea409-0936-463b-9032-10b2c2b07022 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7082025-01-09T01:45:35.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e36ea409-0936-463b-9032-10b2c2b07022 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7092025-01-09T01:45:35.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e36ea409-0936-463b-9032-10b2c2b07022 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7102025-01-09T01:45:36.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 258ba753-502f-4788-8707-ad0387d4f11e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7112025-01-09T01:45:36.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 258ba753-502f-4788-8707-ad0387d4f11e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7122025-01-09T01:45:36.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 258ba753-502f-4788-8707-ad0387d4f11e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7132025-01-09T01:45:36.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
7142025-01-09T01:45:36.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7152025-01-09T01:45:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7162025-01-09T01:45:36.609ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
7172025-01-09T01:45:36.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7182025-01-09T01:45:36.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7192025-01-09T01:45:36.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202025-01-09T01:45:36.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7212025-01-09T01:45:36.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7222025-01-09T01:45:36.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7232025-01-09T01:45:36.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7242025-01-09T01:45:36.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7252025-01-09T01:45:36.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7262025-01-09T01:45:36.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
7272025-01-09T01:45:36.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7282025-01-09T01:45:36.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7292025-01-09T01:45:36.631ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
7302025-01-09T01:45:36.631ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.866444ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
7312025-01-09T01:45:36.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7322025-01-09T01:45:36.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7332025-01-09T01:45:36.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.496177ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7342025-01-09T01:45:37.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c52db03-f917-4fd2-a693-adccb5b125d6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7352025-01-09T01:45:37.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c52db03-f917-4fd2-a693-adccb5b125d6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7362025-01-09T01:45:37.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c52db03-f917-4fd2-a693-adccb5b125d6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7372025-01-09T01:45:38.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 528e2e96-de87-4b52-94b2-73e713cd33ac roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7382025-01-09T01:45:38.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 528e2e96-de87-4b52-94b2-73e713cd33ac resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7392025-01-09T01:45:38.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 528e2e96-de87-4b52-94b2-73e713cd33ac response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7402025-01-09T01:45:39.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83f05a97-067a-4cb0-a911-03f8a87018a0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7412025-01-09T01:45:39.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83f05a97-067a-4cb0-a911-03f8a87018a0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7422025-01-09T01:45:39.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83f05a97-067a-4cb0-a911-03f8a87018a0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7432025-01-09T01:45:39.300ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1178 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 31c39a95-efa0-4476-8d99-2a9e013168d9 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
7442025-01-09T01:45:40.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a26efff8-c1d8-4a71-bbb0-0647db618f42 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7452025-01-09T01:45:40.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a26efff8-c1d8-4a71-bbb0-0647db618f42 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7462025-01-09T01:45:40.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a26efff8-c1d8-4a71-bbb0-0647db618f42 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7472025-01-09T01:45:41.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f703e7e4-bbf2-4a74-9e60-f686bf4ec128 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7482025-01-09T01:45:41.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f703e7e4-bbf2-4a74-9e60-f686bf4ec128 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7492025-01-09T01:45:41.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f703e7e4-bbf2-4a74-9e60-f686bf4ec128 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7502025-01-09T01:45:42.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b0df12a-da8d-40f5-87b5-2a46fa7a732f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7512025-01-09T01:45:42.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b0df12a-da8d-40f5-87b5-2a46fa7a732f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7522025-01-09T01:45:42.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b0df12a-da8d-40f5-87b5-2a46fa7a732f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7532025-01-09T01:45:43.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2722a29d-c299-41d5-8416-6bfc6ed4dd02 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7542025-01-09T01:45:43.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2722a29d-c299-41d5-8416-6bfc6ed4dd02 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7552025-01-09T01:45:43.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2722a29d-c299-41d5-8416-6bfc6ed4dd02 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7562025-01-09T01:45:44.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = c60b2d86-718c-40b6-b5e3-1d1370565c9c roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
7572025-01-09T01:45:44.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = c60b2d86-718c-40b6-b5e3-1d1370565c9c resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
7582025-01-09T01:45:44.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = c60b2d86-718c-40b6-b5e3-1d1370565c9c response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
7592025-01-09T01:45:44.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4d4fbb25-4e47-4f33-a5b3-25ac52f5649a roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
7602025-01-09T01:45:44.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4d4fbb25-4e47-4f33-a5b3-25ac52f5649a resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
7612025-01-09T01:45:44.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4d4fbb25-4e47-4f33-a5b3-25ac52f5649a response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
7622025-01-09T01:45:44.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5e82e0e-0237-4387-b5ae-e6627b2e2def roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7632025-01-09T01:45:44.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5e82e0e-0237-4387-b5ae-e6627b2e2def resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7642025-01-09T01:45:44.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5e82e0e-0237-4387-b5ae-e6627b2e2def response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7652025-01-09T01:45:45.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 13e6f498-9ed9-4e02-8052-1c193cb3e859 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7662025-01-09T01:45:45.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 13e6f498-9ed9-4e02-8052-1c193cb3e859 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7672025-01-09T01:45:45.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 13e6f498-9ed9-4e02-8052-1c193cb3e859 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7682025-01-09T01:45:46.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c7333d2-05fd-4d5d-9f8b-669d5be490cd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7692025-01-09T01:45:46.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c7333d2-05fd-4d5d-9f8b-669d5be490cd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7702025-01-09T01:45:46.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5c7333d2-05fd-4d5d-9f8b-669d5be490cd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
7712025-01-09T01:45:46.607ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
7722025-01-09T01:45:46.607ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
7732025-01-09T01:45:46.607ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
7742025-01-09T01:45:46.607ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.44\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
7752025-01-09T01:45:46.607ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
7762025-01-09T01:45:46.607ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
7772025-01-09T01:45:46.607ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:35:46.607912218 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
7782025-01-09T01:45:46.607ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7792025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
7802025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
7812025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
7822025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
7832025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7842025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
7852025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7862025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
7872025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
7882025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
7892025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7902025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
7912025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
7922025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
7932025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
7942025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7952025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7962025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
7972025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7982025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7992025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8002025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8012025-01-09T01:45:46.608ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 4885709 } })
8022025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8032025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8042025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
8052025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
8062025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8072025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8082025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8092025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
8102025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8112025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
8122025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8132025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
8142025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
8152025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8162025-01-09T01:45:46.608ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
8172025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8182025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
8192025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
8202025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8212025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
8222025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8232025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
8242025-01-09T01:45:46.608ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
8252025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8262025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
8272025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8282025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8292025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
8302025-01-09T01:45:46.608ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8312025-01-09T01:45:46.608ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 5159084 } })
8322025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8332025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8342025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
8352025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8362025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.190119ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
8372025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8382025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8392025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8402025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8412025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8422025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8432025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8442025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8452025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8462025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8472025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8482025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
8492025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8502025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.466184ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
8512025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8522025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8532025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8542025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
8552025-01-09T01:45:46.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
8562025-01-09T01:45:46.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8572025-01-09T01:45:46.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8582025-01-09T01:45:46.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8592025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8602025-01-09T01:45:46.611ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:35:46.607912218 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
8612025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
8622025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8632025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
8642025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.551588ms iteration = 13 status = {"expiration":"2025-01-09T01:35:46.607912218Z","pruned":[]}
8652025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
8662025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
8672025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8682025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
8692025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
8702025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
8712025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
8722025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
8732025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
8742025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
8752025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8762025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
8772025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8782025-01-09T01:45:46.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 8078101 } })
8792025-01-09T01:45:46.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8802025-01-09T01:45:46.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8812025-01-09T01:45:46.612ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
8822025-01-09T01:45:46.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8832025-01-09T01:45:46.613ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.309775ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8842025-01-09T01:45:46.613ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 9999962 } })
8852025-01-09T01:45:46.614ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
8862025-01-09T01:45:46.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8872025-01-09T01:45:46.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8882025-01-09T01:45:46.614ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8892025-01-09T01:45:46.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8902025-01-09T01:45:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8912025-01-09T01:45:46.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8922025-01-09T01:45:46.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8932025-01-09T01:45:46.618ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8942025-01-09T01:45:46.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8952025-01-09T01:45:46.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8962025-01-09T01:45:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
8972025-01-09T01:45:46.621ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8982025-01-09T01:45:46.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8992025-01-09T01:45:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9002025-01-09T01:45:46.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9012025-01-09T01:45:46.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9022025-01-09T01:45:46.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9032025-01-09T01:45:46.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9042025-01-09T01:45:46.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9052025-01-09T01:45:46.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9062025-01-09T01:45:46.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9072025-01-09T01:45:46.628ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9082025-01-09T01:45:46.629ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9092025-01-09T01:45:46.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9102025-01-09T01:45:46.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9112025-01-09T01:45:46.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9122025-01-09T01:45:46.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9132025-01-09T01:45:46.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9142025-01-09T01:45:46.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9152025-01-09T01:45:46.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9162025-01-09T01:45:46.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9172025-01-09T01:45:46.634ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.419016ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
9182025-01-09T01:45:46.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9192025-01-09T01:45:46.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9202025-01-09T01:45:46.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9212025-01-09T01:45:46.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9222025-01-09T01:45:46.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9232025-01-09T01:45:46.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9242025-01-09T01:45:46.661ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9252025-01-09T01:45:46.661ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9262025-01-09T01:45:46.661ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9272025-01-09T01:45:46.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9282025-01-09T01:45:46.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9292025-01-09T01:45:46.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9302025-01-09T01:45:46.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9312025-01-09T01:45:46.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9322025-01-09T01:45:46.673ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9332025-01-09T01:45:46.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9342025-01-09T01:45:46.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9352025-01-09T01:45:46.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9362025-01-09T01:45:46.675ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9372025-01-09T01:45:46.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9382025-01-09T01:45:46.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9392025-01-09T01:45:46.676ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9402025-01-09T01:45:46.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9412025-01-09T01:45:46.677ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9422025-01-09T01:45:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9432025-01-09T01:45:46.678ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9442025-01-09T01:45:46.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9452025-01-09T01:45:46.680ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9462025-01-09T01:45:46.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
9472025-01-09T01:45:46.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9482025-01-09T01:45:46.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9492025-01-09T01:45:46.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9502025-01-09T01:45:46.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9512025-01-09T01:45:46.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9522025-01-09T01:45:46.683ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9532025-01-09T01:45:46.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9542025-01-09T01:45:46.684ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9552025-01-09T01:45:46.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.840781ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
9562025-01-09T01:45:46.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9572025-01-09T01:45:46.685ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1679, tv_nsec: 81707065 } })
9582025-01-09T01:45:46.685ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
9592025-01-09T01:45:46.685ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
9602025-01-09T01:45:46.686ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
9612025-01-09T01:45:46.686ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
9622025-01-09T01:45:46.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9632025-01-09T01:45:46.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9642025-01-09T01:45:46.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9652025-01-09T01:45:46.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9662025-01-09T01:45:46.687ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9672025-01-09T01:45:46.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9682025-01-09T01:45:46.688ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9692025-01-09T01:45:46.690ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9702025-01-09T01:45:46.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9712025-01-09T01:45:46.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
9722025-01-09T01:45:46.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9732025-01-09T01:45:46.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9742025-01-09T01:45:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
9752025-01-09T01:45:46.692ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
9762025-01-09T01:45:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
9772025-01-09T01:45:46.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9782025-01-09T01:45:46.693ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
9792025-01-09T01:45:46.693ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
9802025-01-09T01:45:46.693ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.656384ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
9812025-01-09T01:45:46.693ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9822025-01-09T01:45:46.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9832025-01-09T01:45:46.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9842025-01-09T01:45:46.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.644898ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
9852025-01-09T01:45:46.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
9862025-01-09T01:45:46.697ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9872025-01-09T01:45:46.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9882025-01-09T01:45:46.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.084856ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
9892025-01-09T01:45:46.700ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9902025-01-09T01:45:46.700ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9912025-01-09T01:45:46.702ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
9922025-01-09T01:45:46.702ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
9932025-01-09T01:45:46.702ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.586615ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
9942025-01-09T01:45:46.702ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 93.832109ms iteration = 6 status = {"nsuccess":5}
9952025-01-09T01:45:46.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9962025-01-09T01:45:46.704ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9972025-01-09T01:45:46.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9982025-01-09T01:45:46.704ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9992025-01-09T01:45:46.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10002025-01-09T01:45:46.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10012025-01-09T01:45:46.724ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
10022025-01-09T01:45:46.724ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 116.071187ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
10032025-01-09T01:45:46.725ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10042025-01-09T01:45:46.725ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.061763ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
10052025-01-09T01:45:46.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10062025-01-09T01:45:46.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10072025-01-09T01:45:46.730ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10082025-01-09T01:45:46.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10092025-01-09T01:45:46.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10102025-01-09T01:45:46.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10112025-01-09T01:45:46.747ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10122025-01-09T01:45:46.747ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10132025-01-09T01:45:46.747ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10142025-01-09T01:45:46.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10152025-01-09T01:45:46.761ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 153.082843ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10162025-01-09T01:45:46.764ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 152.985541ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10172025-01-09T01:45:46.764ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
10182025-01-09T01:45:46.764ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
10192025-01-09T01:45:46.764ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
10202025-01-09T01:45:46.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10212025-01-09T01:45:46.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10222025-01-09T01:45:46.766ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
10232025-01-09T01:45:46.766ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10242025-01-09T01:45:46.766ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffeb3798-5e8b-4516-89a0-0ca2723ec35d", "content-length": "26", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
10252025-01-09T01:45:46.766ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10262025-01-09T01:45:46.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10272025-01-09T01:45:46.768ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10282025-01-09T01:45:46.771ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
10292025-01-09T01:45:46.771ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
10302025-01-09T01:45:46.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10312025-01-09T01:45:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10322025-01-09T01:45:46.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10332025-01-09T01:45:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10342025-01-09T01:45:46.772ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10352025-01-09T01:45:46.772ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10362025-01-09T01:45:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10372025-01-09T01:45:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10382025-01-09T01:45:46.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10392025-01-09T01:45:46.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10402025-01-09T01:45:46.775ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10412025-01-09T01:45:46.778ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10422025-01-09T01:45:46.778ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10432025-01-09T01:45:46.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10442025-01-09T01:45:46.779ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10452025-01-09T01:45:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10462025-01-09T01:45:46.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10472025-01-09T01:45:46.783ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
10482025-01-09T01:45:46.783ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
10492025-01-09T01:45:46.783ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
10502025-01-09T01:45:46.783ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 175.665625ms iteration = 13 status = {"generation":1}
10512025-01-09T01:45:46.787ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.0468ms iteration = 28 status = {"physical_disks_added":0}
10522025-01-09T01:45:46.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10532025-01-09T01:45:46.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
10542025-01-09T01:45:46.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10552025-01-09T01:45:46.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10562025-01-09T01:45:46.793ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 184.436967ms iteration = 25 status = 0
10572025-01-09T01:45:46.799ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10582025-01-09T01:45:46.799ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10592025-01-09T01:45:46.799ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 191.042123ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10602025-01-09T01:45:46.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 206.694335ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
10612025-01-09T01:45:46.819ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
10622025-01-09T01:45:46.819ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
10632025-01-09T01:45:46.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10642025-01-09T01:45:46.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10652025-01-09T01:45:46.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10662025-01-09T01:45:46.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10672025-01-09T01:45:46.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10682025-01-09T01:45:46.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10692025-01-09T01:45:46.830ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
10702025-01-09T01:45:46.830ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 222.387748ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
10712025-01-09T01:45:46.831ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
10722025-01-09T01:45:46.831ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
10732025-01-09T01:45:46.831ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
10742025-01-09T01:45:46.831ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 223.897961ms iteration = 13 status = {"generation":2}
10752025-01-09T01:45:46.841ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
10762025-01-09T01:45:46.841ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 232.924987ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
10772025-01-09T01:45:46.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10782025-01-09T01:45:46.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10792025-01-09T01:45:46.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10802025-01-09T01:45:46.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10812025-01-09T01:45:46.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10822025-01-09T01:45:46.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10832025-01-09T01:45:46.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10842025-01-09T01:45:46.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10852025-01-09T01:45:46.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10862025-01-09T01:45:46.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10872025-01-09T01:45:46.878ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
10882025-01-09T01:45:46.878ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10892025-01-09T01:45:46.879ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "abf4d781-514c-4707-975c-502dabdb3c8e", "content-length": "372", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
10902025-01-09T01:45:46.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10912025-01-09T01:45:46.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10922025-01-09T01:45:46.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
10932025-01-09T01:45:46.900ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10942025-01-09T01:45:46.900ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "11cd5230-d2d0-45c7-8059-45f7f0b1a800", "content-length": "26", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
10952025-01-09T01:45:46.900ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10962025-01-09T01:45:46.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
10972025-01-09T01:45:46.947ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
10982025-01-09T01:45:46.947ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
10992025-01-09T01:45:46.948ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c1d1e649-e849-4658-92e7-7f230b8ceecd", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
11002025-01-09T01:45:46.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11012025-01-09T01:45:46.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11022025-01-09T01:45:46.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11032025-01-09T01:45:46.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11042025-01-09T01:45:46.967ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11052025-01-09T01:45:46.967ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ef473f7-45ce-48d1-bffd-1fc97831146b", "content-length": "2", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
11062025-01-09T01:45:46.969ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11072025-01-09T01:45:46.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11082025-01-09T01:45:47.004ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
11092025-01-09T01:45:47.041ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
11102025-01-09T01:45:47.091ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11112025-01-09T01:45:47.091ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11122025-01-09T01:45:47.092ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a4cfa89-5243-4771-bccd-38b4dadc6331", "content-length": "26", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
11132025-01-09T01:45:47.092ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11142025-01-09T01:45:47.094ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11152025-01-09T01:45:47.169ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11162025-01-09T01:45:47.169ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbe492e1-d012-4836-8ca0-2bd471012693", "content-length": "691", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
11172025-01-09T01:45:47.169ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11182025-01-09T01:45:47.169ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11192025-01-09T01:45:47.169ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11202025-01-09T01:45:47.171ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 562.652641ms iteration = 26 status = {}
11212025-01-09T01:45:47.172ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 564.165364ms iteration = 25 status = null
11222025-01-09T01:45:47.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11232025-01-09T01:45:47.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11242025-01-09T01:45:47.176ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11252025-01-09T01:45:47.176ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11262025-01-09T01:45:47.176ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5a8b09c6-cdf5-4abc-8788-c703ead777f8", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
11272025-01-09T01:45:47.178ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 570.179342ms iteration = 26 status = {}
11282025-01-09T01:45:47.246ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 638.604653ms iteration = 25 status = {}
11292025-01-09T01:45:47.284ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
11302025-01-09T01:45:47.310ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
11312025-01-09T01:45:47.311ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "02cfc0c3-a5e3-423f-bf70-ff9efb6386f0", "date": "Thu, 09 Jan 2025 01:45:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11322025-01-09T01:45:47.311ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11332025-01-09T01:45:47.313ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "03688025-9915-41b4-ac8b-e215d4940b3b", "date": "Thu, 09 Jan 2025 01:45:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11342025-01-09T01:45:47.313ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11352025-01-09T01:45:47.315ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11362025-01-09T01:45:47.315ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 707.174075ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
11372025-01-09T01:45:47.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11382025-01-09T01:45:47.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11392025-01-09T01:45:47.364ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
11402025-01-09T01:45:47.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11412025-01-09T01:45:47.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11422025-01-09T01:45:47.365ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
11432025-01-09T01:45:47.366ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7638f31d-f3d4-4d30-8354-8a0e40db85e1", "date": "Thu, 09 Jan 2025 01:45:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11442025-01-09T01:45:47.366ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11452025-01-09T01:45:47.367ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0165b873-4d96-46a9-92b3-ebcfca5683d5", "date": "Thu, 09 Jan 2025 01:45:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11462025-01-09T01:45:47.367ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11472025-01-09T01:45:47.369ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b0df2f1f-d132-43a3-a6e2-52a42ebf67ba", "date": "Thu, 09 Jan 2025 01:45:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11482025-01-09T01:45:47.369ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11492025-01-09T01:45:47.371ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
11502025-01-09T01:45:47.371ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 763.492501ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
11512025-01-09T01:45:47.372ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11522025-01-09T01:45:47.372ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c198b765-356c-48a4-9a12-0b42e4b85698", "content-length": "134", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
11532025-01-09T01:45:47.372ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11542025-01-09T01:45:47.372ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
11552025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11562025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11572025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11582025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11592025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11602025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11612025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11622025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11632025-01-09T01:45:47.373ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
11642025-01-09T01:45:47.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11652025-01-09T01:45:47.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11662025-01-09T01:45:47.376ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11672025-01-09T01:45:47.376ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c274525c-90f1-4d2f-bdb8-ffaf2cd4df39", "content-length": "2", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
11682025-01-09T01:45:47.376ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11692025-01-09T01:45:47.376ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "70390179-455f-4f52-bba6-26101c21b271", "content-length": "52", "date": "Thu, 09 Jan 2025 01:45:46 GMT"} })
11702025-01-09T01:45:47.376ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
11712025-01-09T01:45:47.376ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11722025-01-09T01:45:47.481ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4796faff-9473-4546-bbc1-1acc0ce5a323", "date": "Thu, 09 Jan 2025 01:45:47 GMT"} })
11732025-01-09T01:45:47.481ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
11742025-01-09T01:45:47.481ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11752025-01-09T01:45:47.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e19e777-243d-41e4-bf6d-e1b0532b6e81 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11762025-01-09T01:45:47.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e19e777-243d-41e4-bf6d-e1b0532b6e81 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11772025-01-09T01:45:47.481ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7e0d179-45d7-4c44-b3e5-1772130c9c53", "content-length": "682", "date": "Thu, 09 Jan 2025 01:45:47 GMT"} })
11782025-01-09T01:45:47.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11792025-01-09T01:45:47.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11802025-01-09T01:45:47.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e19e777-243d-41e4-bf6d-e1b0532b6e81 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11812025-01-09T01:45:47.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11822025-01-09T01:45:47.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11832025-01-09T01:45:47.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11842025-01-09T01:45:47.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11852025-01-09T01:45:47.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11862025-01-09T01:45:47.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11872025-01-09T01:45:47.502ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 893.457262ms iteration = 25 status = {}
11882025-01-09T01:45:48.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a3fbf34-a613-4b2b-b9dd-e6d154456a87 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11892025-01-09T01:45:48.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a3fbf34-a613-4b2b-b9dd-e6d154456a87 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11902025-01-09T01:45:48.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2a3fbf34-a613-4b2b-b9dd-e6d154456a87 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11912025-01-09T01:45:49.299ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 684 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = d6468ae6-7198-46d4-9d8b-4b50343b6fa6 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
11922025-01-09T01:45:49.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5b192e6d-06d3-4c0f-b1ea-9bda7c949ec0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11932025-01-09T01:45:49.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5b192e6d-06d3-4c0f-b1ea-9bda7c949ec0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11942025-01-09T01:45:49.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5b192e6d-06d3-4c0f-b1ea-9bda7c949ec0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11952025-01-09T01:45:50.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4c6d55f-fc83-4863-93e3-076bd7d96077 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11962025-01-09T01:45:50.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4c6d55f-fc83-4863-93e3-076bd7d96077 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11972025-01-09T01:45:50.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d4c6d55f-fc83-4863-93e3-076bd7d96077 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11982025-01-09T01:45:51.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29e63de3-f4d1-44b5-b639-42409d29e509 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
11992025-01-09T01:45:51.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29e63de3-f4d1-44b5-b639-42409d29e509 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12002025-01-09T01:45:51.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 29e63de3-f4d1-44b5-b639-42409d29e509 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12012025-01-09T01:45:52.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b1fef13-dcbd-4823-8a88-803aa23259ee roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12022025-01-09T01:45:52.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b1fef13-dcbd-4823-8a88-803aa23259ee resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12032025-01-09T01:45:52.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6b1fef13-dcbd-4823-8a88-803aa23259ee response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12042025-01-09T01:45:53.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 1d96c2b9-f930-40c2-83b0-9277c87210ed roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
12052025-01-09T01:45:53.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 1d96c2b9-f930-40c2-83b0-9277c87210ed resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
12062025-01-09T01:45:53.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 1d96c2b9-f930-40c2-83b0-9277c87210ed response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
12072025-01-09T01:45:53.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79891a2e-e3af-4932-b172-cb8e44ae8663 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12082025-01-09T01:45:53.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79891a2e-e3af-4932-b172-cb8e44ae8663 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12092025-01-09T01:45:53.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 79891a2e-e3af-4932-b172-cb8e44ae8663 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12102025-01-09T01:45:54.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bfc6318-7233-4095-b78b-0f6c04801669 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12112025-01-09T01:45:54.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bfc6318-7233-4095-b78b-0f6c04801669 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12122025-01-09T01:45:54.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5bfc6318-7233-4095-b78b-0f6c04801669 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12132025-01-09T01:45:55.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 00e18420-5475-4c77-84c4-b0383f09dbf9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12142025-01-09T01:45:55.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 00e18420-5475-4c77-84c4-b0383f09dbf9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12152025-01-09T01:45:55.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 00e18420-5475-4c77-84c4-b0383f09dbf9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12162025-01-09T01:45:56.608ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
12172025-01-09T01:45:56.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12182025-01-09T01:45:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12192025-01-09T01:45:56.609ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
12202025-01-09T01:45:56.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12212025-01-09T01:45:56.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12222025-01-09T01:45:56.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12232025-01-09T01:45:56.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12242025-01-09T01:45:56.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12252025-01-09T01:45:56.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.72636ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12262025-01-09T01:45:56.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12272025-01-09T01:45:56.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12282025-01-09T01:45:56.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12292025-01-09T01:45:56.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12302025-01-09T01:45:56.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12312025-01-09T01:45:56.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12322025-01-09T01:45:56.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
12332025-01-09T01:45:56.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12342025-01-09T01:45:56.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12352025-01-09T01:45:56.631ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
12362025-01-09T01:45:56.631ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.763523ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
12372025-01-09T01:45:56.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a9db187-22d4-42c0-bf57-79f5c04f834c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12382025-01-09T01:45:56.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a9db187-22d4-42c0-bf57-79f5c04f834c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12392025-01-09T01:45:56.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3a9db187-22d4-42c0-bf57-79f5c04f834c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12402025-01-09T01:45:57.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44928a41-e9b9-43cd-b325-78251dc983f5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12412025-01-09T01:45:57.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44928a41-e9b9-43cd-b325-78251dc983f5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12422025-01-09T01:45:57.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44928a41-e9b9-43cd-b325-78251dc983f5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12432025-01-09T01:45:58.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86fa2abe-9261-40aa-a426-b98166dd1d39 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12442025-01-09T01:45:58.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86fa2abe-9261-40aa-a426-b98166dd1d39 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12452025-01-09T01:45:58.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 86fa2abe-9261-40aa-a426-b98166dd1d39 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12462025-01-09T01:45:59.439ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 565 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 1bad6923-aafd-49c2-acc7-ef532330c34e response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
12472025-01-09T01:45:59.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 85202056-b510-45c1-86e7-047efaef65e8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12482025-01-09T01:45:59.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 85202056-b510-45c1-86e7-047efaef65e8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12492025-01-09T01:45:59.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 85202056-b510-45c1-86e7-047efaef65e8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12502025-01-09T01:46:00.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = beb3829a-6316-49c7-a20c-71ab093b84b1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12512025-01-09T01:46:00.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = beb3829a-6316-49c7-a20c-71ab093b84b1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12522025-01-09T01:46:00.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = beb3829a-6316-49c7-a20c-71ab093b84b1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12532025-01-09T01:46:02.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f2a2cc6-d5d8-4b73-b22c-de61166f8a46 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12542025-01-09T01:46:02.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f2a2cc6-d5d8-4b73-b22c-de61166f8a46 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12552025-01-09T01:46:02.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9f2a2cc6-d5d8-4b73-b22c-de61166f8a46 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12562025-01-09T01:46:03.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 773d7356-5d05-4592-8791-ce15e7d727f1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12572025-01-09T01:46:03.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 773d7356-5d05-4592-8791-ce15e7d727f1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12582025-01-09T01:46:03.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 773d7356-5d05-4592-8791-ce15e7d727f1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12592025-01-09T01:46:04.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e90b51ba-cc78-445d-86be-01a7c7021fc8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12602025-01-09T01:46:04.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e90b51ba-cc78-445d-86be-01a7c7021fc8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12612025-01-09T01:46:04.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e90b51ba-cc78-445d-86be-01a7c7021fc8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12622025-01-09T01:46:05.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 324e031c-52b2-45b8-905c-b674a213d8ff roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12632025-01-09T01:46:05.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 324e031c-52b2-45b8-905c-b674a213d8ff resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12642025-01-09T01:46:05.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 324e031c-52b2-45b8-905c-b674a213d8ff response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12652025-01-09T01:46:06.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7985ec96-87a6-44ad-aae3-24f3d0f8bdec roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12662025-01-09T01:46:06.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7985ec96-87a6-44ad-aae3-24f3d0f8bdec resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12672025-01-09T01:46:06.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7985ec96-87a6-44ad-aae3-24f3d0f8bdec response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12682025-01-09T01:46:07.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
12692025-01-09T01:46:07.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12702025-01-09T01:46:07.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12712025-01-09T01:46:07.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
12722025-01-09T01:46:07.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12732025-01-09T01:46:07.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12742025-01-09T01:46:07.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12752025-01-09T01:46:07.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12762025-01-09T01:46:07.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12772025-01-09T01:46:07.082ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.691773ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12782025-01-09T01:46:07.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12792025-01-09T01:46:07.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12802025-01-09T01:46:07.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12812025-01-09T01:46:07.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12822025-01-09T01:46:07.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12832025-01-09T01:46:07.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12842025-01-09T01:46:07.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
12852025-01-09T01:46:07.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12862025-01-09T01:46:07.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12872025-01-09T01:46:07.101ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
12882025-01-09T01:46:07.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.338224ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
12892025-01-09T01:46:07.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b054a441-be8c-44b0-a5ad-3d1599160944 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12902025-01-09T01:46:07.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b054a441-be8c-44b0-a5ad-3d1599160944 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12912025-01-09T01:46:07.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b054a441-be8c-44b0-a5ad-3d1599160944 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12922025-01-09T01:46:08.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c8141b5-a66e-4419-b83d-56a9ecff1abe roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12932025-01-09T01:46:08.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c8141b5-a66e-4419-b83d-56a9ecff1abe resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12942025-01-09T01:46:08.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9c8141b5-a66e-4419-b83d-56a9ecff1abe response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12952025-01-09T01:46:09.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9c5cba0-a8e0-4c49-98b9-e85ec4411861 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12962025-01-09T01:46:09.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9c5cba0-a8e0-4c49-98b9-e85ec4411861 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12972025-01-09T01:46:09.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d9c5cba0-a8e0-4c49-98b9-e85ec4411861 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
12982025-01-09T01:46:09.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1092 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 582654e7-b1c6-44d7-8256-2a918f69b593 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
12992025-01-09T01:46:10.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5d582015-2260-4f31-83ca-9668931fc603 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13002025-01-09T01:46:10.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5d582015-2260-4f31-83ca-9668931fc603 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13012025-01-09T01:46:10.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5d582015-2260-4f31-83ca-9668931fc603 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13022025-01-09T01:46:11.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0a7bc1b2-60f1-4ebd-9529-0e07996cd857 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13032025-01-09T01:46:11.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0a7bc1b2-60f1-4ebd-9529-0e07996cd857 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13042025-01-09T01:46:11.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0a7bc1b2-60f1-4ebd-9529-0e07996cd857 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13052025-01-09T01:46:12.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = abca1667-9425-429e-a7e6-edbca3e04d40 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13062025-01-09T01:46:12.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = abca1667-9425-429e-a7e6-edbca3e04d40 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13072025-01-09T01:46:12.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = abca1667-9425-429e-a7e6-edbca3e04d40 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13082025-01-09T01:46:13.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f5c055b9-9a4f-457a-ba31-3a936d752a21 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13092025-01-09T01:46:13.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f5c055b9-9a4f-457a-ba31-3a936d752a21 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13102025-01-09T01:46:13.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f5c055b9-9a4f-457a-ba31-3a936d752a21 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13112025-01-09T01:46:14.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4d4aa722-e2df-4748-830e-440d1d6dbf00 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13122025-01-09T01:46:14.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4d4aa722-e2df-4748-830e-440d1d6dbf00 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13132025-01-09T01:46:14.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4d4aa722-e2df-4748-830e-440d1d6dbf00 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13142025-01-09T01:46:14.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = a162ac74-52ad-4998-a032-94b7456a9760 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
13152025-01-09T01:46:14.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = a162ac74-52ad-4998-a032-94b7456a9760 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
13162025-01-09T01:46:14.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = a162ac74-52ad-4998-a032-94b7456a9760 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
13172025-01-09T01:46:14.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 96e919a9-cde6-4099-8d64-40f3271a6f80 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
13182025-01-09T01:46:14.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 96e919a9-cde6-4099-8d64-40f3271a6f80 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
13192025-01-09T01:46:14.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 96e919a9-cde6-4099-8d64-40f3271a6f80 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
13202025-01-09T01:46:15.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72439712-7616-45bd-8b46-ba9f49497a0a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13212025-01-09T01:46:15.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72439712-7616-45bd-8b46-ba9f49497a0a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13222025-01-09T01:46:15.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72439712-7616-45bd-8b46-ba9f49497a0a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13232025-01-09T01:46:16.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8bf3ab00-7780-4b3e-8196-e44b29cbcc1d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13242025-01-09T01:46:16.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8bf3ab00-7780-4b3e-8196-e44b29cbcc1d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13252025-01-09T01:46:16.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8bf3ab00-7780-4b3e-8196-e44b29cbcc1d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
13262025-01-09T01:46:17.051ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
13272025-01-09T01:46:17.051ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13282025-01-09T01:46:17.051ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
13292025-01-09T01:46:17.051ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
13302025-01-09T01:46:17.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13312025-01-09T01:46:17.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13322025-01-09T01:46:17.051ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
13332025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13342025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13352025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13362025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
13372025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
13382025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13392025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
13402025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13412025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13422025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
13432025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13442025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
13452025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13462025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
13472025-01-09T01:46:17.052ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13482025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13492025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
13502025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13512025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13522025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
13532025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13542025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
13552025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13562025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13572025-01-09T01:46:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13582025-01-09T01:46:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13592025-01-09T01:46:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13602025-01-09T01:46:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13612025-01-09T01:46:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13622025-01-09T01:46:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13632025-01-09T01:46:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13642025-01-09T01:46:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13652025-01-09T01:46:17.054ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
13662025-01-09T01:46:17.054ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
13672025-01-09T01:46:17.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13682025-01-09T01:46:17.054ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13692025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13702025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13712025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
13722025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
13732025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13742025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13752025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13762025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13772025-01-09T01:46:17.055ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1709, tv_nsec: 8442347 } })
13782025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.100156ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13792025-01-09T01:46:17.055ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1709, tv_nsec: 8582599 } })
13802025-01-09T01:46:17.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13812025-01-09T01:46:17.055ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
13822025-01-09T01:46:17.056ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
13832025-01-09T01:46:17.056ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13842025-01-09T01:46:17.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13852025-01-09T01:46:17.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13862025-01-09T01:46:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13872025-01-09T01:46:17.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13882025-01-09T01:46:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13892025-01-09T01:46:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13902025-01-09T01:46:17.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13912025-01-09T01:46:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13922025-01-09T01:46:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13932025-01-09T01:46:17.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13942025-01-09T01:46:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13952025-01-09T01:46:17.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13962025-01-09T01:46:17.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13972025-01-09T01:46:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13982025-01-09T01:46:17.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13992025-01-09T01:46:17.062ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14002025-01-09T01:46:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14012025-01-09T01:46:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14022025-01-09T01:46:17.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14032025-01-09T01:46:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14042025-01-09T01:46:17.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14052025-01-09T01:46:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14062025-01-09T01:46:17.069ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1709, tv_nsec: 21918223 } })
14072025-01-09T01:46:17.069ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
14082025-01-09T01:46:17.070ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14092025-01-09T01:46:17.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14102025-01-09T01:46:17.072ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14112025-01-09T01:46:17.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.430203ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14122025-01-09T01:46:17.095ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14132025-01-09T01:46:17.095ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14142025-01-09T01:46:17.095ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14152025-01-09T01:46:17.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14162025-01-09T01:46:17.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14172025-01-09T01:46:17.097ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.78999ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14182025-01-09T01:46:17.098ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14192025-01-09T01:46:17.098ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14202025-01-09T01:46:17.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14212025-01-09T01:46:17.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14222025-01-09T01:46:17.098ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14232025-01-09T01:46:17.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14242025-01-09T01:46:17.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14252025-01-09T01:46:17.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14262025-01-09T01:46:17.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14272025-01-09T01:46:17.100ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14282025-01-09T01:46:17.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14292025-01-09T01:46:17.101ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14302025-01-09T01:46:17.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14312025-01-09T01:46:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14322025-01-09T01:46:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14332025-01-09T01:46:17.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14342025-01-09T01:46:17.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
14352025-01-09T01:46:17.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14362025-01-09T01:46:17.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14372025-01-09T01:46:17.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.779589ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
14382025-01-09T01:46:17.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392025-01-09T01:46:17.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14402025-01-09T01:46:17.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.566659ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
14412025-01-09T01:46:17.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14422025-01-09T01:46:17.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14432025-01-09T01:46:17.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14442025-01-09T01:46:17.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14452025-01-09T01:46:17.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14462025-01-09T01:46:17.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14472025-01-09T01:46:17.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
14482025-01-09T01:46:17.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.510401ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
14492025-01-09T01:46:17.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14502025-01-09T01:46:17.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14512025-01-09T01:46:17.140ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14522025-01-09T01:46:17.140ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14532025-01-09T01:46:17.140ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c680250-5f9a-4d0b-bfc9-8f9d0c3b9f21", "content-length": "26", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
14542025-01-09T01:46:17.140ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14552025-01-09T01:46:17.140ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14562025-01-09T01:46:17.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14572025-01-09T01:46:17.141ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
14582025-01-09T01:46:17.141ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14592025-01-09T01:46:17.141ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6fa7245-c55d-4f73-ab5c-1e0d712da22a", "content-length": "26", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
14602025-01-09T01:46:17.141ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14612025-01-09T01:46:17.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14622025-01-09T01:46:17.143ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14632025-01-09T01:46:17.144ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14642025-01-09T01:46:17.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
14652025-01-09T01:46:17.145ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14662025-01-09T01:46:17.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14672025-01-09T01:46:17.146ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14682025-01-09T01:46:17.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14692025-01-09T01:46:17.147ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.635112ms iteration = 26 status = 0
14702025-01-09T01:46:17.147ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14712025-01-09T01:46:17.147ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14722025-01-09T01:46:17.147ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 94.963628ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14732025-01-09T01:46:17.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.744698ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14742025-01-09T01:46:17.150ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.280905ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14752025-01-09T01:46:17.168ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
14762025-01-09T01:46:17.169ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14772025-01-09T01:46:17.169ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4220a8f8-a393-40e8-9be5-1d4367d2bcf5", "content-length": "26", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
14782025-01-09T01:46:17.169ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14792025-01-09T01:46:17.172ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
14802025-01-09T01:46:17.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 144.289651ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14812025-01-09T01:46:17.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14822025-01-09T01:46:17.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14832025-01-09T01:46:17.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14842025-01-09T01:46:17.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14852025-01-09T01:46:17.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14862025-01-09T01:46:17.223ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14872025-01-09T01:46:17.223ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14882025-01-09T01:46:17.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14892025-01-09T01:46:17.225ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14902025-01-09T01:46:17.227ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14912025-01-09T01:46:17.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14922025-01-09T01:46:17.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14932025-01-09T01:46:17.235ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14942025-01-09T01:46:17.235ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14952025-01-09T01:46:17.236ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7020af24-a89f-48f3-af2e-8f275e765f55", "content-length": "372", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
14962025-01-09T01:46:17.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14972025-01-09T01:46:17.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14982025-01-09T01:46:17.251ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
14992025-01-09T01:46:17.251ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15002025-01-09T01:46:17.251ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "52ae4403-b28a-451d-b56f-71a4ab3b449d", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
15012025-01-09T01:46:17.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15022025-01-09T01:46:17.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15032025-01-09T01:46:17.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15042025-01-09T01:46:17.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15052025-01-09T01:46:17.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15062025-01-09T01:46:17.255ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.021966ms iteration = 29 status = {"physical_disks_added":0}
15072025-01-09T01:46:17.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15082025-01-09T01:46:17.258ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15092025-01-09T01:46:17.258ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15102025-01-09T01:46:17.259ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c98d2555-87d9-4927-958a-d34d5ba937f1", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
15112025-01-09T01:46:17.260ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 208.23101ms iteration = 27 status = {}
15122025-01-09T01:46:17.263ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15132025-01-09T01:46:17.263ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f63c21-00bf-41fd-92d6-0598d4d08a8b", "content-length": "2", "date": "Thu, 09 Jan 2025 01:46:16 GMT"} })
15142025-01-09T01:46:17.264ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15152025-01-09T01:46:17.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15162025-01-09T01:46:17.266ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 215.10689ms iteration = 26 status = null
15172025-01-09T01:46:17.267ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.757691ms iteration = 26 status = {}
15182025-01-09T01:46:17.352ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15192025-01-09T01:46:17.352ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "12c3017f-1b59-40ff-91a4-a85ef1c098ef", "content-length": "691", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
15202025-01-09T01:46:17.352ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
15212025-01-09T01:46:17.352ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
15222025-01-09T01:46:17.352ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
15232025-01-09T01:46:17.354ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 302.205741ms iteration = 27 status = {}
15242025-01-09T01:46:17.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15252025-01-09T01:46:17.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15262025-01-09T01:46:17.361ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
15272025-01-09T01:46:17.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15282025-01-09T01:46:17.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15292025-01-09T01:46:17.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15302025-01-09T01:46:17.373ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f93d94d-fdf8-4278-b414-b772bf2d37b0", "content-length": "134", "date": "Thu, 09 Jan 2025 01:46:16 GMT"} })
15312025-01-09T01:46:17.373ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15322025-01-09T01:46:17.373ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
15332025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15342025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15352025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15362025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15372025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15382025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15392025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15402025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15412025-01-09T01:46:17.374ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
15422025-01-09T01:46:17.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15432025-01-09T01:46:17.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15442025-01-09T01:46:17.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15452025-01-09T01:46:17.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ee2b513-a90f-4989-8951-fafa310672a9", "content-length": "2", "date": "Thu, 09 Jan 2025 01:46:16 GMT"} })
15462025-01-09T01:46:17.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15472025-01-09T01:46:17.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca0bafa5-c79c-429f-88aa-a76384440a9b", "content-length": "52", "date": "Thu, 09 Jan 2025 01:46:16 GMT"} })
15482025-01-09T01:46:17.377ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
15492025-01-09T01:46:17.377ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15502025-01-09T01:46:17.491ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "882a5382-c031-4d71-88cb-42b0d084014e", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
15512025-01-09T01:46:17.491ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
15522025-01-09T01:46:17.491ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15532025-01-09T01:46:17.496ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f98cfe43-bbf6-460f-8f04-e4952dd108e3", "content-length": "682", "date": "Thu, 09 Jan 2025 01:46:17 GMT"} })
15542025-01-09T01:46:17.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15552025-01-09T01:46:17.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15562025-01-09T01:46:17.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15572025-01-09T01:46:17.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15582025-01-09T01:46:17.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15592025-01-09T01:46:17.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15602025-01-09T01:46:17.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15612025-01-09T01:46:17.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15622025-01-09T01:46:17.515ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 462.331387ms iteration = 26 status = {}
15632025-01-09T01:46:17.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d19c635c-671c-4a5c-9afc-7764e33fb284 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15642025-01-09T01:46:17.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d19c635c-671c-4a5c-9afc-7764e33fb284 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15652025-01-09T01:46:17.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d19c635c-671c-4a5c-9afc-7764e33fb284 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15662025-01-09T01:46:18.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0817f28-7ce9-4821-84ef-895ab4e95024 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15672025-01-09T01:46:18.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0817f28-7ce9-4821-84ef-895ab4e95024 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15682025-01-09T01:46:18.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0817f28-7ce9-4821-84ef-895ab4e95024 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15692025-01-09T01:46:19.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f720366-739e-4b60-b5f0-5d4371294386 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15702025-01-09T01:46:19.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f720366-739e-4b60-b5f0-5d4371294386 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15712025-01-09T01:46:19.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4f720366-739e-4b60-b5f0-5d4371294386 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15722025-01-09T01:46:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 565 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 0c9b773d-f4da-4af7-b5c6-f8d14de26007 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
15732025-01-09T01:46:20.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6fbddb6-fa10-4ae0-b340-68069fb2dedc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15742025-01-09T01:46:20.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6fbddb6-fa10-4ae0-b340-68069fb2dedc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15752025-01-09T01:46:20.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6fbddb6-fa10-4ae0-b340-68069fb2dedc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15762025-01-09T01:46:21.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b7ed2794-4f0a-4482-8777-aa863b014d28 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15772025-01-09T01:46:21.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b7ed2794-4f0a-4482-8777-aa863b014d28 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15782025-01-09T01:46:21.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b7ed2794-4f0a-4482-8777-aa863b014d28 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15792025-01-09T01:46:22.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 24ed5f28-6c21-40ef-bf9d-2ae0f7cd073c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15802025-01-09T01:46:22.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 24ed5f28-6c21-40ef-bf9d-2ae0f7cd073c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15812025-01-09T01:46:22.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 24ed5f28-6c21-40ef-bf9d-2ae0f7cd073c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15822025-01-09T01:46:23.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38099f34-1783-4fc6-8a66-cbd1795ed560 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15832025-01-09T01:46:23.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38099f34-1783-4fc6-8a66-cbd1795ed560 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15842025-01-09T01:46:23.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 38099f34-1783-4fc6-8a66-cbd1795ed560 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15852025-01-09T01:46:23.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fcde91e2-d064-49e2-b6eb-0598346e5791 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
15862025-01-09T01:46:23.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fcde91e2-d064-49e2-b6eb-0598346e5791 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
15872025-01-09T01:46:23.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = fcde91e2-d064-49e2-b6eb-0598346e5791 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
15882025-01-09T01:46:24.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40957b41-bac5-4823-87c3-063b2e476798 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15892025-01-09T01:46:24.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40957b41-bac5-4823-87c3-063b2e476798 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15902025-01-09T01:46:24.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 40957b41-bac5-4823-87c3-063b2e476798 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15912025-01-09T01:46:25.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59dc9302-c867-46c6-8aa0-a867f18bccdf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15922025-01-09T01:46:25.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59dc9302-c867-46c6-8aa0-a867f18bccdf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15932025-01-09T01:46:25.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 59dc9302-c867-46c6-8aa0-a867f18bccdf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15942025-01-09T01:46:26.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5fced104-bbeb-4eb3-b0a4-f064d3dd84be roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15952025-01-09T01:46:26.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5fced104-bbeb-4eb3-b0a4-f064d3dd84be resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15962025-01-09T01:46:26.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5fced104-bbeb-4eb3-b0a4-f064d3dd84be response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
15972025-01-09T01:46:27.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
15982025-01-09T01:46:27.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15992025-01-09T01:46:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16002025-01-09T01:46:27.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
16012025-01-09T01:46:27.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16022025-01-09T01:46:27.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16032025-01-09T01:46:27.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16042025-01-09T01:46:27.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16052025-01-09T01:46:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16062025-01-09T01:46:27.057ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.507943ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16072025-01-09T01:46:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16082025-01-09T01:46:27.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16092025-01-09T01:46:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16102025-01-09T01:46:27.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16112025-01-09T01:46:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16122025-01-09T01:46:27.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16132025-01-09T01:46:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
16142025-01-09T01:46:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16152025-01-09T01:46:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16162025-01-09T01:46:27.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
16172025-01-09T01:46:27.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.112644ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
16182025-01-09T01:46:27.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 16929780-e988-445b-be6b-afd499ae436d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16192025-01-09T01:46:27.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 16929780-e988-445b-be6b-afd499ae436d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16202025-01-09T01:46:27.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 16929780-e988-445b-be6b-afd499ae436d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16212025-01-09T01:46:28.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e1a993db-cb4f-4308-a59a-71d00dce5cf2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16222025-01-09T01:46:28.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e1a993db-cb4f-4308-a59a-71d00dce5cf2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16232025-01-09T01:46:28.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e1a993db-cb4f-4308-a59a-71d00dce5cf2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16242025-01-09T01:46:29.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 629 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = f317311d-3c8b-4982-b3be-b81662f76792 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
16252025-01-09T01:46:29.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 046a78a9-6fcb-473e-846c-f49393cd45eb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16262025-01-09T01:46:29.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 046a78a9-6fcb-473e-846c-f49393cd45eb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16272025-01-09T01:46:29.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 046a78a9-6fcb-473e-846c-f49393cd45eb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16282025-01-09T01:46:30.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ee6e6656-43a5-4a2b-8f6d-1ec463b7487e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16292025-01-09T01:46:30.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ee6e6656-43a5-4a2b-8f6d-1ec463b7487e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16302025-01-09T01:46:30.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ee6e6656-43a5-4a2b-8f6d-1ec463b7487e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16312025-01-09T01:46:31.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b3421a0-476a-440e-8b2f-9752a788cb8a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16322025-01-09T01:46:31.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b3421a0-476a-440e-8b2f-9752a788cb8a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16332025-01-09T01:46:31.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b3421a0-476a-440e-8b2f-9752a788cb8a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16342025-01-09T01:46:32.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2619733-7f02-4901-860a-e96adf1eebce roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16352025-01-09T01:46:32.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2619733-7f02-4901-860a-e96adf1eebce resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16362025-01-09T01:46:32.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2619733-7f02-4901-860a-e96adf1eebce response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16372025-01-09T01:46:33.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44f22cfd-7d6c-4cb5-9ceb-683326f0fe89 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16382025-01-09T01:46:33.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44f22cfd-7d6c-4cb5-9ceb-683326f0fe89 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16392025-01-09T01:46:33.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 44f22cfd-7d6c-4cb5-9ceb-683326f0fe89 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16402025-01-09T01:46:34.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1f45fe90-89e8-4a80-b647-5586fc3edb8b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16412025-01-09T01:46:34.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1f45fe90-89e8-4a80-b647-5586fc3edb8b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16422025-01-09T01:46:34.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1f45fe90-89e8-4a80-b647-5586fc3edb8b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16432025-01-09T01:46:35.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2967aaf6-3636-45ea-be13-886be25d5585 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16442025-01-09T01:46:35.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2967aaf6-3636-45ea-be13-886be25d5585 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16452025-01-09T01:46:35.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2967aaf6-3636-45ea-be13-886be25d5585 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16462025-01-09T01:46:36.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 200a1ea9-9918-4272-8169-e2ac9fb1134a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16472025-01-09T01:46:36.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 200a1ea9-9918-4272-8169-e2ac9fb1134a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16482025-01-09T01:46:36.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 200a1ea9-9918-4272-8169-e2ac9fb1134a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16492025-01-09T01:46:37.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
16502025-01-09T01:46:37.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16512025-01-09T01:46:37.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16522025-01-09T01:46:37.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
16532025-01-09T01:46:37.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16542025-01-09T01:46:37.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16552025-01-09T01:46:37.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562025-01-09T01:46:37.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16572025-01-09T01:46:37.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16582025-01-09T01:46:37.056ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.31744ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16592025-01-09T01:46:37.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16602025-01-09T01:46:37.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16612025-01-09T01:46:37.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16622025-01-09T01:46:37.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16632025-01-09T01:46:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16642025-01-09T01:46:37.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652025-01-09T01:46:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
16662025-01-09T01:46:37.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16672025-01-09T01:46:37.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16682025-01-09T01:46:37.076ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
16692025-01-09T01:46:37.076ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.209939ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
16702025-01-09T01:46:37.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36a4b033-e82b-4052-afaa-994a4da196fa roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16712025-01-09T01:46:37.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36a4b033-e82b-4052-afaa-994a4da196fa resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16722025-01-09T01:46:37.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 36a4b033-e82b-4052-afaa-994a4da196fa response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16732025-01-09T01:46:39.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 66459018-cd9b-4f04-87df-9c63f82862e0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16742025-01-09T01:46:39.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 66459018-cd9b-4f04-87df-9c63f82862e0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16752025-01-09T01:46:39.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 66459018-cd9b-4f04-87df-9c63f82862e0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16762025-01-09T01:46:39.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1051 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 65770348-27e4-4f9b-89f5-add4e24ad83e response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
16772025-01-09T01:46:40.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7b3b9de9-4796-4e9c-a9ca-7990a867d42e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16782025-01-09T01:46:40.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7b3b9de9-4796-4e9c-a9ca-7990a867d42e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16792025-01-09T01:46:40.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7b3b9de9-4796-4e9c-a9ca-7990a867d42e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16802025-01-09T01:46:41.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bfa22d00-5dc8-4cad-a7bd-d0c458db5f9b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16812025-01-09T01:46:41.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bfa22d00-5dc8-4cad-a7bd-d0c458db5f9b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16822025-01-09T01:46:41.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bfa22d00-5dc8-4cad-a7bd-d0c458db5f9b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16832025-01-09T01:46:42.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cf0940cc-ea96-4bc5-9213-9f84187fa5be roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16842025-01-09T01:46:42.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cf0940cc-ea96-4bc5-9213-9f84187fa5be resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16852025-01-09T01:46:42.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cf0940cc-ea96-4bc5-9213-9f84187fa5be response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16862025-01-09T01:46:43.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1116c944-192a-4f57-858a-91a1c4667924 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16872025-01-09T01:46:43.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1116c944-192a-4f57-858a-91a1c4667924 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16882025-01-09T01:46:43.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1116c944-192a-4f57-858a-91a1c4667924 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16892025-01-09T01:46:44.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5b73454-15e4-4d9c-a703-5a87ecc6382b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16902025-01-09T01:46:44.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5b73454-15e4-4d9c-a703-5a87ecc6382b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16912025-01-09T01:46:44.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a5b73454-15e4-4d9c-a703-5a87ecc6382b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16922025-01-09T01:46:44.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 98ee5cdf-9c7e-4c16-b930-60ead7efb33f roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
16932025-01-09T01:46:44.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 98ee5cdf-9c7e-4c16-b930-60ead7efb33f resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
16942025-01-09T01:46:44.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2888 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 98ee5cdf-9c7e-4c16-b930-60ead7efb33f response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
16952025-01-09T01:46:44.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 2e128089-a7f7-4118-b3c7-2c42e4afa6cd roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
16962025-01-09T01:46:44.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 2e128089-a7f7-4118-b3c7-2c42e4afa6cd resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
16972025-01-09T01:46:44.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 2e128089-a7f7-4118-b3c7-2c42e4afa6cd response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
16982025-01-09T01:46:45.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5deab17b-c41b-4b56-a7fe-4bbf698c20fa roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
16992025-01-09T01:46:45.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5deab17b-c41b-4b56-a7fe-4bbf698c20fa resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
17002025-01-09T01:46:45.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5deab17b-c41b-4b56-a7fe-4bbf698c20fa response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
17012025-01-09T01:46:46.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22bc3222-e155-443c-8c17-070da4c36aba roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
17022025-01-09T01:46:46.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22bc3222-e155-443c-8c17-070da4c36aba resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
17032025-01-09T01:46:46.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 22bc3222-e155-443c-8c17-070da4c36aba response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
17042025-01-09T01:46:47.051ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
17052025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
17062025-01-09T01:46:47.052ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
17072025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.02\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
17082025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
17092025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
17102025-01-09T01:46:47.052ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:36:47.051957257 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17112025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
17122025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17132025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17142025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
17152025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
17162025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17172025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17182025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
17192025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
17202025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
17212025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17222025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
17232025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
17242025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17252025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17262025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
17272025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17282025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17292025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17302025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17312025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17322025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
17332025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
17342025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17352025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17362025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17372025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17382025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
17392025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17402025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17412025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17422025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
17432025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
17442025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17452025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
17462025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17472025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
17482025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17492025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
17502025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17512025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17522025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
17532025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17542025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
17552025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17562025-01-09T01:46:47.052ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17572025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17582025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
17592025-01-09T01:46:47.052ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
17602025-01-09T01:46:47.052ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17612025-01-09T01:46:47.053ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1739, tv_nsec: 5321386 } })
17622025-01-09T01:46:47.053ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1739, tv_nsec: 5377137 } })
17632025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17642025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17652025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17662025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17672025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17682025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17692025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17702025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17712025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17722025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17732025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17742025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
17752025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.459893ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
17762025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
17772025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.391873ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
17782025-01-09T01:46:47.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17792025-01-09T01:46:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17802025-01-09T01:46:47.055ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:36:47.051957257 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17812025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.130331ms iteration = 14 status = {"expiration":"2025-01-09T01:36:47.051957257Z","pruned":[]}
17822025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
17832025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
17842025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17852025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17862025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
17872025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17882025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
17892025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.475516ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17902025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17912025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
17922025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17932025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
17942025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17952025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17962025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17972025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17982025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17992025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18002025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18012025-01-09T01:46:47.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18022025-01-09T01:46:47.056ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1739, tv_nsec: 8428226 } })
18032025-01-09T01:46:47.056ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
18042025-01-09T01:46:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18052025-01-09T01:46:47.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18062025-01-09T01:46:47.057ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1739, tv_nsec: 9667926 } })
18072025-01-09T01:46:47.057ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
18082025-01-09T01:46:47.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18092025-01-09T01:46:47.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18102025-01-09T01:46:47.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18112025-01-09T01:46:47.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18122025-01-09T01:46:47.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18132025-01-09T01:46:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18142025-01-09T01:46:47.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18152025-01-09T01:46:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18162025-01-09T01:46:47.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18172025-01-09T01:46:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18182025-01-09T01:46:47.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18192025-01-09T01:46:47.061ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18202025-01-09T01:46:47.061ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18212025-01-09T01:46:47.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18222025-01-09T01:46:47.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18232025-01-09T01:46:47.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18242025-01-09T01:46:47.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18252025-01-09T01:46:47.063ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18262025-01-09T01:46:47.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18272025-01-09T01:46:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18282025-01-09T01:46:47.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18292025-01-09T01:46:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18302025-01-09T01:46:47.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18312025-01-09T01:46:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18322025-01-09T01:46:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18332025-01-09T01:46:47.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18342025-01-09T01:46:47.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18352025-01-09T01:46:47.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18362025-01-09T01:46:47.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18372025-01-09T01:46:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18382025-01-09T01:46:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18392025-01-09T01:46:47.069ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18402025-01-09T01:46:47.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.160307ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
18412025-01-09T01:46:47.069ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422025-01-09T01:46:47.071ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.730153ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
18432025-01-09T01:46:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18442025-01-09T01:46:47.073ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18452025-01-09T01:46:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18462025-01-09T01:46:47.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18472025-01-09T01:46:47.076ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18482025-01-09T01:46:47.076ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18492025-01-09T01:46:47.076ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18502025-01-09T01:46:47.076ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18512025-01-09T01:46:47.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18522025-01-09T01:46:47.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18532025-01-09T01:46:47.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18542025-01-09T01:46:47.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18552025-01-09T01:46:47.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18562025-01-09T01:46:47.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18572025-01-09T01:46:47.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18582025-01-09T01:46:47.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18592025-01-09T01:46:47.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18602025-01-09T01:46:47.079ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18612025-01-09T01:46:47.079ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18622025-01-09T01:46:47.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18632025-01-09T01:46:47.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18642025-01-09T01:46:47.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18652025-01-09T01:46:47.080ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1739, tv_nsec: 32637206 } })
18662025-01-09T01:46:47.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18672025-01-09T01:46:47.080ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
18682025-01-09T01:46:47.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18692025-01-09T01:46:47.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702025-01-09T01:46:47.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18712025-01-09T01:46:47.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18722025-01-09T01:46:47.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732025-01-09T01:46:47.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18742025-01-09T01:46:47.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18752025-01-09T01:46:47.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18762025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18772025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18782025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18792025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
18802025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18812025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18822025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18832025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18842025-01-09T01:46:47.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18852025-01-09T01:46:47.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18862025-01-09T01:46:47.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18872025-01-09T01:46:47.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18882025-01-09T01:46:47.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18892025-01-09T01:46:47.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18902025-01-09T01:46:47.109ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18912025-01-09T01:46:47.109ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 56.729513ms iteration = 30 status = {"physical_disks_added":0}
18922025-01-09T01:46:47.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18932025-01-09T01:46:47.112ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
18942025-01-09T01:46:47.112ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.31019ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
18952025-01-09T01:46:47.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18962025-01-09T01:46:47.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18972025-01-09T01:46:47.125ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18982025-01-09T01:46:47.125ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18992025-01-09T01:46:47.125ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.863253ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19002025-01-09T01:46:47.127ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19012025-01-09T01:46:47.127ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19022025-01-09T01:46:47.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19032025-01-09T01:46:47.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19042025-01-09T01:46:47.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.343239ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
19052025-01-09T01:46:47.133ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19062025-01-09T01:46:47.133ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19072025-01-09T01:46:47.133ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.228261ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19082025-01-09T01:46:47.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19092025-01-09T01:46:47.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19102025-01-09T01:46:47.140ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19112025-01-09T01:46:47.140ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.440077ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19122025-01-09T01:46:47.142ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19132025-01-09T01:46:47.142ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19142025-01-09T01:46:47.142ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.954937ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19152025-01-09T01:46:47.143ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19162025-01-09T01:46:47.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19172025-01-09T01:46:47.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19182025-01-09T01:46:47.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19192025-01-09T01:46:47.190ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19202025-01-09T01:46:47.190ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19212025-01-09T01:46:47.190ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19222025-01-09T01:46:47.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19232025-01-09T01:46:47.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19242025-01-09T01:46:47.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ad1614a-6e3b-4d01-85ae-cd6d0ef33c84 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
19252025-01-09T01:46:47.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ad1614a-6e3b-4d01-85ae-cd6d0ef33c84 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
19262025-01-09T01:46:47.200ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
19272025-01-09T01:46:47.218ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19282025-01-09T01:46:47.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19292025-01-09T01:46:47.219ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19302025-01-09T01:46:47.219ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19312025-01-09T01:46:47.219ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b579f6d-e581-4b2e-b97b-74371cffaac6", "content-length": "26", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
19322025-01-09T01:46:47.219ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19332025-01-09T01:46:47.221ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19342025-01-09T01:46:47.222ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
19352025-01-09T01:46:47.241ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
19362025-01-09T01:46:47.242ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19372025-01-09T01:46:47.242ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "340e9ac4-adad-43b4-b840-5d801f1ebade", "content-length": "26", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
19382025-01-09T01:46:47.242ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19392025-01-09T01:46:47.243ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19402025-01-09T01:46:47.245ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19412025-01-09T01:46:47.245ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19422025-01-09T01:46:47.245ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c89921a8-41c7-49f2-8757-fcfbcc9b50b3", "content-length": "372", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
19432025-01-09T01:46:47.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19442025-01-09T01:46:47.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19452025-01-09T01:46:47.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 194.221724ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19462025-01-09T01:46:47.247ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19472025-01-09T01:46:47.247ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19482025-01-09T01:46:47.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19492025-01-09T01:46:47.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19502025-01-09T01:46:47.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19512025-01-09T01:46:47.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19522025-01-09T01:46:47.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19532025-01-09T01:46:47.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0ad1614a-6e3b-4d01-85ae-cd6d0ef33c84 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
19542025-01-09T01:46:47.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19552025-01-09T01:46:47.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19562025-01-09T01:46:47.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19572025-01-09T01:46:47.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19582025-01-09T01:46:47.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19592025-01-09T01:46:47.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19602025-01-09T01:46:47.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19612025-01-09T01:46:47.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
19622025-01-09T01:46:47.267ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19632025-01-09T01:46:47.267ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb5b0900-32d8-4e6a-a585-59fbe8affb82", "content-length": "26", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
19642025-01-09T01:46:47.267ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19652025-01-09T01:46:47.269ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
19662025-01-09T01:46:47.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 234.103406ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19672025-01-09T01:46:47.294ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 241.479824ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19682025-01-09T01:46:47.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 241.042327ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19692025-01-09T01:46:47.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702025-01-09T01:46:47.309ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19712025-01-09T01:46:47.309ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
19722025-01-09T01:46:47.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19732025-01-09T01:46:47.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19742025-01-09T01:46:47.310ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19752025-01-09T01:46:47.312ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
19762025-01-09T01:46:47.312ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 260.148024ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19772025-01-09T01:46:47.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19782025-01-09T01:46:47.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19792025-01-09T01:46:47.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
19802025-01-09T01:46:47.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19812025-01-09T01:46:47.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19822025-01-09T01:46:47.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19832025-01-09T01:46:47.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19842025-01-09T01:46:47.316ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
19852025-01-09T01:46:47.316ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19862025-01-09T01:46:47.316ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
19872025-01-09T01:46:47.316ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 264.296402ms iteration = 14 status = {"generation":1}
19882025-01-09T01:46:47.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19892025-01-09T01:46:47.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19902025-01-09T01:46:47.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19912025-01-09T01:46:47.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19922025-01-09T01:46:47.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19932025-01-09T01:46:47.319ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 266.236773ms iteration = 27 status = 0
19942025-01-09T01:46:47.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19952025-01-09T01:46:47.319ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
19962025-01-09T01:46:47.319ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19972025-01-09T01:46:47.319ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
19982025-01-09T01:46:47.319ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 267.148368ms iteration = 14 status = {"generation":2}
19992025-01-09T01:46:47.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20002025-01-09T01:46:47.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20012025-01-09T01:46:47.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20022025-01-09T01:46:47.336ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
20032025-01-09T01:46:47.336ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 284.10772ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20042025-01-09T01:46:47.337ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20052025-01-09T01:46:47.337ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20062025-01-09T01:46:47.337ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "72da6913-3ee9-4be6-8fb3-5ca322204a72", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
20072025-01-09T01:46:47.337ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20082025-01-09T01:46:47.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20092025-01-09T01:46:47.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20102025-01-09T01:46:47.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20112025-01-09T01:46:47.341ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
20122025-01-09T01:46:47.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20132025-01-09T01:46:47.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20142025-01-09T01:46:47.348ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20152025-01-09T01:46:47.348ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20162025-01-09T01:46:47.349ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86d5fa88-1edb-4b67-8cab-6364eaba5f11", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
20172025-01-09T01:46:47.352ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 299.382036ms iteration = 28 status = {}
20182025-01-09T01:46:47.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20192025-01-09T01:46:47.360ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20202025-01-09T01:46:47.360ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20212025-01-09T01:46:47.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20222025-01-09T01:46:47.362ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20232025-01-09T01:46:47.362ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "847d0bfc-bcf4-48cc-a5da-26fdb900f837", "content-length": "2", "date": "Thu, 09 Jan 2025 01:46:46 GMT"} })
20242025-01-09T01:46:47.364ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20252025-01-09T01:46:47.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20262025-01-09T01:46:47.366ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 314.673302ms iteration = 27 status = null
20272025-01-09T01:46:47.388ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
20282025-01-09T01:46:47.389ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d4c98761-da29-4545-8086-81df80430236", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20292025-01-09T01:46:47.389ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20302025-01-09T01:46:47.392ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8c62461b-3059-4f01-8109-22c060493ae2", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20312025-01-09T01:46:47.392ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20322025-01-09T01:46:47.394ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
20332025-01-09T01:46:47.394ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 342.657092ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
20342025-01-09T01:46:47.395ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 343.574817ms iteration = 27 status = {}
20352025-01-09T01:46:47.453ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
20362025-01-09T01:46:47.454ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "dbe479ce-2644-434e-9466-b64f95becda4", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20372025-01-09T01:46:47.454ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20382025-01-09T01:46:47.457ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f677d9d6-b806-4bbd-9689-f774957226b3", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20392025-01-09T01:46:47.457ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20402025-01-09T01:46:47.458ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "46d6269d-6017-450a-873e-9b61ee86377b", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20412025-01-09T01:46:47.458ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20422025-01-09T01:46:47.461ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
20432025-01-09T01:46:47.461ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 409.168682ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
20442025-01-09T01:46:47.528ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20452025-01-09T01:46:47.528ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a64cafb8-de0e-44f4-be0f-3c12b46df2c6", "content-length": "691", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
20462025-01-09T01:46:47.528ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20472025-01-09T01:46:47.528ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20482025-01-09T01:46:47.528ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20492025-01-09T01:46:47.530ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 477.290078ms iteration = 28 status = {}
20502025-01-09T01:46:47.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20512025-01-09T01:46:47.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20522025-01-09T01:46:47.544ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
20532025-01-09T01:46:47.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20542025-01-09T01:46:47.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20552025-01-09T01:46:47.555ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20562025-01-09T01:46:47.556ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d72f523-7a3c-48df-8d62-c194bb228332", "content-length": "134", "date": "Thu, 09 Jan 2025 01:46:46 GMT"} })
20572025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20582025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
20592025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20602025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20612025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20622025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20632025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20642025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20652025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20662025-01-09T01:46:47.556ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20672025-01-09T01:46:47.557ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
20682025-01-09T01:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20692025-01-09T01:46:47.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20702025-01-09T01:46:47.559ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20712025-01-09T01:46:47.559ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcc49dd9-2515-41ad-827f-b2f3d8ad6b2b", "content-length": "2", "date": "Thu, 09 Jan 2025 01:46:46 GMT"} })
20722025-01-09T01:46:47.559ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20732025-01-09T01:46:47.560ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "297a368b-e63c-4753-9607-dc84c5751bc6", "content-length": "52", "date": "Thu, 09 Jan 2025 01:46:46 GMT"} })
20742025-01-09T01:46:47.560ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
20752025-01-09T01:46:47.560ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20762025-01-09T01:46:47.657ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0dec1199-440a-4edf-a48e-d1666f7fbf4c", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
20772025-01-09T01:46:47.657ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
20782025-01-09T01:46:47.657ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20792025-01-09T01:46:47.752ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b71c48c-21c0-48ae-b60b-2b0b7db3bba4", "content-length": "682", "date": "Thu, 09 Jan 2025 01:46:47 GMT"} })
20802025-01-09T01:46:47.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20812025-01-09T01:46:47.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20822025-01-09T01:46:47.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20832025-01-09T01:46:47.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20842025-01-09T01:46:47.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20852025-01-09T01:46:47.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20862025-01-09T01:46:47.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20872025-01-09T01:46:47.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20882025-01-09T01:46:47.770ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 717.742146ms iteration = 27 status = {}
20892025-01-09T01:46:48.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bbbc2d61-77a1-41c5-9d2a-0d7cfaca0963 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20902025-01-09T01:46:48.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bbbc2d61-77a1-41c5-9d2a-0d7cfaca0963 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20912025-01-09T01:46:48.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bbbc2d61-77a1-41c5-9d2a-0d7cfaca0963 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20922025-01-09T01:46:49.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 61441e8b-4bba-431b-8e8b-557e76531d7a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20932025-01-09T01:46:49.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 61441e8b-4bba-431b-8e8b-557e76531d7a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20942025-01-09T01:46:49.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 61441e8b-4bba-431b-8e8b-557e76531d7a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20952025-01-09T01:46:49.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 606 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 6d9fa1d7-05ee-4d45-9566-0986a6495075 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
20962025-01-09T01:46:50.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a391158-8d30-4b5c-825d-410dcd0d1cc6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20972025-01-09T01:46:50.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a391158-8d30-4b5c-825d-410dcd0d1cc6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20982025-01-09T01:46:50.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a391158-8d30-4b5c-825d-410dcd0d1cc6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
20992025-01-09T01:46:51.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 052d0811-ad41-4c72-a9a4-e07dbe3ff3aa roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21002025-01-09T01:46:51.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 052d0811-ad41-4c72-a9a4-e07dbe3ff3aa resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21012025-01-09T01:46:51.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 052d0811-ad41-4c72-a9a4-e07dbe3ff3aa response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21022025-01-09T01:46:52.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6906892e-b759-4fa8-8dad-91c92d821a86 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21032025-01-09T01:46:52.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6906892e-b759-4fa8-8dad-91c92d821a86 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21042025-01-09T01:46:52.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6906892e-b759-4fa8-8dad-91c92d821a86 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21052025-01-09T01:46:53.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8694b8d7-2f9f-46a8-9733-3cd6dcc91892 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21062025-01-09T01:46:53.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8694b8d7-2f9f-46a8-9733-3cd6dcc91892 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21072025-01-09T01:46:53.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8694b8d7-2f9f-46a8-9733-3cd6dcc91892 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21082025-01-09T01:46:54.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5bc7e1b8-32a9-4afe-83fb-dd79315b4397 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
21092025-01-09T01:46:54.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5bc7e1b8-32a9-4afe-83fb-dd79315b4397 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
21102025-01-09T01:46:54.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5bc7e1b8-32a9-4afe-83fb-dd79315b4397 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
21112025-01-09T01:46:54.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a293feb-b5e7-4f99-916d-290296f62628 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21122025-01-09T01:46:54.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a293feb-b5e7-4f99-916d-290296f62628 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21132025-01-09T01:46:54.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a293feb-b5e7-4f99-916d-290296f62628 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21142025-01-09T01:46:55.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ddcb893c-1b77-418f-9384-8c750a1de84f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21152025-01-09T01:46:55.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ddcb893c-1b77-418f-9384-8c750a1de84f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21162025-01-09T01:46:55.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ddcb893c-1b77-418f-9384-8c750a1de84f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21172025-01-09T01:46:56.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7ff283f0-db7b-4f7c-b060-c398326424cd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21182025-01-09T01:46:56.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7ff283f0-db7b-4f7c-b060-c398326424cd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21192025-01-09T01:46:56.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7ff283f0-db7b-4f7c-b060-c398326424cd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21202025-01-09T01:46:57.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
21212025-01-09T01:46:57.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21222025-01-09T01:46:57.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21232025-01-09T01:46:57.052ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
21242025-01-09T01:46:57.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21252025-01-09T01:46:57.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21262025-01-09T01:46:57.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21272025-01-09T01:46:57.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21282025-01-09T01:46:57.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21292025-01-09T01:46:57.057ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.078085ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21302025-01-09T01:46:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21312025-01-09T01:46:57.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21322025-01-09T01:46:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21332025-01-09T01:46:57.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21342025-01-09T01:46:57.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21352025-01-09T01:46:57.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21362025-01-09T01:46:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
21372025-01-09T01:46:57.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21382025-01-09T01:46:57.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21392025-01-09T01:46:57.074ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
21402025-01-09T01:46:57.074ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.999284ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
21412025-01-09T01:46:57.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 87c58e56-8a9b-45b2-8dd9-6ed04db95976 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21422025-01-09T01:46:57.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 87c58e56-8a9b-45b2-8dd9-6ed04db95976 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21432025-01-09T01:46:57.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 87c58e56-8a9b-45b2-8dd9-6ed04db95976 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21442025-01-09T01:46:58.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b390f71-f49d-4f04-88f7-fda2de3bdf0d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21452025-01-09T01:46:58.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b390f71-f49d-4f04-88f7-fda2de3bdf0d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21462025-01-09T01:46:58.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b390f71-f49d-4f04-88f7-fda2de3bdf0d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21472025-01-09T01:46:59.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95fde801-282e-4a0b-8385-26297d9f37a8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21482025-01-09T01:46:59.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95fde801-282e-4a0b-8385-26297d9f37a8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21492025-01-09T01:46:59.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 95fde801-282e-4a0b-8385-26297d9f37a8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21502025-01-09T01:46:59.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 632 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = cc4ece58-4e07-43fa-a6dc-03779b6fca21 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
21512025-01-09T01:47:00.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33cb4cd0-0d6b-4e75-9594-bd63ebcac016 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21522025-01-09T01:47:00.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33cb4cd0-0d6b-4e75-9594-bd63ebcac016 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21532025-01-09T01:47:00.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 33cb4cd0-0d6b-4e75-9594-bd63ebcac016 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21542025-01-09T01:47:01.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a83c21b4-5d12-468e-babc-fe69fef3c995 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21552025-01-09T01:47:01.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a83c21b4-5d12-468e-babc-fe69fef3c995 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21562025-01-09T01:47:01.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a83c21b4-5d12-468e-babc-fe69fef3c995 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21572025-01-09T01:47:02.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eee9db88-38ef-476c-99ef-4193194653e0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21582025-01-09T01:47:02.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eee9db88-38ef-476c-99ef-4193194653e0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21592025-01-09T01:47:02.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = eee9db88-38ef-476c-99ef-4193194653e0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21602025-01-09T01:47:03.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 35aeac78-15b3-456e-b518-efafaf3fdcc2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21612025-01-09T01:47:03.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 35aeac78-15b3-456e-b518-efafaf3fdcc2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21622025-01-09T01:47:03.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 35aeac78-15b3-456e-b518-efafaf3fdcc2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21632025-01-09T01:47:04.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8c3dec45-6aff-4a76-aa48-80b68f06c08e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21642025-01-09T01:47:04.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8c3dec45-6aff-4a76-aa48-80b68f06c08e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21652025-01-09T01:47:04.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8c3dec45-6aff-4a76-aa48-80b68f06c08e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21662025-01-09T01:47:05.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0bf843e6-1876-4cac-8a64-bb58064aed88 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21672025-01-09T01:47:05.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0bf843e6-1876-4cac-8a64-bb58064aed88 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21682025-01-09T01:47:05.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0bf843e6-1876-4cac-8a64-bb58064aed88 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21692025-01-09T01:47:06.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 42510815-9622-4075-8be8-c048eaced4fb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21702025-01-09T01:47:06.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 42510815-9622-4075-8be8-c048eaced4fb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21712025-01-09T01:47:06.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 42510815-9622-4075-8be8-c048eaced4fb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21722025-01-09T01:47:07.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
21732025-01-09T01:47:07.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21742025-01-09T01:47:07.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21752025-01-09T01:47:07.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
21762025-01-09T01:47:07.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21772025-01-09T01:47:07.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21782025-01-09T01:47:07.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21792025-01-09T01:47:07.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21802025-01-09T01:47:07.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21812025-01-09T01:47:07.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21822025-01-09T01:47:07.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21832025-01-09T01:47:07.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21842025-01-09T01:47:07.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21852025-01-09T01:47:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21862025-01-09T01:47:07.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21872025-01-09T01:47:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
21882025-01-09T01:47:07.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21892025-01-09T01:47:07.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21902025-01-09T01:47:07.075ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
21912025-01-09T01:47:07.075ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.119232ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
21922025-01-09T01:47:07.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.957688ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21932025-01-09T01:47:07.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3cb888c-0675-404c-9206-fe9ff037b33a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21942025-01-09T01:47:07.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3cb888c-0675-404c-9206-fe9ff037b33a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21952025-01-09T01:47:07.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3cb888c-0675-404c-9206-fe9ff037b33a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21962025-01-09T01:47:08.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e434efb-0ff2-4f83-ae96-82a60726f913 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21972025-01-09T01:47:08.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e434efb-0ff2-4f83-ae96-82a60726f913 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21982025-01-09T01:47:08.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e434efb-0ff2-4f83-ae96-82a60726f913 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
21992025-01-09T01:47:09.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 672 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 718f88e1-4f2b-41a9-98d8-e2d2cdf6bca6 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
22002025-01-09T01:47:09.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e375844-7d57-44fc-95aa-e3db65dc002d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22012025-01-09T01:47:09.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e375844-7d57-44fc-95aa-e3db65dc002d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22022025-01-09T01:47:09.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e375844-7d57-44fc-95aa-e3db65dc002d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22032025-01-09T01:47:10.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a40b4a89-64ca-438e-a9a7-755441ff8955 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22042025-01-09T01:47:10.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a40b4a89-64ca-438e-a9a7-755441ff8955 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22052025-01-09T01:47:10.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a40b4a89-64ca-438e-a9a7-755441ff8955 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22062025-01-09T01:47:11.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 068c24d7-0665-4783-950f-e01dbcb29d06 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22072025-01-09T01:47:11.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 068c24d7-0665-4783-950f-e01dbcb29d06 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22082025-01-09T01:47:11.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 068c24d7-0665-4783-950f-e01dbcb29d06 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22092025-01-09T01:47:12.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5aef7ce-6f12-4f3e-96c2-0d5d13fac406 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22102025-01-09T01:47:12.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5aef7ce-6f12-4f3e-96c2-0d5d13fac406 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22112025-01-09T01:47:12.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5aef7ce-6f12-4f3e-96c2-0d5d13fac406 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22122025-01-09T01:47:13.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72ce08d0-eb31-4eab-856d-7f06b3fec79e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22132025-01-09T01:47:13.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72ce08d0-eb31-4eab-856d-7f06b3fec79e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22142025-01-09T01:47:13.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 72ce08d0-eb31-4eab-856d-7f06b3fec79e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22152025-01-09T01:47:14.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b97e65-b491-4df6-b242-fc78e4d83084 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22162025-01-09T01:47:14.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b97e65-b491-4df6-b242-fc78e4d83084 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22172025-01-09T01:47:14.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b97e65-b491-4df6-b242-fc78e4d83084 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22182025-01-09T01:47:15.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cedb7636-9489-4e5a-8f8f-cba807562db0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22192025-01-09T01:47:15.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cedb7636-9489-4e5a-8f8f-cba807562db0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22202025-01-09T01:47:15.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cedb7636-9489-4e5a-8f8f-cba807562db0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22212025-01-09T01:47:16.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9411cb99-d852-4e03-9129-23338730e9cf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22222025-01-09T01:47:16.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9411cb99-d852-4e03-9129-23338730e9cf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22232025-01-09T01:47:16.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9411cb99-d852-4e03-9129-23338730e9cf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
22242025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
22252025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22262025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
22272025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22282025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
22292025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
22302025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22312025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22322025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22332025-01-09T01:47:17.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22342025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
22352025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
22362025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
22372025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22382025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22392025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
22402025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22412025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22422025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
22432025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22442025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
22452025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22462025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
22472025-01-09T01:47:17.053ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22482025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
22492025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22502025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22512025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22522025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
22532025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22542025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22552025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22562025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22572025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22582025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22592025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22602025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22612025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22622025-01-09T01:47:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22632025-01-09T01:47:17.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
22642025-01-09T01:47:17.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
22652025-01-09T01:47:17.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22662025-01-09T01:47:17.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22672025-01-09T01:47:17.055ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1769, tv_nsec: 7233057 } })
22682025-01-09T01:47:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22692025-01-09T01:47:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22702025-01-09T01:47:17.055ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
22712025-01-09T01:47:17.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22722025-01-09T01:47:17.056ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
22732025-01-09T01:47:17.056ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
22742025-01-09T01:47:17.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22752025-01-09T01:47:17.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22762025-01-09T01:47:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22772025-01-09T01:47:17.056ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1769, tv_nsec: 8646920 } })
22782025-01-09T01:47:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22792025-01-09T01:47:17.056ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
22802025-01-09T01:47:17.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22812025-01-09T01:47:17.057ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.322316ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22822025-01-09T01:47:17.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22832025-01-09T01:47:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22842025-01-09T01:47:17.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22852025-01-09T01:47:17.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22862025-01-09T01:47:17.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22872025-01-09T01:47:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22882025-01-09T01:47:17.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22892025-01-09T01:47:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22902025-01-09T01:47:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22912025-01-09T01:47:17.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22922025-01-09T01:47:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22932025-01-09T01:47:17.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22942025-01-09T01:47:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22952025-01-09T01:47:17.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22962025-01-09T01:47:17.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22972025-01-09T01:47:17.064ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22982025-01-09T01:47:17.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.571504ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
22992025-01-09T01:47:17.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23002025-01-09T01:47:17.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23012025-01-09T01:47:17.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23022025-01-09T01:47:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23032025-01-09T01:47:17.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23042025-01-09T01:47:17.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23052025-01-09T01:47:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23062025-01-09T01:47:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23072025-01-09T01:47:17.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.834873ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
23082025-01-09T01:47:17.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23092025-01-09T01:47:17.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23102025-01-09T01:47:17.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23112025-01-09T01:47:17.072ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1769, tv_nsec: 24442094 } })
23122025-01-09T01:47:17.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23132025-01-09T01:47:17.072ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
23142025-01-09T01:47:17.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23152025-01-09T01:47:17.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23162025-01-09T01:47:17.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23172025-01-09T01:47:17.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23182025-01-09T01:47:17.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23192025-01-09T01:47:17.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23202025-01-09T01:47:17.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23212025-01-09T01:47:17.078ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23222025-01-09T01:47:17.078ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 25.206305ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23232025-01-09T01:47:17.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23242025-01-09T01:47:17.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23252025-01-09T01:47:17.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23262025-01-09T01:47:17.104ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23272025-01-09T01:47:17.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23282025-01-09T01:47:17.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23292025-01-09T01:47:17.105ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23302025-01-09T01:47:17.105ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23312025-01-09T01:47:17.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23322025-01-09T01:47:17.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23332025-01-09T01:47:17.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23342025-01-09T01:47:17.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23352025-01-09T01:47:17.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.67437ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23362025-01-09T01:47:17.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23372025-01-09T01:47:17.112ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23382025-01-09T01:47:17.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23392025-01-09T01:47:17.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23402025-01-09T01:47:17.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23412025-01-09T01:47:17.114ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23422025-01-09T01:47:17.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23432025-01-09T01:47:17.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.241518ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23442025-01-09T01:47:17.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23452025-01-09T01:47:17.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
23462025-01-09T01:47:17.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23472025-01-09T01:47:17.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23482025-01-09T01:47:17.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23492025-01-09T01:47:17.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23502025-01-09T01:47:17.137ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
23512025-01-09T01:47:17.137ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.891675ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
23522025-01-09T01:47:17.151ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23532025-01-09T01:47:17.151ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23542025-01-09T01:47:17.151ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23552025-01-09T01:47:17.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23562025-01-09T01:47:17.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
23572025-01-09T01:47:17.157ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23582025-01-09T01:47:17.157ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a35a386e-7f8b-4aca-9b46-4b78118f9a7b", "content-length": "26", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
23592025-01-09T01:47:17.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23602025-01-09T01:47:17.162ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23612025-01-09T01:47:17.167ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23622025-01-09T01:47:17.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23632025-01-09T01:47:17.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23642025-01-09T01:47:17.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
23652025-01-09T01:47:17.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23662025-01-09T01:47:17.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23672025-01-09T01:47:17.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23682025-01-09T01:47:17.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.123747ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23692025-01-09T01:47:17.175ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.149734ms iteration = 28 status = 0
23702025-01-09T01:47:17.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23712025-01-09T01:47:17.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23722025-01-09T01:47:17.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23732025-01-09T01:47:17.196ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23742025-01-09T01:47:17.196ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23752025-01-09T01:47:17.196ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.664765ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23762025-01-09T01:47:17.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 147.115457ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
23772025-01-09T01:47:17.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782025-01-09T01:47:17.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23792025-01-09T01:47:17.209ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23802025-01-09T01:47:17.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23812025-01-09T01:47:17.215ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.2373ms iteration = 31 status = {"physical_disks_added":0}
23822025-01-09T01:47:17.250ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
23832025-01-09T01:47:17.250ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23842025-01-09T01:47:17.251ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2634667d-a6ff-42ad-97bc-6aa4dfede73d", "content-length": "26", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
23852025-01-09T01:47:17.251ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23862025-01-09T01:47:17.253ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23872025-01-09T01:47:17.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
23882025-01-09T01:47:17.267ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23892025-01-09T01:47:17.267ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e581820c-614e-4263-834f-642040965d92", "content-length": "26", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
23902025-01-09T01:47:17.267ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23912025-01-09T01:47:17.269ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
23922025-01-09T01:47:17.276ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 224.413239ms iteration = 28 status = {}
23932025-01-09T01:47:17.279ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23942025-01-09T01:47:17.279ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23952025-01-09T01:47:17.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a50c852-2dab-4df2-aec1-0f80d3ba80c4", "content-length": "372", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
23962025-01-09T01:47:17.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23972025-01-09T01:47:17.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23982025-01-09T01:47:17.355ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23992025-01-09T01:47:17.355ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "041d2596-cbc9-46c9-ac7c-d30a324e1d18", "content-length": "2", "date": "Thu, 09 Jan 2025 01:47:16 GMT"} })
24002025-01-09T01:47:17.357ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24012025-01-09T01:47:17.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24022025-01-09T01:47:17.442ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24032025-01-09T01:47:17.445ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 393.369808ms iteration = 28 status = null
24042025-01-09T01:47:17.490ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24052025-01-09T01:47:17.490ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24062025-01-09T01:47:17.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24072025-01-09T01:47:17.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24082025-01-09T01:47:17.514ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
24092025-01-09T01:47:17.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24102025-01-09T01:47:17.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24112025-01-09T01:47:17.524ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24122025-01-09T01:47:17.524ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7a24427-6db9-4bde-8079-9f47ac3d6b90", "content-length": "134", "date": "Thu, 09 Jan 2025 01:47:16 GMT"} })
24132025-01-09T01:47:17.524ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24142025-01-09T01:47:17.524ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
24152025-01-09T01:47:17.524ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24162025-01-09T01:47:17.524ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24172025-01-09T01:47:17.524ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24182025-01-09T01:47:17.524ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24192025-01-09T01:47:17.524ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24202025-01-09T01:47:17.524ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24212025-01-09T01:47:17.525ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24222025-01-09T01:47:17.525ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24232025-01-09T01:47:17.525ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
24242025-01-09T01:47:17.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24252025-01-09T01:47:17.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24262025-01-09T01:47:17.528ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24272025-01-09T01:47:17.528ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "57e40077-dc2b-4dfb-9acd-59caa526329d", "content-length": "2", "date": "Thu, 09 Jan 2025 01:47:16 GMT"} })
24282025-01-09T01:47:17.528ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24292025-01-09T01:47:17.528ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ad0bcd6-41eb-49ac-a4fb-b4af9d1764c6", "content-length": "52", "date": "Thu, 09 Jan 2025 01:47:16 GMT"} })
24302025-01-09T01:47:17.528ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
24312025-01-09T01:47:17.528ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24322025-01-09T01:47:17.552ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "53fe5b9f-ad00-42c1-8eb2-86d133ea106b", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
24332025-01-09T01:47:17.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24342025-01-09T01:47:17.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24352025-01-09T01:47:17.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24362025-01-09T01:47:17.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24372025-01-09T01:47:17.556ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e43784d9-c7d0-44f7-b385-75949de42dd8", "content-length": "691", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
24382025-01-09T01:47:17.556ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24392025-01-09T01:47:17.556ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24402025-01-09T01:47:17.556ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24412025-01-09T01:47:17.557ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 504.330872ms iteration = 29 status = {}
24422025-01-09T01:47:17.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24432025-01-09T01:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24442025-01-09T01:47:17.563ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24452025-01-09T01:47:17.563ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24462025-01-09T01:47:17.563ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4203637c-28e9-42a8-95a5-d13ecf709db5", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
24472025-01-09T01:47:17.565ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 511.908155ms iteration = 29 status = {}
24482025-01-09T01:47:17.658ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "338531c6-3571-484b-92ed-a488185d755e", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
24492025-01-09T01:47:17.658ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
24502025-01-09T01:47:17.658ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24512025-01-09T01:47:17.659ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fa23ebc-9b2b-48d6-a1f4-4002bd1aff95", "content-length": "682", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
24522025-01-09T01:47:17.659ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24532025-01-09T01:47:17.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24542025-01-09T01:47:17.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24552025-01-09T01:47:17.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24562025-01-09T01:47:17.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24572025-01-09T01:47:17.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24582025-01-09T01:47:17.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24592025-01-09T01:47:17.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24602025-01-09T01:47:17.675ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 622.466423ms iteration = 28 status = {}
24612025-01-09T01:47:17.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 782deabf-cbc1-42b0-9bdd-077fe3960ca0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24622025-01-09T01:47:17.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 782deabf-cbc1-42b0-9bdd-077fe3960ca0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24632025-01-09T01:47:17.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 782deabf-cbc1-42b0-9bdd-077fe3960ca0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24642025-01-09T01:47:17.939ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24652025-01-09T01:47:17.939ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
24662025-01-09T01:47:17.970ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
24672025-01-09T01:47:17.970ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:65197
24682025-01-09T01:47:17.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65197 req_id = 0b6c477b-efc5-4f28-b752-790ace099148 roles = RoleSet { roles: {} } uri = /metrics/producers
24692025-01-09T01:47:17.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65197 req_id = 0b6c477b-efc5-4f28-b752-790ace099148 resource = Database result = Ok(()) uri = /metrics/producers
24702025-01-09T01:47:18.008ZINFOnexus: assigned collector to new producer collector_id = ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a file = nexus/src/app/oximeter.rs:76 producer_id = 74d09270-c94b-4c18-b2b3-d5f83a0dc096
24712025-01-09T01:47:18.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38315 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65197 req_id = 0b6c477b-efc5-4f28-b752-790ace099148 response_code = 201 uri = /metrics/producers
24722025-01-09T01:47:18.008ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0b6c477b-efc5-4f28-b752-790ace099148", "content-length": "41", "date": "Thu, 09 Jan 2025 01:47:17 GMT"} })
24732025-01-09T01:47:18.010ZDEBGnexus (producer-registration-task): registered with nexus successfully
24742025-01-09T01:47:18.010ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
24752025-01-09T01:47:18.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 98742486-71c1-4d16-bc8f-83133cf0a8e6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24762025-01-09T01:47:18.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 98742486-71c1-4d16-bc8f-83133cf0a8e6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24772025-01-09T01:47:18.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 98742486-71c1-4d16-bc8f-83133cf0a8e6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24782025-01-09T01:47:19.743ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 674 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 6475c78c-54e8-4963-9f64-f519eec0b083 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
24792025-01-09T01:47:19.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e5a274a-69a6-42f9-9741-904d9d6e553b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24802025-01-09T01:47:19.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e5a274a-69a6-42f9-9741-904d9d6e553b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24812025-01-09T01:47:19.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1e5a274a-69a6-42f9-9741-904d9d6e553b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24822025-01-09T01:47:20.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cf80171c-75f7-48ef-9a02-ae089655ab2c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24832025-01-09T01:47:20.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cf80171c-75f7-48ef-9a02-ae089655ab2c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24842025-01-09T01:47:20.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = cf80171c-75f7-48ef-9a02-ae089655ab2c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24852025-01-09T01:47:22.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1dfb924e-db31-46d8-9521-3dfa3acbb6d9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24862025-01-09T01:47:22.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1dfb924e-db31-46d8-9521-3dfa3acbb6d9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24872025-01-09T01:47:22.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1dfb924e-db31-46d8-9521-3dfa3acbb6d9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24882025-01-09T01:47:23.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4728180c-107f-4b11-861f-629a9eceb7e1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24892025-01-09T01:47:23.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4728180c-107f-4b11-861f-629a9eceb7e1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24902025-01-09T01:47:23.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4728180c-107f-4b11-861f-629a9eceb7e1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24912025-01-09T01:47:24.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d347b29e-1bf3-49ad-865f-6f8ef8025153 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24922025-01-09T01:47:24.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d347b29e-1bf3-49ad-865f-6f8ef8025153 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24932025-01-09T01:47:24.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d347b29e-1bf3-49ad-865f-6f8ef8025153 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24942025-01-09T01:47:24.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = eb468c83-03ab-4eca-86df-836bfaffe217 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
24952025-01-09T01:47:24.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = eb468c83-03ab-4eca-86df-836bfaffe217 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
24962025-01-09T01:47:24.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = eb468c83-03ab-4eca-86df-836bfaffe217 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
24972025-01-09T01:47:25.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9cad0e69-998c-4e8d-ae2c-cc6703c23366 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24982025-01-09T01:47:25.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9cad0e69-998c-4e8d-ae2c-cc6703c23366 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
24992025-01-09T01:47:25.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9cad0e69-998c-4e8d-ae2c-cc6703c23366 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25002025-01-09T01:47:26.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76e2388e-512c-487a-a958-b9c524d593a5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25012025-01-09T01:47:26.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76e2388e-512c-487a-a958-b9c524d593a5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25022025-01-09T01:47:26.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76e2388e-512c-487a-a958-b9c524d593a5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25032025-01-09T01:47:27.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
25042025-01-09T01:47:27.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25052025-01-09T01:47:27.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25062025-01-09T01:47:27.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
25072025-01-09T01:47:27.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25082025-01-09T01:47:27.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25092025-01-09T01:47:27.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25102025-01-09T01:47:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25112025-01-09T01:47:27.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25122025-01-09T01:47:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25132025-01-09T01:47:27.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25142025-01-09T01:47:27.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25152025-01-09T01:47:27.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25162025-01-09T01:47:27.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
25172025-01-09T01:47:27.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25182025-01-09T01:47:27.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25192025-01-09T01:47:27.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
25202025-01-09T01:47:27.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.856879ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
25212025-01-09T01:47:27.082ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25222025-01-09T01:47:27.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25232025-01-09T01:47:27.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.10559ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25242025-01-09T01:47:27.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2bb99575-65c5-42d9-a2ba-dc2c070ffd7b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25252025-01-09T01:47:27.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2bb99575-65c5-42d9-a2ba-dc2c070ffd7b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25262025-01-09T01:47:27.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2bb99575-65c5-42d9-a2ba-dc2c070ffd7b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25272025-01-09T01:47:28.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e06b3a20-665f-47af-9012-da03909fe803 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25282025-01-09T01:47:28.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e06b3a20-665f-47af-9012-da03909fe803 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25292025-01-09T01:47:28.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e06b3a20-665f-47af-9012-da03909fe803 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25302025-01-09T01:47:29.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 02e99871-bab6-4696-9538-73dfec0f6808 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25312025-01-09T01:47:29.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 02e99871-bab6-4696-9538-73dfec0f6808 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25322025-01-09T01:47:29.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 02e99871-bab6-4696-9538-73dfec0f6808 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25332025-01-09T01:47:29.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 05654337-f731-4bf9-abd7-7859ad57c1d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
25342025-01-09T01:47:29.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 05654337-f731-4bf9-abd7-7859ad57c1d3 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
25352025-01-09T01:47:29.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 05654337-f731-4bf9-abd7-7859ad57c1d3 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
25362025-01-09T01:47:29.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 6ac2b293-9fba-4b51-985c-500267bd9621 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
25372025-01-09T01:47:29.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 6ac2b293-9fba-4b51-985c-500267bd9621 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
25382025-01-09T01:47:29.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 6ac2b293-9fba-4b51-985c-500267bd9621 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
25392025-01-09T01:47:29.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 580 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 6ff8f875-99c1-45e9-ba96-b511da7da434 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
25402025-01-09T01:47:30.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90ce111f-7185-402f-9717-4319b921adb0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25412025-01-09T01:47:30.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90ce111f-7185-402f-9717-4319b921adb0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25422025-01-09T01:47:30.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 90ce111f-7185-402f-9717-4319b921adb0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25432025-01-09T01:47:31.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8dfa232a-1229-4d0c-ba55-d8b5d99a95e9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25442025-01-09T01:47:31.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8dfa232a-1229-4d0c-ba55-d8b5d99a95e9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25452025-01-09T01:47:31.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8dfa232a-1229-4d0c-ba55-d8b5d99a95e9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25462025-01-09T01:47:32.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b7100da-302f-4b21-a60e-93c7b50645ab roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25472025-01-09T01:47:32.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b7100da-302f-4b21-a60e-93c7b50645ab resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25482025-01-09T01:47:32.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1b7100da-302f-4b21-a60e-93c7b50645ab response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25492025-01-09T01:47:33.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 381a909a-eae2-4aa1-b4e3-b8f04fdf0871 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25502025-01-09T01:47:33.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 381a909a-eae2-4aa1-b4e3-b8f04fdf0871 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25512025-01-09T01:47:33.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 381a909a-eae2-4aa1-b4e3-b8f04fdf0871 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25522025-01-09T01:47:34.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a7658e47-a967-4c53-9d7e-51f5c0bcf558 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25532025-01-09T01:47:34.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a7658e47-a967-4c53-9d7e-51f5c0bcf558 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25542025-01-09T01:47:34.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a7658e47-a967-4c53-9d7e-51f5c0bcf558 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25552025-01-09T01:47:35.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6fe26d6-3538-498a-9773-3bed7b73d3fd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25562025-01-09T01:47:35.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6fe26d6-3538-498a-9773-3bed7b73d3fd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25572025-01-09T01:47:35.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6fe26d6-3538-498a-9773-3bed7b73d3fd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25582025-01-09T01:47:36.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b68b6a8-7e06-493e-b52a-59fc4273bdbd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25592025-01-09T01:47:36.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b68b6a8-7e06-493e-b52a-59fc4273bdbd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25602025-01-09T01:47:36.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8b68b6a8-7e06-493e-b52a-59fc4273bdbd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25612025-01-09T01:47:37.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
25622025-01-09T01:47:37.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25632025-01-09T01:47:37.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25642025-01-09T01:47:37.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
25652025-01-09T01:47:37.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25662025-01-09T01:47:37.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25672025-01-09T01:47:37.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25682025-01-09T01:47:37.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25692025-01-09T01:47:37.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25702025-01-09T01:47:37.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25712025-01-09T01:47:37.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25722025-01-09T01:47:37.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25732025-01-09T01:47:37.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25742025-01-09T01:47:37.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25752025-01-09T01:47:37.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25762025-01-09T01:47:37.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
25772025-01-09T01:47:37.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25782025-01-09T01:47:37.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25792025-01-09T01:47:37.101ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
25802025-01-09T01:47:37.101ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.000938ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
25812025-01-09T01:47:37.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.42755ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25822025-01-09T01:47:37.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9a73dc8-a096-4ad3-997a-13ef94755b62 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25832025-01-09T01:47:37.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9a73dc8-a096-4ad3-997a-13ef94755b62 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25842025-01-09T01:47:37.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e9a73dc8-a096-4ad3-997a-13ef94755b62 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25852025-01-09T01:47:38.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5869a035-9c29-47b0-b1c9-0750355bac6f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25862025-01-09T01:47:38.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5869a035-9c29-47b0-b1c9-0750355bac6f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25872025-01-09T01:47:38.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5869a035-9c29-47b0-b1c9-0750355bac6f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25882025-01-09T01:47:39.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8a495cc3-d76b-4a17-926e-24ee385883fb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25892025-01-09T01:47:39.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8a495cc3-d76b-4a17-926e-24ee385883fb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25902025-01-09T01:47:39.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 8a495cc3-d76b-4a17-926e-24ee385883fb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25912025-01-09T01:47:39.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 645 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 7c08a281-662e-4441-9b22-6458e0d4aefc response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
25922025-01-09T01:47:40.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 56a599df-9001-4b56-a70e-9bb64aae7190 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25932025-01-09T01:47:40.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 56a599df-9001-4b56-a70e-9bb64aae7190 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25942025-01-09T01:47:40.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 56a599df-9001-4b56-a70e-9bb64aae7190 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25952025-01-09T01:47:41.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe674436-7d70-453c-b5ca-016a6b1f8a3e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25962025-01-09T01:47:41.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe674436-7d70-453c-b5ca-016a6b1f8a3e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25972025-01-09T01:47:41.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = fe674436-7d70-453c-b5ca-016a6b1f8a3e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25982025-01-09T01:47:42.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e3bd2c6-2ddd-48c8-996f-bbcd14e114be roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
25992025-01-09T01:47:42.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e3bd2c6-2ddd-48c8-996f-bbcd14e114be resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26002025-01-09T01:47:42.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0e3bd2c6-2ddd-48c8-996f-bbcd14e114be response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26012025-01-09T01:47:43.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 564bde1e-e732-415b-ae1b-93ebd7aa098a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26022025-01-09T01:47:43.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 564bde1e-e732-415b-ae1b-93ebd7aa098a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26032025-01-09T01:47:43.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 564bde1e-e732-415b-ae1b-93ebd7aa098a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26042025-01-09T01:47:44.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a88a3711-419b-4253-8bf5-db9f46534669 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26052025-01-09T01:47:44.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a88a3711-419b-4253-8bf5-db9f46534669 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26062025-01-09T01:47:44.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a88a3711-419b-4253-8bf5-db9f46534669 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26072025-01-09T01:47:45.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11a04d0c-8120-44e7-965c-40f83e6a0de3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26082025-01-09T01:47:45.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11a04d0c-8120-44e7-965c-40f83e6a0de3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26092025-01-09T01:47:45.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 11a04d0c-8120-44e7-965c-40f83e6a0de3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26102025-01-09T01:47:46.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7966b16c-2e01-43da-b493-f4341aace6ff roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26112025-01-09T01:47:46.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7966b16c-2e01-43da-b493-f4341aace6ff resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26122025-01-09T01:47:46.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7966b16c-2e01-43da-b493-f4341aace6ff response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
26132025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
26142025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
26152025-01-09T01:47:47.053ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
26162025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.761\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
26172025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
26182025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
26192025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
26202025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26212025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
26222025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
26232025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26242025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
26252025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
26262025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26272025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
26282025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26292025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
26302025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
26312025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26322025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
26332025-01-09T01:47:47.053ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:37:47.053366528 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
26342025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
26352025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
26362025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
26372025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26382025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
26392025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
26402025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26412025-01-09T01:47:47.053ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
26422025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
26432025-01-09T01:47:47.053ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
26442025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26452025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
26462025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26472025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26482025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
26492025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
26502025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
26512025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26522025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26532025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
26542025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26552025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26562025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
26572025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26582025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
26592025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26602025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
26612025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26622025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26632025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26642025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26652025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26662025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26672025-01-09T01:47:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26682025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26692025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26702025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26712025-01-09T01:47:47.054ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1799, tv_nsec: 5644202 } })
26722025-01-09T01:47:47.054ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1799, tv_nsec: 5680752 } })
26732025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26742025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26752025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26762025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26772025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26782025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
26792025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26802025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26812025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26822025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26832025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
26842025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.141778ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
26852025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
26862025-01-09T01:47:47.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.210619ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
26872025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
26882025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
26892025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
26902025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26912025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
26922025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
26932025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26942025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26952025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26962025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26972025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
26982025-01-09T01:47:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
26992025-01-09T01:47:47.056ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
27002025-01-09T01:47:47.056ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
27012025-01-09T01:47:47.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27022025-01-09T01:47:47.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27032025-01-09T01:47:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27042025-01-09T01:47:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27052025-01-09T01:47:47.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27062025-01-09T01:47:47.056ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1799, tv_nsec: 8399966 } })
27072025-01-09T01:47:47.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27082025-01-09T01:47:47.056ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
27092025-01-09T01:47:47.057ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.782631ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27102025-01-09T01:47:47.058ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1799, tv_nsec: 10317967 } })
27112025-01-09T01:47:47.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
27122025-01-09T01:47:47.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27132025-01-09T01:47:47.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27142025-01-09T01:47:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27152025-01-09T01:47:47.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27162025-01-09T01:47:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27172025-01-09T01:47:47.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27182025-01-09T01:47:47.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27192025-01-09T01:47:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27202025-01-09T01:47:47.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27212025-01-09T01:47:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27222025-01-09T01:47:47.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27232025-01-09T01:47:47.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27242025-01-09T01:47:47.064ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:37:47.053366528 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
27252025-01-09T01:47:47.064ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.344762ms iteration = 15 status = {"expiration":"2025-01-09T01:37:47.053366528Z","pruned":[]}
27262025-01-09T01:47:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27272025-01-09T01:47:47.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27282025-01-09T01:47:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27292025-01-09T01:47:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27302025-01-09T01:47:47.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27312025-01-09T01:47:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27322025-01-09T01:47:47.068ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27332025-01-09T01:47:47.068ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27342025-01-09T01:47:47.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27352025-01-09T01:47:47.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27362025-01-09T01:47:47.070ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.858759ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
27372025-01-09T01:47:47.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27382025-01-09T01:47:47.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27392025-01-09T01:47:47.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27402025-01-09T01:47:47.072ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27412025-01-09T01:47:47.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27422025-01-09T01:47:47.074ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1799, tv_nsec: 26137041 } })
27432025-01-09T01:47:47.074ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
27442025-01-09T01:47:47.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27452025-01-09T01:47:47.075ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27462025-01-09T01:47:47.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27472025-01-09T01:47:47.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27482025-01-09T01:47:47.078ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27492025-01-09T01:47:47.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27502025-01-09T01:47:47.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27512025-01-09T01:47:47.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27522025-01-09T01:47:47.082ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27532025-01-09T01:47:47.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27542025-01-09T01:47:47.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27552025-01-09T01:47:47.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
27562025-01-09T01:47:47.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27572025-01-09T01:47:47.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27582025-01-09T01:47:47.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27592025-01-09T01:47:47.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27602025-01-09T01:47:47.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27612025-01-09T01:47:47.095ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27622025-01-09T01:47:47.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
27632025-01-09T01:47:47.099ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27642025-01-09T01:47:47.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27652025-01-09T01:47:47.109ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27662025-01-09T01:47:47.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27672025-01-09T01:47:47.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27682025-01-09T01:47:47.113ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27692025-01-09T01:47:47.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27702025-01-09T01:47:47.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27712025-01-09T01:47:47.114ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
27722025-01-09T01:47:47.114ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
27732025-01-09T01:47:47.114ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.992659ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
27742025-01-09T01:47:47.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27752025-01-09T01:47:47.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27762025-01-09T01:47:47.116ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772025-01-09T01:47:47.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27782025-01-09T01:47:47.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27792025-01-09T01:47:47.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27802025-01-09T01:47:47.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27812025-01-09T01:47:47.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27822025-01-09T01:47:47.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27832025-01-09T01:47:47.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27842025-01-09T01:47:47.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27852025-01-09T01:47:47.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27862025-01-09T01:47:47.121ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27872025-01-09T01:47:47.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27882025-01-09T01:47:47.123ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
27892025-01-09T01:47:47.123ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.916265ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
27902025-01-09T01:47:47.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27912025-01-09T01:47:47.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27922025-01-09T01:47:47.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.807988ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
27932025-01-09T01:47:47.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.909473ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
27942025-01-09T01:47:47.136ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27952025-01-09T01:47:47.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27962025-01-09T01:47:47.139ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
27972025-01-09T01:47:47.139ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
27982025-01-09T01:47:47.139ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
27992025-01-09T01:47:47.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28002025-01-09T01:47:47.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28012025-01-09T01:47:47.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28022025-01-09T01:47:47.145ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28032025-01-09T01:47:47.145ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28042025-01-09T01:47:47.145ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28052025-01-09T01:47:47.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28062025-01-09T01:47:47.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28072025-01-09T01:47:47.147ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28082025-01-09T01:47:47.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28092025-01-09T01:47:47.148ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28102025-01-09T01:47:47.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28112025-01-09T01:47:47.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122025-01-09T01:47:47.180ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
28132025-01-09T01:47:47.180ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
28142025-01-09T01:47:47.180ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
28152025-01-09T01:47:47.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28162025-01-09T01:47:47.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28172025-01-09T01:47:47.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28182025-01-09T01:47:47.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28192025-01-09T01:47:47.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28202025-01-09T01:47:47.181ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
28212025-01-09T01:47:47.181ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
28222025-01-09T01:47:47.181ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.225232ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
28232025-01-09T01:47:47.181ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28242025-01-09T01:47:47.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28252025-01-09T01:47:47.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.238523ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28262025-01-09T01:47:47.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28272025-01-09T01:47:47.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 134.458893ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28282025-01-09T01:47:47.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 136.091569ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28292025-01-09T01:47:47.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28302025-01-09T01:47:47.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28312025-01-09T01:47:47.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28322025-01-09T01:47:47.190ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28332025-01-09T01:47:47.190ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.254558ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28342025-01-09T01:47:47.190ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28352025-01-09T01:47:47.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28362025-01-09T01:47:47.191ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28372025-01-09T01:47:47.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28382025-01-09T01:47:47.193ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.834669ms iteration = 32 status = {"physical_disks_added":0}
28392025-01-09T01:47:47.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28402025-01-09T01:47:47.215ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28412025-01-09T01:47:47.216ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
28422025-01-09T01:47:47.216ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
28432025-01-09T01:47:47.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28442025-01-09T01:47:47.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28452025-01-09T01:47:47.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28462025-01-09T01:47:47.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28472025-01-09T01:47:47.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28482025-01-09T01:47:47.221ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28492025-01-09T01:47:47.221ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28502025-01-09T01:47:47.221ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 167.664447ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28512025-01-09T01:47:47.245ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
28522025-01-09T01:47:47.245ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
28532025-01-09T01:47:47.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28542025-01-09T01:47:47.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28552025-01-09T01:47:47.252ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28562025-01-09T01:47:47.252ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28572025-01-09T01:47:47.252ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6c86ee5-6696-4498-808d-3990f0c46ceb", "content-length": "26", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
28582025-01-09T01:47:47.252ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28592025-01-09T01:47:47.255ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28602025-01-09T01:47:47.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28612025-01-09T01:47:47.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28622025-01-09T01:47:47.265ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
28632025-01-09T01:47:47.265ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 212.168463ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
28642025-01-09T01:47:47.312ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
28652025-01-09T01:47:47.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
28662025-01-09T01:47:47.321ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28672025-01-09T01:47:47.321ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5fb213f-33a4-43c3-944c-bd3b930ac451", "content-length": "26", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
28682025-01-09T01:47:47.321ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28692025-01-09T01:47:47.324ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28702025-01-09T01:47:47.377ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
28712025-01-09T01:47:47.377ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28722025-01-09T01:47:47.378ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aee2e173-f2f3-4c26-ae38-f9d2b789b27a", "content-length": "26", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
28732025-01-09T01:47:47.378ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28742025-01-09T01:47:47.380ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
28752025-01-09T01:47:47.429ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
28762025-01-09T01:47:47.442ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28772025-01-09T01:47:47.443ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e23d949-41ea-4357-813d-8c0dd1ca43a6", "content-length": "2", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
28782025-01-09T01:47:47.445ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28792025-01-09T01:47:47.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28802025-01-09T01:47:47.494ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28812025-01-09T01:47:47.494ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28822025-01-09T01:47:47.494ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "448656a5-ed71-4195-b6dc-b2192a8f82b4", "content-length": "372", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
28832025-01-09T01:47:47.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28842025-01-09T01:47:47.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28852025-01-09T01:47:47.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28862025-01-09T01:47:47.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28872025-01-09T01:47:47.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28882025-01-09T01:47:47.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28892025-01-09T01:47:47.501ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 448.095389ms iteration = 29 status = null
28902025-01-09T01:47:47.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28912025-01-09T01:47:47.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28922025-01-09T01:47:47.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28932025-01-09T01:47:47.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28942025-01-09T01:47:47.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28952025-01-09T01:47:47.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28962025-01-09T01:47:47.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28972025-01-09T01:47:47.508ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
28982025-01-09T01:47:47.508ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
28992025-01-09T01:47:47.508ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
29002025-01-09T01:47:47.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 454.792256ms iteration = 15 status = {"generation":1}
29012025-01-09T01:47:47.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29022025-01-09T01:47:47.508ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29032025-01-09T01:47:47.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29042025-01-09T01:47:47.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 475.103643ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
29052025-01-09T01:47:47.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29062025-01-09T01:47:47.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29072025-01-09T01:47:47.542ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29082025-01-09T01:47:47.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29092025-01-09T01:47:47.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29102025-01-09T01:47:47.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
29112025-01-09T01:47:47.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29122025-01-09T01:47:47.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29132025-01-09T01:47:47.545ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
29142025-01-09T01:47:47.545ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
29152025-01-09T01:47:47.545ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
29162025-01-09T01:47:47.545ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 492.002865ms iteration = 15 status = {"generation":2}
29172025-01-09T01:47:47.545ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 492.262319ms iteration = 29 status = 0
29182025-01-09T01:47:47.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 606d999b-a4c1-462c-91ff-28e3bdf6c9a9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29192025-01-09T01:47:47.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 606d999b-a4c1-462c-91ff-28e3bdf6c9a9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29202025-01-09T01:47:47.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 606d999b-a4c1-462c-91ff-28e3bdf6c9a9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29212025-01-09T01:47:47.554ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
29222025-01-09T01:47:47.554ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 501.372865ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
29232025-01-09T01:47:47.559ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
29242025-01-09T01:47:47.559ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29252025-01-09T01:47:47.560ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1e881f4e-1c87-457b-ac9e-c285828c4b26", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
29262025-01-09T01:47:47.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29272025-01-09T01:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29282025-01-09T01:47:47.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29292025-01-09T01:47:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29302025-01-09T01:47:47.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29312025-01-09T01:47:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29322025-01-09T01:47:47.569ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29332025-01-09T01:47:47.569ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29342025-01-09T01:47:47.570ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7809b80b-e555-4f19-ac16-e730f1ec5759", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
29352025-01-09T01:47:47.572ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 518.721124ms iteration = 30 status = {}
29362025-01-09T01:47:47.593ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
29372025-01-09T01:47:47.593ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1611231b-19db-42b4-b865-6fa3e194e640", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
29382025-01-09T01:47:47.593ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
29392025-01-09T01:47:47.596ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5ece15c2-c40b-4e73-b39d-fa7f7b319ca8", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
29402025-01-09T01:47:47.596ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
29412025-01-09T01:47:47.600ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
29422025-01-09T01:47:47.600ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
29432025-01-09T01:47:47.600ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 547.035849ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
29442025-01-09T01:47:47.600ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "66ab5c8b-1986-4afe-8270-bcba3ddab9db", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29452025-01-09T01:47:47.600ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29462025-01-09T01:47:47.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "940e6ecb-87f2-418b-b940-fcd8b0793a46", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29472025-01-09T01:47:47.602ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29482025-01-09T01:47:47.604ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "973972f9-88fa-4053-9628-e47eb00b10fe", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29492025-01-09T01:47:47.604ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29502025-01-09T01:47:47.606ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
29512025-01-09T01:47:47.606ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 553.400731ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
29522025-01-09T01:47:47.611ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 558.384242ms iteration = 29 status = {}
29532025-01-09T01:47:47.653ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29542025-01-09T01:47:47.654ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "053f5838-e260-43f5-bee5-025ea6ed92d0", "content-length": "691", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
29552025-01-09T01:47:47.654ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29562025-01-09T01:47:47.654ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29572025-01-09T01:47:47.654ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29582025-01-09T01:47:47.656ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 603.02669ms iteration = 30 status = {}
29592025-01-09T01:47:47.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29602025-01-09T01:47:47.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29612025-01-09T01:47:47.683ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
29622025-01-09T01:47:47.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29632025-01-09T01:47:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29642025-01-09T01:47:47.692ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29652025-01-09T01:47:47.693ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "538b6867-21c8-44c0-a187-476730b01e53", "content-length": "134", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
29662025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29672025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
29682025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29692025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29702025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29712025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29722025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29732025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29742025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29752025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29762025-01-09T01:47:47.693ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
29772025-01-09T01:47:47.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29782025-01-09T01:47:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29792025-01-09T01:47:47.695ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29802025-01-09T01:47:47.695ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "760222f6-8779-4970-ac6b-6ef624850438", "content-length": "2", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
29812025-01-09T01:47:47.695ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29822025-01-09T01:47:47.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f886002f-8292-414b-8ccd-ea04379d5d34", "content-length": "52", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
29832025-01-09T01:47:47.696ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
29842025-01-09T01:47:47.696ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29852025-01-09T01:47:47.796ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "49be4356-ff5a-4e84-85c7-0c4d30c86e29", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
29862025-01-09T01:47:47.796ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
29872025-01-09T01:47:47.796ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29882025-01-09T01:47:47.797ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7318bcef-0585-49c5-abd6-729fdbe23683", "content-length": "682", "date": "Thu, 09 Jan 2025 01:47:47 GMT"} })
29892025-01-09T01:47:47.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29902025-01-09T01:47:47.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29912025-01-09T01:47:47.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29922025-01-09T01:47:47.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29932025-01-09T01:47:47.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29942025-01-09T01:47:47.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29952025-01-09T01:47:47.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29962025-01-09T01:47:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29972025-01-09T01:47:47.814ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 760.968181ms iteration = 29 status = {}
29982025-01-09T01:47:48.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa65527a-034e-4bfa-892f-06e7f122634a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
29992025-01-09T01:47:48.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa65527a-034e-4bfa-892f-06e7f122634a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30002025-01-09T01:47:48.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = aa65527a-034e-4bfa-892f-06e7f122634a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30012025-01-09T01:47:49.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2fbe507-992a-40b8-82ba-d51820d2d03c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30022025-01-09T01:47:49.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2fbe507-992a-40b8-82ba-d51820d2d03c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30032025-01-09T01:47:49.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d2fbe507-992a-40b8-82ba-d51820d2d03c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30042025-01-09T01:47:49.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 02355ed5-669c-451d-98f1-513a38ef7a26 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
30052025-01-09T01:47:50.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 769223a7-1344-4996-858c-9fc56ce5ceea roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30062025-01-09T01:47:50.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 769223a7-1344-4996-858c-9fc56ce5ceea resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30072025-01-09T01:47:50.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 769223a7-1344-4996-858c-9fc56ce5ceea response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30082025-01-09T01:47:51.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3fe9493-f429-4b8e-b9e3-20be0e6238d6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30092025-01-09T01:47:51.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3fe9493-f429-4b8e-b9e3-20be0e6238d6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30102025-01-09T01:47:51.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d3fe9493-f429-4b8e-b9e3-20be0e6238d6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30112025-01-09T01:47:52.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47ce057e-0317-4583-8618-2d26bce2c34c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30122025-01-09T01:47:52.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47ce057e-0317-4583-8618-2d26bce2c34c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30132025-01-09T01:47:52.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 47ce057e-0317-4583-8618-2d26bce2c34c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30142025-01-09T01:47:53.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 42aa1e0f-cb8d-4262-a4fb-f31db08f5ed2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30152025-01-09T01:47:53.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 42aa1e0f-cb8d-4262-a4fb-f31db08f5ed2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30162025-01-09T01:47:53.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 42aa1e0f-cb8d-4262-a4fb-f31db08f5ed2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30172025-01-09T01:47:54.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 7b1d3f13-f9c7-42f5-9e21-4ae490cbc604 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
30182025-01-09T01:47:54.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 7b1d3f13-f9c7-42f5-9e21-4ae490cbc604 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
30192025-01-09T01:47:54.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 7b1d3f13-f9c7-42f5-9e21-4ae490cbc604 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
30202025-01-09T01:47:54.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9005f2e9-cb70-40dc-b11d-0834d65dee0f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30212025-01-09T01:47:54.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9005f2e9-cb70-40dc-b11d-0834d65dee0f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30222025-01-09T01:47:54.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9005f2e9-cb70-40dc-b11d-0834d65dee0f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30232025-01-09T01:47:55.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ccb31df-8d18-4c49-94e7-03359ba1a0e5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30242025-01-09T01:47:55.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ccb31df-8d18-4c49-94e7-03359ba1a0e5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30252025-01-09T01:47:55.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5ccb31df-8d18-4c49-94e7-03359ba1a0e5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30262025-01-09T01:47:56.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82cbb35e-c1df-4546-b24e-47a14117aac9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30272025-01-09T01:47:56.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82cbb35e-c1df-4546-b24e-47a14117aac9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30282025-01-09T01:47:56.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82cbb35e-c1df-4546-b24e-47a14117aac9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30292025-01-09T01:47:57.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
30302025-01-09T01:47:57.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30312025-01-09T01:47:57.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30322025-01-09T01:47:57.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
30332025-01-09T01:47:57.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30342025-01-09T01:47:57.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30352025-01-09T01:47:57.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30362025-01-09T01:47:57.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30372025-01-09T01:47:57.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30382025-01-09T01:47:57.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30392025-01-09T01:47:57.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30402025-01-09T01:47:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30412025-01-09T01:47:57.082ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30422025-01-09T01:47:57.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30432025-01-09T01:47:57.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30442025-01-09T01:47:57.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
30452025-01-09T01:47:57.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30462025-01-09T01:47:57.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30472025-01-09T01:47:57.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
30482025-01-09T01:47:57.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.953754ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
30492025-01-09T01:47:57.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.967285ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30502025-01-09T01:47:57.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0989860-835d-45f5-9622-c1a8b77c7f65 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30512025-01-09T01:47:57.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0989860-835d-45f5-9622-c1a8b77c7f65 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30522025-01-09T01:47:57.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0989860-835d-45f5-9622-c1a8b77c7f65 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30532025-01-09T01:47:58.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65d65671-51fc-4f88-8a73-281a71c40ca7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30542025-01-09T01:47:58.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65d65671-51fc-4f88-8a73-281a71c40ca7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30552025-01-09T01:47:58.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 65d65671-51fc-4f88-8a73-281a71c40ca7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30562025-01-09T01:47:59.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = a13acede-4911-4223-b2a2-1c8221f10ba2 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
30572025-01-09T01:47:59.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = a13acede-4911-4223-b2a2-1c8221f10ba2 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
30582025-01-09T01:47:59.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = a13acede-4911-4223-b2a2-1c8221f10ba2 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
30592025-01-09T01:47:59.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = c478c84c-acb1-4b7b-ba50-133132c4f5cb roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
30602025-01-09T01:47:59.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = c478c84c-acb1-4b7b-ba50-133132c4f5cb resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
30612025-01-09T01:47:59.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = c478c84c-acb1-4b7b-ba50-133132c4f5cb response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
30622025-01-09T01:47:59.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = fc969797-e2d5-4c52-854d-4bc7e87f5be8 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
30632025-01-09T01:47:59.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09ab326b-e200-42b8-8bcb-bdefc8efc7d3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30642025-01-09T01:47:59.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09ab326b-e200-42b8-8bcb-bdefc8efc7d3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30652025-01-09T01:47:59.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09ab326b-e200-42b8-8bcb-bdefc8efc7d3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30662025-01-09T01:48:00.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c67dd56-bda5-4040-8918-e1746dd97408 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30672025-01-09T01:48:00.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c67dd56-bda5-4040-8918-e1746dd97408 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30682025-01-09T01:48:00.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c67dd56-bda5-4040-8918-e1746dd97408 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30692025-01-09T01:48:01.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e4904ef2-5016-48d0-adcd-d8e293672eec roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30702025-01-09T01:48:01.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e4904ef2-5016-48d0-adcd-d8e293672eec resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30712025-01-09T01:48:01.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e4904ef2-5016-48d0-adcd-d8e293672eec response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30722025-01-09T01:48:02.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a65bbaaa-ca15-44c6-be5c-2684c27fecbc roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30732025-01-09T01:48:02.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a65bbaaa-ca15-44c6-be5c-2684c27fecbc resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30742025-01-09T01:48:02.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a65bbaaa-ca15-44c6-be5c-2684c27fecbc response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30752025-01-09T01:48:03.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e16e4dd2-38ea-4f41-a5ec-01b93e97acd3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30762025-01-09T01:48:03.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e16e4dd2-38ea-4f41-a5ec-01b93e97acd3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30772025-01-09T01:48:03.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e16e4dd2-38ea-4f41-a5ec-01b93e97acd3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30782025-01-09T01:48:04.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0b08d66-787c-4b17-a0fb-7910157f7785 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30792025-01-09T01:48:04.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0b08d66-787c-4b17-a0fb-7910157f7785 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30802025-01-09T01:48:04.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0b08d66-787c-4b17-a0fb-7910157f7785 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30812025-01-09T01:48:05.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60f2a5ae-54c2-4d68-b612-15042db316ee roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30822025-01-09T01:48:05.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60f2a5ae-54c2-4d68-b612-15042db316ee resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30832025-01-09T01:48:05.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60f2a5ae-54c2-4d68-b612-15042db316ee response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30842025-01-09T01:48:06.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5362ec6-d96c-45fe-992c-eca3cc535993 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30852025-01-09T01:48:06.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5362ec6-d96c-45fe-992c-eca3cc535993 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30862025-01-09T01:48:06.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5362ec6-d96c-45fe-992c-eca3cc535993 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
30872025-01-09T01:48:07.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
30882025-01-09T01:48:07.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30892025-01-09T01:48:07.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30902025-01-09T01:48:07.053ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
30912025-01-09T01:48:07.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30922025-01-09T01:48:07.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30932025-01-09T01:48:07.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30942025-01-09T01:48:07.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30952025-01-09T01:48:07.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30962025-01-09T01:48:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30972025-01-09T01:48:07.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30982025-01-09T01:48:07.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30992025-01-09T01:48:07.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31002025-01-09T01:48:07.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31012025-01-09T01:48:07.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31022025-01-09T01:48:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
31032025-01-09T01:48:07.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31042025-01-09T01:48:07.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31052025-01-09T01:48:07.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
31062025-01-09T01:48:07.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.499116ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
31072025-01-09T01:48:07.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.374583ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31082025-01-09T01:48:07.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 931076e7-1711-4014-878f-32998b60c3ca roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31092025-01-09T01:48:07.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 931076e7-1711-4014-878f-32998b60c3ca resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31102025-01-09T01:48:07.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 931076e7-1711-4014-878f-32998b60c3ca response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31112025-01-09T01:48:09.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58efed52-83f7-4f36-bedd-b612bddf2eb1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31122025-01-09T01:48:09.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58efed52-83f7-4f36-bedd-b612bddf2eb1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31132025-01-09T01:48:09.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 58efed52-83f7-4f36-bedd-b612bddf2eb1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31142025-01-09T01:48:09.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 689 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = beb08fd6-66b8-4dd7-b238-75820720ab6f response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
31152025-01-09T01:48:10.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f7cffc32-83a5-478b-b52d-ea490626d374 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31162025-01-09T01:48:10.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f7cffc32-83a5-478b-b52d-ea490626d374 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31172025-01-09T01:48:10.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f7cffc32-83a5-478b-b52d-ea490626d374 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31182025-01-09T01:48:11.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60d987fa-2cb2-4b48-aa0d-5a68972cb9d0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31192025-01-09T01:48:11.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60d987fa-2cb2-4b48-aa0d-5a68972cb9d0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31202025-01-09T01:48:11.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 60d987fa-2cb2-4b48-aa0d-5a68972cb9d0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31212025-01-09T01:48:12.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2731905c-727a-4d10-a2b8-51be7888727f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31222025-01-09T01:48:12.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2731905c-727a-4d10-a2b8-51be7888727f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31232025-01-09T01:48:12.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2731905c-727a-4d10-a2b8-51be7888727f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31242025-01-09T01:48:13.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89e63398-1df6-45d7-bc08-0247ab105eb3 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31252025-01-09T01:48:13.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89e63398-1df6-45d7-bc08-0247ab105eb3 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31262025-01-09T01:48:13.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89e63398-1df6-45d7-bc08-0247ab105eb3 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31272025-01-09T01:48:14.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 903e9661-5ea6-4341-ac81-33a6cc2c0a1c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31282025-01-09T01:48:14.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 903e9661-5ea6-4341-ac81-33a6cc2c0a1c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31292025-01-09T01:48:14.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 903e9661-5ea6-4341-ac81-33a6cc2c0a1c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31302025-01-09T01:48:14.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = fe3f1c71-232c-48f3-abc0-f37c22c03df2 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
31312025-01-09T01:48:14.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = fe3f1c71-232c-48f3-abc0-f37c22c03df2 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
31322025-01-09T01:48:14.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = fe3f1c71-232c-48f3-abc0-f37c22c03df2 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
31332025-01-09T01:48:14.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 951d4c7f-5dbd-4f61-a4cb-c644aac3c8b0 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
31342025-01-09T01:48:14.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 951d4c7f-5dbd-4f61-a4cb-c644aac3c8b0 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
31352025-01-09T01:48:14.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 951d4c7f-5dbd-4f61-a4cb-c644aac3c8b0 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
31362025-01-09T01:48:15.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c894865-c819-48d1-b4c4-f62398e167b8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31372025-01-09T01:48:15.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c894865-c819-48d1-b4c4-f62398e167b8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31382025-01-09T01:48:15.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0c894865-c819-48d1-b4c4-f62398e167b8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31392025-01-09T01:48:16.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 634f4881-522e-445f-9057-fb5c02fcd179 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31402025-01-09T01:48:16.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 634f4881-522e-445f-9057-fb5c02fcd179 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31412025-01-09T01:48:16.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 634f4881-522e-445f-9057-fb5c02fcd179 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
31422025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
31432025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
31442025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31452025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31462025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
31472025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
31482025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31492025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31502025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31512025-01-09T01:48:17.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31522025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
31532025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
31542025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31552025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31562025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
31572025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
31582025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31592025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
31602025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31612025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31622025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
31632025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
31642025-01-09T01:48:17.054ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31652025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31662025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
31672025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31682025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31692025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
31702025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31712025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31722025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31732025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31742025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31752025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31762025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31772025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31782025-01-09T01:48:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31792025-01-09T01:48:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31802025-01-09T01:48:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31812025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
31822025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
31832025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31842025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31852025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
31862025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31872025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
31882025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31892025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31902025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
31912025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
31922025-01-09T01:48:17.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31932025-01-09T01:48:17.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942025-01-09T01:48:17.057ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1829, tv_nsec: 8385536 } })
31952025-01-09T01:48:17.057ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
31962025-01-09T01:48:17.057ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1829, tv_nsec: 8831543 } })
31972025-01-09T01:48:17.057ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
31982025-01-09T01:48:17.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31992025-01-09T01:48:17.058ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.694576ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32002025-01-09T01:48:17.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32012025-01-09T01:48:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32022025-01-09T01:48:17.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32032025-01-09T01:48:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32042025-01-09T01:48:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32052025-01-09T01:48:17.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32062025-01-09T01:48:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32072025-01-09T01:48:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32082025-01-09T01:48:17.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32092025-01-09T01:48:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32102025-01-09T01:48:17.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32112025-01-09T01:48:17.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32122025-01-09T01:48:17.063ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32132025-01-09T01:48:17.063ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32142025-01-09T01:48:17.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32152025-01-09T01:48:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32162025-01-09T01:48:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32172025-01-09T01:48:17.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32182025-01-09T01:48:17.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32192025-01-09T01:48:17.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32202025-01-09T01:48:17.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32212025-01-09T01:48:17.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32222025-01-09T01:48:17.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.210484ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
32232025-01-09T01:48:17.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.461418ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
32242025-01-09T01:48:17.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32252025-01-09T01:48:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32262025-01-09T01:48:17.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32272025-01-09T01:48:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32282025-01-09T01:48:17.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32292025-01-09T01:48:17.071ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1829, tv_nsec: 22431352 } })
32302025-01-09T01:48:17.071ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
32312025-01-09T01:48:17.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32322025-01-09T01:48:17.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32332025-01-09T01:48:17.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32342025-01-09T01:48:17.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32352025-01-09T01:48:17.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32362025-01-09T01:48:17.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32372025-01-09T01:48:17.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32382025-01-09T01:48:17.097ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32392025-01-09T01:48:17.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32402025-01-09T01:48:17.099ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32412025-01-09T01:48:17.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32422025-01-09T01:48:17.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32432025-01-09T01:48:17.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32442025-01-09T01:48:17.101ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32452025-01-09T01:48:17.101ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32462025-01-09T01:48:17.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32472025-01-09T01:48:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32482025-01-09T01:48:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32492025-01-09T01:48:17.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32502025-01-09T01:48:17.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32512025-01-09T01:48:17.103ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
32522025-01-09T01:48:17.103ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 49.008478ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
32532025-01-09T01:48:17.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32542025-01-09T01:48:17.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32552025-01-09T01:48:17.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32562025-01-09T01:48:17.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32572025-01-09T01:48:17.108ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32582025-01-09T01:48:17.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32592025-01-09T01:48:17.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
32602025-01-09T01:48:17.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32612025-01-09T01:48:17.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32622025-01-09T01:48:17.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.637633ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32632025-01-09T01:48:17.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32642025-01-09T01:48:17.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32652025-01-09T01:48:17.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32662025-01-09T01:48:17.116ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.263831ms iteration = 30 status = 0
32672025-01-09T01:48:17.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32682025-01-09T01:48:17.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32692025-01-09T01:48:17.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32702025-01-09T01:48:17.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32712025-01-09T01:48:17.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
32722025-01-09T01:48:17.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32732025-01-09T01:48:17.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32742025-01-09T01:48:17.135ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
32752025-01-09T01:48:17.135ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.00432ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
32762025-01-09T01:48:17.147ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32772025-01-09T01:48:17.147ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32782025-01-09T01:48:17.147ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fe804ee-c92d-4003-a75d-de28f79db411", "content-length": "26", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
32792025-01-09T01:48:17.147ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32802025-01-09T01:48:17.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.786267ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32812025-01-09T01:48:17.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.273586ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32822025-01-09T01:48:17.149ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32832025-01-09T01:48:17.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.808579ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32842025-01-09T01:48:17.165ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32852025-01-09T01:48:17.165ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32862025-01-09T01:48:17.165ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.620669ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32872025-01-09T01:48:17.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0e831a9-26d9-495a-a82e-d4f0228b5cf2 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
32882025-01-09T01:48:17.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0e831a9-26d9-495a-a82e-d4f0228b5cf2 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
32892025-01-09T01:48:17.200ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32902025-01-09T01:48:17.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32912025-01-09T01:48:17.221ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.21597ms iteration = 33 status = {"physical_disks_added":0}
32922025-01-09T01:48:17.244ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
32932025-01-09T01:48:17.244ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32942025-01-09T01:48:17.244ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c37b7ac6-056c-40a1-ba84-551ae3a3ffdf", "content-length": "26", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
32952025-01-09T01:48:17.244ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32962025-01-09T01:48:17.247ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
32972025-01-09T01:48:17.248ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
32982025-01-09T01:48:17.248ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32992025-01-09T01:48:17.248ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67ac5978-3ea9-468f-bd31-fa2c338140ce", "content-length": "26", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
33002025-01-09T01:48:17.248ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33012025-01-09T01:48:17.250ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33022025-01-09T01:48:17.250ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33032025-01-09T01:48:17.250ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e73f936f-790a-4965-b9b5-82a35d526a30", "content-length": "2", "date": "Thu, 09 Jan 2025 01:48:16 GMT"} })
33042025-01-09T01:48:17.252ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33052025-01-09T01:48:17.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33062025-01-09T01:48:17.270ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33072025-01-09T01:48:17.270ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33082025-01-09T01:48:17.270ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "146ff5a3-5fff-4eb3-af3f-c18ee68b3200", "content-length": "372", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
33092025-01-09T01:48:17.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33102025-01-09T01:48:17.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33112025-01-09T01:48:17.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d0e831a9-26d9-495a-a82e-d4f0228b5cf2 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33122025-01-09T01:48:17.273ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.765545ms iteration = 30 status = null
33132025-01-09T01:48:17.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33142025-01-09T01:48:17.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33152025-01-09T01:48:17.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33162025-01-09T01:48:17.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33172025-01-09T01:48:17.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33182025-01-09T01:48:17.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33192025-01-09T01:48:17.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33202025-01-09T01:48:17.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33212025-01-09T01:48:17.285ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33222025-01-09T01:48:17.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33232025-01-09T01:48:17.287ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33242025-01-09T01:48:17.287ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33252025-01-09T01:48:17.287ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e23556f2-91dd-4917-a3c4-d96d621f2be1", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
33262025-01-09T01:48:17.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33272025-01-09T01:48:17.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33282025-01-09T01:48:17.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33292025-01-09T01:48:17.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33302025-01-09T01:48:17.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33312025-01-09T01:48:17.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33322025-01-09T01:48:17.296ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33332025-01-09T01:48:17.296ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33342025-01-09T01:48:17.296ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5fc1bd93-fc88-43a0-84c1-57f1d66fbf73", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
33352025-01-09T01:48:17.297ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 243.420535ms iteration = 31 status = {}
33362025-01-09T01:48:17.317ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 263.728492ms iteration = 30 status = {}
33372025-01-09T01:48:17.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33382025-01-09T01:48:17.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33392025-01-09T01:48:17.427ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
33402025-01-09T01:48:17.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33412025-01-09T01:48:17.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33422025-01-09T01:48:17.428ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33432025-01-09T01:48:17.439ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33442025-01-09T01:48:17.440ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "27d62ce5-a91f-49ce-89b2-ec919ab93af8", "content-length": "134", "date": "Thu, 09 Jan 2025 01:48:16 GMT"} })
33452025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33462025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
33472025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33482025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33492025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33502025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33512025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33522025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33532025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33542025-01-09T01:48:17.440ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33552025-01-09T01:48:17.441ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
33562025-01-09T01:48:17.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33572025-01-09T01:48:17.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33582025-01-09T01:48:17.442ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33592025-01-09T01:48:17.442ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0037f383-56a6-4796-911b-753aef570c53", "content-length": "2", "date": "Thu, 09 Jan 2025 01:48:16 GMT"} })
33602025-01-09T01:48:17.442ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33612025-01-09T01:48:17.442ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ebc1b5b-b107-44fd-9be7-f5a8692be874", "content-length": "52", "date": "Thu, 09 Jan 2025 01:48:16 GMT"} })
33622025-01-09T01:48:17.442ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
33632025-01-09T01:48:17.442ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33642025-01-09T01:48:17.539ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "458557f8-b95b-4fe2-bbd0-5889bdefef70", "content-length": "691", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
33652025-01-09T01:48:17.539ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33662025-01-09T01:48:17.539ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33672025-01-09T01:48:17.539ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33682025-01-09T01:48:17.540ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 486.413715ms iteration = 31 status = {}
33692025-01-09T01:48:17.632ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "81f5d967-efe8-446e-99d5-9f39ae117d72", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
33702025-01-09T01:48:17.632ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
33712025-01-09T01:48:17.632ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33722025-01-09T01:48:17.633ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "390ac604-7ae5-4bd3-b226-1e32443f9c75", "content-length": "682", "date": "Thu, 09 Jan 2025 01:48:17 GMT"} })
33732025-01-09T01:48:17.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33742025-01-09T01:48:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33752025-01-09T01:48:17.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33762025-01-09T01:48:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33772025-01-09T01:48:17.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33782025-01-09T01:48:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33792025-01-09T01:48:17.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33802025-01-09T01:48:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33812025-01-09T01:48:17.648ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 593.747171ms iteration = 30 status = {}
33822025-01-09T01:48:18.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c249a76e-2440-44fe-af4d-5cfc4677539b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33832025-01-09T01:48:18.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c249a76e-2440-44fe-af4d-5cfc4677539b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33842025-01-09T01:48:18.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c249a76e-2440-44fe-af4d-5cfc4677539b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33852025-01-09T01:48:19.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 08fda2dc-2721-4c5d-962c-688c2dd76bd9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33862025-01-09T01:48:19.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 08fda2dc-2721-4c5d-962c-688c2dd76bd9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33872025-01-09T01:48:19.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 08fda2dc-2721-4c5d-962c-688c2dd76bd9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33882025-01-09T01:48:19.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 839 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 87da87cd-6c0a-4be4-b6b5-9c9aec002ea5 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
33892025-01-09T01:48:20.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a46b7e71-97f7-4c97-be3c-de13b704e6d6 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33902025-01-09T01:48:20.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a46b7e71-97f7-4c97-be3c-de13b704e6d6 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33912025-01-09T01:48:20.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a46b7e71-97f7-4c97-be3c-de13b704e6d6 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33922025-01-09T01:48:21.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6d52f41-604f-4fc1-bfae-ca5f7ea532b1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33932025-01-09T01:48:21.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6d52f41-604f-4fc1-bfae-ca5f7ea532b1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33942025-01-09T01:48:21.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c6d52f41-604f-4fc1-bfae-ca5f7ea532b1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33952025-01-09T01:48:22.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5c62556-ac18-400e-8eae-0bd4f19b9677 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33962025-01-09T01:48:22.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5c62556-ac18-400e-8eae-0bd4f19b9677 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33972025-01-09T01:48:22.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e5c62556-ac18-400e-8eae-0bd4f19b9677 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33982025-01-09T01:48:23.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7ffda95c-6c64-4e5c-a41a-3e0ba0e53ecd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
33992025-01-09T01:48:23.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7ffda95c-6c64-4e5c-a41a-3e0ba0e53ecd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34002025-01-09T01:48:23.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7ffda95c-6c64-4e5c-a41a-3e0ba0e53ecd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34012025-01-09T01:48:24.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 7dc0fb2c-cf45-4a33-b8dc-03890ea6e53b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
34022025-01-09T01:48:24.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 7dc0fb2c-cf45-4a33-b8dc-03890ea6e53b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
34032025-01-09T01:48:24.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 7dc0fb2c-cf45-4a33-b8dc-03890ea6e53b response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
34042025-01-09T01:48:24.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6caa8fa9-d980-4552-a63c-0232f1a3bfa4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34052025-01-09T01:48:24.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6caa8fa9-d980-4552-a63c-0232f1a3bfa4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34062025-01-09T01:48:24.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6caa8fa9-d980-4552-a63c-0232f1a3bfa4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34072025-01-09T01:48:25.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3f509b8f-4d50-4a8c-bc2a-f8ea563e28a5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34082025-01-09T01:48:25.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3f509b8f-4d50-4a8c-bc2a-f8ea563e28a5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34092025-01-09T01:48:25.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3f509b8f-4d50-4a8c-bc2a-f8ea563e28a5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34102025-01-09T01:48:26.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b9163974-6473-4eac-9473-cedcf38ce810 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34112025-01-09T01:48:26.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b9163974-6473-4eac-9473-cedcf38ce810 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34122025-01-09T01:48:26.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b9163974-6473-4eac-9473-cedcf38ce810 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34132025-01-09T01:48:27.052ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
34142025-01-09T01:48:27.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34152025-01-09T01:48:27.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34162025-01-09T01:48:27.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
34172025-01-09T01:48:27.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182025-01-09T01:48:27.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34192025-01-09T01:48:27.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34202025-01-09T01:48:27.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34212025-01-09T01:48:27.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34222025-01-09T01:48:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34232025-01-09T01:48:27.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34242025-01-09T01:48:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34252025-01-09T01:48:27.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.636038ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34262025-01-09T01:48:27.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34272025-01-09T01:48:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34282025-01-09T01:48:27.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34292025-01-09T01:48:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
34302025-01-09T01:48:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34312025-01-09T01:48:27.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34322025-01-09T01:48:27.075ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
34332025-01-09T01:48:27.075ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.730795ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
34342025-01-09T01:48:27.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 169bb563-7fe4-4a1c-94e2-012b22e6289b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34352025-01-09T01:48:27.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 169bb563-7fe4-4a1c-94e2-012b22e6289b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34362025-01-09T01:48:27.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 169bb563-7fe4-4a1c-94e2-012b22e6289b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34372025-01-09T01:48:28.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d0d81c5-8aba-4284-a129-04df1b1c1d70 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34382025-01-09T01:48:28.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d0d81c5-8aba-4284-a129-04df1b1c1d70 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34392025-01-09T01:48:28.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6d0d81c5-8aba-4284-a129-04df1b1c1d70 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34402025-01-09T01:48:29.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 80d06ce9-5afa-48e2-b7fa-9649c5728906 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34412025-01-09T01:48:29.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 80d06ce9-5afa-48e2-b7fa-9649c5728906 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34422025-01-09T01:48:29.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 80d06ce9-5afa-48e2-b7fa-9649c5728906 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34432025-01-09T01:48:29.744ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 90697b8f-8118-45a7-b1b7-24d24381be8b response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
34442025-01-09T01:48:30.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0098133-c251-4e49-beda-d3dee62c63cd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34452025-01-09T01:48:30.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0098133-c251-4e49-beda-d3dee62c63cd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34462025-01-09T01:48:30.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b0098133-c251-4e49-beda-d3dee62c63cd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34472025-01-09T01:48:31.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0fc9b927-6054-454b-b878-57815f391056 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34482025-01-09T01:48:31.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0fc9b927-6054-454b-b878-57815f391056 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34492025-01-09T01:48:31.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0fc9b927-6054-454b-b878-57815f391056 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34502025-01-09T01:48:32.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5cfd384a-3591-403e-a361-d2bc15a400fb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34512025-01-09T01:48:32.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5cfd384a-3591-403e-a361-d2bc15a400fb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34522025-01-09T01:48:32.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 5cfd384a-3591-403e-a361-d2bc15a400fb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34532025-01-09T01:48:33.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6a6d3133-228a-4a5a-bce2-165f54072c13 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34542025-01-09T01:48:33.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6a6d3133-228a-4a5a-bce2-165f54072c13 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34552025-01-09T01:48:33.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6a6d3133-228a-4a5a-bce2-165f54072c13 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34562025-01-09T01:48:34.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0deda81-c2be-48f7-94f3-5f829b481460 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34572025-01-09T01:48:34.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0deda81-c2be-48f7-94f3-5f829b481460 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34582025-01-09T01:48:34.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0deda81-c2be-48f7-94f3-5f829b481460 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34592025-01-09T01:48:35.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a56d9f5-8f12-4d25-8ed0-a34805b3c9f0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34602025-01-09T01:48:35.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a56d9f5-8f12-4d25-8ed0-a34805b3c9f0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34612025-01-09T01:48:35.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9a56d9f5-8f12-4d25-8ed0-a34805b3c9f0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34622025-01-09T01:48:36.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f613267d-6d2c-4af9-9d2f-6593a679f74c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34632025-01-09T01:48:36.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f613267d-6d2c-4af9-9d2f-6593a679f74c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34642025-01-09T01:48:36.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f613267d-6d2c-4af9-9d2f-6593a679f74c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34652025-01-09T01:48:37.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
34662025-01-09T01:48:37.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34672025-01-09T01:48:37.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34682025-01-09T01:48:37.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
34692025-01-09T01:48:37.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34702025-01-09T01:48:37.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34712025-01-09T01:48:37.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34722025-01-09T01:48:37.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34732025-01-09T01:48:37.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34742025-01-09T01:48:37.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34752025-01-09T01:48:37.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34762025-01-09T01:48:37.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34772025-01-09T01:48:37.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.711915ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34782025-01-09T01:48:37.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34792025-01-09T01:48:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34802025-01-09T01:48:37.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34812025-01-09T01:48:37.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
34822025-01-09T01:48:37.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34832025-01-09T01:48:37.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34842025-01-09T01:48:37.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
34852025-01-09T01:48:37.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.109983ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
34862025-01-09T01:48:37.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 88cd1bad-c797-46e5-a468-ac5782145457 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34872025-01-09T01:48:37.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 88cd1bad-c797-46e5-a468-ac5782145457 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34882025-01-09T01:48:37.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 88cd1bad-c797-46e5-a468-ac5782145457 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34892025-01-09T01:48:38.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83bec17e-0d78-47cd-9768-da3c6cf54dbd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34902025-01-09T01:48:38.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83bec17e-0d78-47cd-9768-da3c6cf54dbd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34912025-01-09T01:48:38.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 83bec17e-0d78-47cd-9768-da3c6cf54dbd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34922025-01-09T01:48:39.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1006 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 0f7d2a63-1e30-4f7b-8912-4a0f6cba1f0f response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
34932025-01-09T01:48:39.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d40757a-5f29-4316-83a1-75712ba000ad roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34942025-01-09T01:48:39.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d40757a-5f29-4316-83a1-75712ba000ad resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34952025-01-09T01:48:39.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1d40757a-5f29-4316-83a1-75712ba000ad response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34962025-01-09T01:48:40.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76ae60be-e49a-4806-a9c7-0ffb478720b5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34972025-01-09T01:48:40.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76ae60be-e49a-4806-a9c7-0ffb478720b5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34982025-01-09T01:48:40.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 76ae60be-e49a-4806-a9c7-0ffb478720b5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
34992025-01-09T01:48:41.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82124465-02ec-41ef-83a1-012bab913b5f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35002025-01-09T01:48:41.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82124465-02ec-41ef-83a1-012bab913b5f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35012025-01-09T01:48:41.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 82124465-02ec-41ef-83a1-012bab913b5f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35022025-01-09T01:48:42.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 155b5e33-f89b-46ee-803a-91c4d30f7532 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35032025-01-09T01:48:42.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 155b5e33-f89b-46ee-803a-91c4d30f7532 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35042025-01-09T01:48:42.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 155b5e33-f89b-46ee-803a-91c4d30f7532 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35052025-01-09T01:48:43.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b93228-70c1-42b8-a4a3-119ca422c98c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35062025-01-09T01:48:43.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b93228-70c1-42b8-a4a3-119ca422c98c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35072025-01-09T01:48:43.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 41b93228-70c1-42b8-a4a3-119ca422c98c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35082025-01-09T01:48:44.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = e3fb587a-3bd7-4f3c-9b4a-b228bc241d8c roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
35092025-01-09T01:48:44.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = e3fb587a-3bd7-4f3c-9b4a-b228bc241d8c resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
35102025-01-09T01:48:44.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = e3fb587a-3bd7-4f3c-9b4a-b228bc241d8c response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
35112025-01-09T01:48:44.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = d5dc1f66-4ffe-42f8-839e-1973afbf1e71 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
35122025-01-09T01:48:44.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = d5dc1f66-4ffe-42f8-839e-1973afbf1e71 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
35132025-01-09T01:48:44.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = d5dc1f66-4ffe-42f8-839e-1973afbf1e71 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
35142025-01-09T01:48:44.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d76301ff-f63f-4c81-a9c7-e7229a9d5ad7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35152025-01-09T01:48:44.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d76301ff-f63f-4c81-a9c7-e7229a9d5ad7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35162025-01-09T01:48:44.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d76301ff-f63f-4c81-a9c7-e7229a9d5ad7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35172025-01-09T01:48:45.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 19e31ab5-95a6-404c-a436-3825d678cc84 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35182025-01-09T01:48:45.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 19e31ab5-95a6-404c-a436-3825d678cc84 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35192025-01-09T01:48:45.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 19e31ab5-95a6-404c-a436-3825d678cc84 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35202025-01-09T01:48:46.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dbd68c6f-0343-455d-887f-81b7cfc252cf roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35212025-01-09T01:48:46.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dbd68c6f-0343-455d-887f-81b7cfc252cf resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35222025-01-09T01:48:46.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dbd68c6f-0343-455d-887f-81b7cfc252cf response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
35232025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
35242025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
35252025-01-09T01:48:47.053ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 955da9d5-c8b1-467a-bada-b813ca146aad
35262025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
35272025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.041\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"955da9d5-c8b1-467a-bada-b813ca146aad"}
35282025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35292025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
35302025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
35312025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
35322025-01-09T01:48:47.053ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-09 01:38:47.053253854 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
35332025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
35342025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
35352025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
35362025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
35372025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
35382025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35392025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
35402025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35412025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
35422025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
35432025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35442025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
35452025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
35462025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35472025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35482025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35492025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
35502025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35512025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35522025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35532025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35542025-01-09T01:48:47.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35552025-01-09T01:48:47.053ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cb79fd4-3b79-4466-bb86-657f7f0ada22.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d28db04c-86dc-4788-b08f-467ff8a673dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1859, tv_nsec: 4944920 } })
35562025-01-09T01:48:47.053ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1587a3be-b05d-4475-8c28-83a2cddb206f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4008b857-31de-45a2-bfb6-156254963434.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("db7bb166-91ce-4196-80af-3fafccfe99a2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1859, tv_nsec: 4959110 } })
35572025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
35582025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
35592025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35602025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
35612025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35622025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35632025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
35642025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35652025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35662025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
35672025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
35682025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
35692025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35702025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
35712025-01-09T01:48:47.054ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
35722025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35732025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35742025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
35752025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35762025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
35772025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35782025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35792025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
35802025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
35812025-01-09T01:48:47.054ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35822025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
35832025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35842025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
35852025-01-09T01:48:47.054ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
35862025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35872025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35882025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35892025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35902025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35912025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35922025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35932025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
35942025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35952025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35962025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
35972025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.335031ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
35982025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.325851ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
35992025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36002025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36012025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36022025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36032025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36042025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36052025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36062025-01-09T01:48:47.054ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36072025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36082025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36092025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36102025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36112025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36122025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36132025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36142025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
36152025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36162025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
36172025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36182025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
36192025-01-09T01:48:47.055ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
36202025-01-09T01:48:47.056ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
36212025-01-09T01:48:47.056ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
36222025-01-09T01:48:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
36232025-01-09T01:48:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36242025-01-09T01:48:47.056ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1859, tv_nsec: 7200787 } })
36252025-01-09T01:48:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
36262025-01-09T01:48:47.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36272025-01-09T01:48:47.056ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
36282025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
36292025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
36302025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36312025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36322025-01-09T01:48:47.057ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-09 01:38:47.053253854 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
36332025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.901953ms iteration = 16 status = {"expiration":"2025-01-09T01:38:47.053253854Z","pruned":[]}
36342025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.895352ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36352025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36362025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36372025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36382025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36392025-01-09T01:48:47.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36402025-01-09T01:48:47.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36412025-01-09T01:48:47.058ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1859, tv_nsec: 9360841 } })
36422025-01-09T01:48:47.058ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
36432025-01-09T01:48:47.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36442025-01-09T01:48:47.060ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36452025-01-09T01:48:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36462025-01-09T01:48:47.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36472025-01-09T01:48:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36482025-01-09T01:48:47.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36492025-01-09T01:48:47.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502025-01-09T01:48:47.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512025-01-09T01:48:47.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36522025-01-09T01:48:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36532025-01-09T01:48:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36542025-01-09T01:48:47.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36552025-01-09T01:48:47.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36562025-01-09T01:48:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36572025-01-09T01:48:47.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36582025-01-09T01:48:47.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36592025-01-09T01:48:47.066ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36602025-01-09T01:48:47.068ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36612025-01-09T01:48:47.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
36622025-01-09T01:48:47.070ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36632025-01-09T01:48:47.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36642025-01-09T01:48:47.070ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36652025-01-09T01:48:47.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36662025-01-09T01:48:47.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36672025-01-09T01:48:47.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36682025-01-09T01:48:47.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36692025-01-09T01:48:47.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36702025-01-09T01:48:47.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36712025-01-09T01:48:47.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36722025-01-09T01:48:47.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36732025-01-09T01:48:47.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36742025-01-09T01:48:47.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36752025-01-09T01:48:47.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36762025-01-09T01:48:47.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36772025-01-09T01:48:47.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36782025-01-09T01:48:47.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36792025-01-09T01:48:47.078ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36802025-01-09T01:48:47.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36812025-01-09T01:48:47.079ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36822025-01-09T01:48:47.079ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.864414ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
36832025-01-09T01:48:47.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
36842025-01-09T01:48:47.081ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
36852025-01-09T01:48:47.081ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 23.913354ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
36862025-01-09T01:48:47.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
36872025-01-09T01:48:47.081ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36882025-01-09T01:48:47.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36892025-01-09T01:48:47.082ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
36902025-01-09T01:48:47.082ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
36912025-01-09T01:48:47.082ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 26.028609ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
36922025-01-09T01:48:47.082ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36932025-01-09T01:48:47.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36942025-01-09T01:48:47.083ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36952025-01-09T01:48:47.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36962025-01-09T01:48:47.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36972025-01-09T01:48:47.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36982025-01-09T01:48:47.085ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1859, tv_nsec: 36702461 } })
36992025-01-09T01:48:47.086ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
37002025-01-09T01:48:47.086ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37012025-01-09T01:48:47.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37022025-01-09T01:48:47.088ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37032025-01-09T01:48:47.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37042025-01-09T01:48:47.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 33.51233ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37052025-01-09T01:48:47.090ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37062025-01-09T01:48:47.090ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 36.114571ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37072025-01-09T01:48:47.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37082025-01-09T01:48:47.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37092025-01-09T01:48:47.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37102025-01-09T01:48:47.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
37112025-01-09T01:48:47.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37122025-01-09T01:48:47.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37132025-01-09T01:48:47.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37142025-01-09T01:48:47.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 38.913055ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37152025-01-09T01:48:47.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37162025-01-09T01:48:47.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37172025-01-09T01:48:47.097ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37182025-01-09T01:48:47.097ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37192025-01-09T01:48:47.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37202025-01-09T01:48:47.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37212025-01-09T01:48:47.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37222025-01-09T01:48:47.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37232025-01-09T01:48:47.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
37242025-01-09T01:48:47.103ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37252025-01-09T01:48:47.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37262025-01-09T01:48:47.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37272025-01-09T01:48:47.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37282025-01-09T01:48:47.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37292025-01-09T01:48:47.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37302025-01-09T01:48:47.107ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37312025-01-09T01:48:47.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.768915ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37322025-01-09T01:48:47.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37332025-01-09T01:48:47.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37342025-01-09T01:48:47.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37352025-01-09T01:48:47.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37362025-01-09T01:48:47.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37372025-01-09T01:48:47.111ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
37382025-01-09T01:48:47.111ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.197646ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
37392025-01-09T01:48:47.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37402025-01-09T01:48:47.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37412025-01-09T01:48:47.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37422025-01-09T01:48:47.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37432025-01-09T01:48:47.113ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37442025-01-09T01:48:47.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
37452025-01-09T01:48:47.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37462025-01-09T01:48:47.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
37472025-01-09T01:48:47.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37482025-01-09T01:48:47.116ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
37492025-01-09T01:48:47.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
37502025-01-09T01:48:47.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37512025-01-09T01:48:47.122ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37522025-01-09T01:48:47.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37532025-01-09T01:48:47.124ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 70.447193ms iteration = 7 status = {"nsuccess":5}
37542025-01-09T01:48:47.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.889278ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
37552025-01-09T01:48:47.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37562025-01-09T01:48:47.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37572025-01-09T01:48:47.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37582025-01-09T01:48:47.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37592025-01-09T01:48:47.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37602025-01-09T01:48:47.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37612025-01-09T01:48:47.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37622025-01-09T01:48:47.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37632025-01-09T01:48:47.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37642025-01-09T01:48:47.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37652025-01-09T01:48:47.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37662025-01-09T01:48:47.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37672025-01-09T01:48:47.131ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37682025-01-09T01:48:47.131ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37692025-01-09T01:48:47.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.562587ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37702025-01-09T01:48:47.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37712025-01-09T01:48:47.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37722025-01-09T01:48:47.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37732025-01-09T01:48:47.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37742025-01-09T01:48:47.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37752025-01-09T01:48:47.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37762025-01-09T01:48:47.136ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772025-01-09T01:48:47.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37782025-01-09T01:48:47.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37792025-01-09T01:48:47.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37802025-01-09T01:48:47.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
37812025-01-09T01:48:47.141ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37822025-01-09T01:48:47.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37832025-01-09T01:48:47.141ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37842025-01-09T01:48:47.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37852025-01-09T01:48:47.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37862025-01-09T01:48:47.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37872025-01-09T01:48:47.144ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37882025-01-09T01:48:47.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37892025-01-09T01:48:47.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37902025-01-09T01:48:47.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37912025-01-09T01:48:47.145ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 91.696755ms iteration = 34 status = {"physical_disks_added":0}
37922025-01-09T01:48:47.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
37932025-01-09T01:48:47.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37942025-01-09T01:48:47.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37952025-01-09T01:48:47.148ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
37962025-01-09T01:48:47.148ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
37972025-01-09T01:48:47.148ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.033932ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
37982025-01-09T01:48:47.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37992025-01-09T01:48:47.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38002025-01-09T01:48:47.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38012025-01-09T01:48:47.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38022025-01-09T01:48:47.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38032025-01-09T01:48:47.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38042025-01-09T01:48:47.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38052025-01-09T01:48:47.160ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38062025-01-09T01:48:47.160ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38072025-01-09T01:48:47.160ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38082025-01-09T01:48:47.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38092025-01-09T01:48:47.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38102025-01-09T01:48:47.161ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38112025-01-09T01:48:47.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38122025-01-09T01:48:47.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38132025-01-09T01:48:47.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38142025-01-09T01:48:47.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38152025-01-09T01:48:47.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38162025-01-09T01:48:47.163ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38172025-01-09T01:48:47.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38182025-01-09T01:48:47.177ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
38192025-01-09T01:48:47.177ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
38202025-01-09T01:48:47.177ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
38212025-01-09T01:48:47.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38222025-01-09T01:48:47.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38232025-01-09T01:48:47.197ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38242025-01-09T01:48:47.197ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
38252025-01-09T01:48:47.197ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
38262025-01-09T01:48:47.197ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
38272025-01-09T01:48:47.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38282025-01-09T01:48:47.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38292025-01-09T01:48:47.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38302025-01-09T01:48:47.203ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38312025-01-09T01:48:47.203ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38322025-01-09T01:48:47.203ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
38332025-01-09T01:48:47.204ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37ee0643-6349-4bc2-a63b-72a19a41dec0", "content-length": "26", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
38342025-01-09T01:48:47.204ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38352025-01-09T01:48:47.206ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38362025-01-09T01:48:47.219ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
38372025-01-09T01:48:47.240ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
38382025-01-09T01:48:47.240ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38392025-01-09T01:48:47.240ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a81f81ad-db96-42b0-ba21-987f84b06001", "content-length": "26", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
38402025-01-09T01:48:47.240ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38412025-01-09T01:48:47.243ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
38422025-01-09T01:48:47.284ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
38432025-01-09T01:48:47.284ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38442025-01-09T01:48:47.285ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c47c1d34-3ff8-4ff5-a1e6-0b85e8e686fa", "content-length": "26", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
38452025-01-09T01:48:47.285ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38462025-01-09T01:48:47.287ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38472025-01-09T01:48:47.368ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38482025-01-09T01:48:47.368ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2b9ac20-cea4-4749-8a89-9dc0d08be011", "content-length": "2", "date": "Thu, 09 Jan 2025 01:48:46 GMT"} })
38492025-01-09T01:48:47.369ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38502025-01-09T01:48:47.369ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38512025-01-09T01:48:47.370ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac9a5a4e-d50b-4919-9bfe-781ea01c34bc", "content-length": "372", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
38522025-01-09T01:48:47.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38532025-01-09T01:48:47.370ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38542025-01-09T01:48:47.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38552025-01-09T01:48:47.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38562025-01-09T01:48:47.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38572025-01-09T01:48:47.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38582025-01-09T01:48:47.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38592025-01-09T01:48:47.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38602025-01-09T01:48:47.376ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38612025-01-09T01:48:47.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38622025-01-09T01:48:47.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38632025-01-09T01:48:47.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38642025-01-09T01:48:47.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38652025-01-09T01:48:47.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38662025-01-09T01:48:47.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38672025-01-09T01:48:47.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38682025-01-09T01:48:47.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38692025-01-09T01:48:47.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38702025-01-09T01:48:47.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38712025-01-09T01:48:47.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38722025-01-09T01:48:47.403ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
38732025-01-09T01:48:47.416ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
38742025-01-09T01:48:47.416ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "95f9d1ba-be1b-4351-90d3-e535b8cc92d2", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
38752025-01-09T01:48:47.416ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
38762025-01-09T01:48:47.419ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "aee8b9a4-0cdc-42b3-8dc7-157fc2b8c777", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
38772025-01-09T01:48:47.419ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
38782025-01-09T01:48:47.425ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
38792025-01-09T01:48:47.425ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 371.923653ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
38802025-01-09T01:48:47.428ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38812025-01-09T01:48:47.428ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38822025-01-09T01:48:47.428ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 374.437603ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38832025-01-09T01:48:47.501ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38842025-01-09T01:48:47.502ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "56b0005e-e0d9-4bef-b0a9-f2eda6b190c4", "content-length": "691", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
38852025-01-09T01:48:47.502ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38862025-01-09T01:48:47.502ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38872025-01-09T01:48:47.502ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
38882025-01-09T01:48:47.504ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 450.639309ms iteration = 32 status = {}
38892025-01-09T01:48:47.505ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 452.400947ms iteration = 31 status = null
38902025-01-09T01:48:47.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912025-01-09T01:48:47.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38922025-01-09T01:48:47.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38932025-01-09T01:48:47.507ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
38942025-01-09T01:48:47.507ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 453.541916ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
38952025-01-09T01:48:47.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
38962025-01-09T01:48:47.509ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38972025-01-09T01:48:47.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38982025-01-09T01:48:47.515ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 461.046307ms iteration = 31 status = 0
38992025-01-09T01:48:47.533ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 480.446768ms iteration = 31 status = {}
39002025-01-09T01:48:47.541ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
39012025-01-09T01:48:47.541ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b9905f18-dba3-4f32-8eba-735f284c6c1e", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
39022025-01-09T01:48:47.541ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
39032025-01-09T01:48:47.543ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dff57ec2-366e-450c-b572-19aa0350ab56", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
39042025-01-09T01:48:47.543ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
39052025-01-09T01:48:47.544ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39062025-01-09T01:48:47.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39072025-01-09T01:48:47.545ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6661255d-28ce-466b-a4eb-1b7d46b1781a", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
39082025-01-09T01:48:47.545ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
39092025-01-09T01:48:47.546ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39102025-01-09T01:48:47.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39112025-01-09T01:48:47.547ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
39122025-01-09T01:48:47.547ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 494.741879ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
39132025-01-09T01:48:47.548ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39142025-01-09T01:48:47.549ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
39152025-01-09T01:48:47.549ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
39162025-01-09T01:48:47.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39172025-01-09T01:48:47.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39182025-01-09T01:48:47.550ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
39192025-01-09T01:48:47.550ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 0 version = 2
39202025-01-09T01:48:47.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39212025-01-09T01:48:47.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39222025-01-09T01:48:47.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232025-01-09T01:48:47.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39242025-01-09T01:48:47.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
39252025-01-09T01:48:47.553ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39262025-01-09T01:48:47.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39272025-01-09T01:48:47.554ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
39282025-01-09T01:48:47.554ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39292025-01-09T01:48:47.554ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c391d9dd-7bc3-4523-a48c-75e0f5ecd18e", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
39302025-01-09T01:48:47.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39312025-01-09T01:48:47.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39322025-01-09T01:48:47.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39332025-01-09T01:48:47.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39342025-01-09T01:48:47.555ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-09T01:33:44.544211Z, time_modified: 2025-01-09T01:33:44.544211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f309fae8-595c-4a3f-a884-58b43b6636ce, db_silo: Silo { identity: SiloIdentity { id: f309fae8-595c-4a3f-a884-58b43b6636ce, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-09T01:34:30.366185Z, time_modified: 2025-01-09T01:34:30.366185Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e" }] }) }
39352025-01-09T01:48:47.555ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 501.822482ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]}},"default_endpoint":{"silo_id":"f309fae8-595c-4a3f-a884-58b43b6636ce","tls_certs":["6b0f81f0e6e046a1d08d2e44f462005a1e3bdd88d6680a2b4c6f47faebab387e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
39362025-01-09T01:48:47.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39372025-01-09T01:48:47.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39382025-01-09T01:48:47.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39392025-01-09T01:48:47.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39402025-01-09T01:48:47.555ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39412025-01-09T01:48:47.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39422025-01-09T01:48:47.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39432025-01-09T01:48:47.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39442025-01-09T01:48:47.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39452025-01-09T01:48:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39462025-01-09T01:48:47.560ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a31173c8-4a8f-4152-b1bf-5ed419a00804 dns_zone_name = oxide.test found_so_far = 1 version = 2
39472025-01-09T01:48:47.560ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
39482025-01-09T01:48:47.560ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-09 01:34:30.412566 UTC dns_group = external generation = 2
39492025-01-09T01:48:47.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 507.479004ms iteration = 16 status = {"generation":2}
39502025-01-09T01:48:47.561ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = fd413d51-e8c7-4439-91e9-3e32d5dabfe7 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
39512025-01-09T01:48:47.561ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
39522025-01-09T01:48:47.561ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-09 01:34:29.546076 UTC dns_group = internal generation = 1
39532025-01-09T01:48:47.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 507.667036ms iteration = 16 status = {"generation":1}
39542025-01-09T01:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39552025-01-09T01:48:47.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39562025-01-09T01:48:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39572025-01-09T01:48:47.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
39582025-01-09T01:48:47.565ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39592025-01-09T01:48:47.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39602025-01-09T01:48:47.567ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39612025-01-09T01:48:47.567ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39622025-01-09T01:48:47.568ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6aade530-3ac7-4037-aaee-b638bcc20a0c", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
39632025-01-09T01:48:47.569ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39642025-01-09T01:48:47.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39652025-01-09T01:48:47.570ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 516.381007ms iteration = 32 status = {}
39662025-01-09T01:48:47.571ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39672025-01-09T01:48:47.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39682025-01-09T01:48:47.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39692025-01-09T01:48:47.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39702025-01-09T01:48:47.576ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39712025-01-09T01:48:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39722025-01-09T01:48:47.578ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39732025-01-09T01:48:47.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39742025-01-09T01:48:47.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39752025-01-09T01:48:47.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39762025-01-09T01:48:47.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39772025-01-09T01:48:47.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39782025-01-09T01:48:47.582ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39792025-01-09T01:48:47.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
39802025-01-09T01:48:47.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39812025-01-09T01:48:47.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39822025-01-09T01:48:47.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39832025-01-09T01:48:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39842025-01-09T01:48:47.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39852025-01-09T01:48:47.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39862025-01-09T01:48:47.610ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
39872025-01-09T01:48:47.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39882025-01-09T01:48:47.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39892025-01-09T01:48:47.621ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39902025-01-09T01:48:47.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39912025-01-09T01:48:47.623ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39922025-01-09T01:48:47.626ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39932025-01-09T01:48:47.626ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "32bd14b5-f211-478f-a9d7-8ce561d7a4cf", "content-length": "134", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
39942025-01-09T01:48:47.626ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39952025-01-09T01:48:47.626ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
39962025-01-09T01:48:47.626ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39972025-01-09T01:48:47.626ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39982025-01-09T01:48:47.626ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39992025-01-09T01:48:47.627ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40002025-01-09T01:48:47.627ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40012025-01-09T01:48:47.627ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40022025-01-09T01:48:47.627ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40032025-01-09T01:48:47.627ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40042025-01-09T01:48:47.627ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
40052025-01-09T01:48:47.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40062025-01-09T01:48:47.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40072025-01-09T01:48:47.628ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
40082025-01-09T01:48:47.628ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40092025-01-09T01:48:47.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40102025-01-09T01:48:47.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40112025-01-09T01:48:47.630ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f8036c7-7624-4068-b19f-1b33eb36942d", "content-length": "2", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
40122025-01-09T01:48:47.630ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40132025-01-09T01:48:47.630ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b2a6c00-8edd-4cdc-a940-91c18388cb58", "content-length": "52", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
40142025-01-09T01:48:47.630ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
40152025-01-09T01:48:47.630ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40162025-01-09T01:48:47.635ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
40172025-01-09T01:48:47.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40182025-01-09T01:48:47.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40192025-01-09T01:48:47.637ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202025-01-09T01:48:47.638ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
40212025-01-09T01:48:47.639ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40222025-01-09T01:48:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40232025-01-09T01:48:47.640ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
40242025-01-09T01:48:47.640ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 090cf7d4-a338-4f4f-ac44-b389a73610c3, kind: Service { id: 5cb79fd4-3b79-4466-bb86-657f7f0ada22 }, name: Name("external-dns-5cb79fd4-3b79-4466-bb86-657f7f0ada22"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 217])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 0914d9ad-fb24-4cfa-babb-de4c02ae3708, kind: Service { id: d28db04c-86dc-4788-b08f-467ff8a673dc }, name: Name("external-dns-d28db04c-86dc-4788-b08f-467ff8a673dc"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 111])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: b2cc3b11-f9f4-442d-887f-787d04e9498b, kind: Service { id: 3ca012d2-322f-4398-94cf-49e9d02ebe0a }, name: Name("nexus-3ca012d2-322f-4398-94cf-49e9d02ebe0a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 243, 43])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e238ac8a-cb2f-4ce4-8e23-72f458e7f7f0, kind: Service { id: 74d09270-c94b-4c18-b2b3-d5f83a0dc096 }, name: Name("nexus-74d09270-c94b-4c18-b2b3-d5f83a0dc096"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 182])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f9cb2b20-6fb0-4377-97d2-f5f43b9336a6, kind: Service { id: 94da342f-e446-47fd-a8fe-112f8b9a9fc9 }, name: Name("nexus-94da342f-e446-47fd-a8fe-112f8b9a9fc9"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 252, 133])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
40252025-01-09T01:48:47.640ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
40262025-01-09T01:48:47.736ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7ddc3d18-f556-4e28-9987-f4886c45c428", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
40272025-01-09T01:48:47.736ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
40282025-01-09T01:48:47.736ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40292025-01-09T01:48:47.736ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3804136-8453-4738-ad5b-7151f6ee5544", "content-length": "682", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
40302025-01-09T01:48:47.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40312025-01-09T01:48:47.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40322025-01-09T01:48:47.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40332025-01-09T01:48:47.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40342025-01-09T01:48:47.744ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, time_created: 2025-01-09T01:34:22.988660Z, time_modified: 2025-01-09T01:34:22.988660Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
40352025-01-09T01:48:47.744ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
40362025-01-09T01:48:47.744ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40372025-01-09T01:48:47.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40382025-01-09T01:48:47.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40392025-01-09T01:48:47.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40402025-01-09T01:48:47.747ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40412025-01-09T01:48:47.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40422025-01-09T01:48:47.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40432025-01-09T01:48:47.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40442025-01-09T01:48:47.748ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40452025-01-09T01:48:47.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
40462025-01-09T01:48:47.754ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 700.538019ms iteration = 31 status = {}
40472025-01-09T01:48:47.782ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
40482025-01-09T01:48:47.783ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "5f5ad070-e9c8-4dac-9efe-3694448a044e", "date": "Thu, 09 Jan 2025 01:48:47 GMT"} })
40492025-01-09T01:48:47.783ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
40502025-01-09T01:48:47.783ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 729.720159ms
40512025-01-09T01:48:47.783ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 729.729369ms iteration = 4 status = {}
40522025-01-09T01:48:47.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b117819d-d19c-443f-a51a-2695f5f34809 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40532025-01-09T01:48:47.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b117819d-d19c-443f-a51a-2695f5f34809 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40542025-01-09T01:48:47.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b117819d-d19c-443f-a51a-2695f5f34809 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40552025-01-09T01:48:48.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0aabf2c-233b-4aac-bd0d-7426a43783b4 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40562025-01-09T01:48:48.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0aabf2c-233b-4aac-bd0d-7426a43783b4 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40572025-01-09T01:48:48.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c0aabf2c-233b-4aac-bd0d-7426a43783b4 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40582025-01-09T01:48:49.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 678 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 1a0b39c4-8630-4b80-b6b2-d97f3644e357 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
40592025-01-09T01:48:49.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 879ec5f6-1a3a-4806-803b-08bcf2687049 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40602025-01-09T01:48:49.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 879ec5f6-1a3a-4806-803b-08bcf2687049 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40612025-01-09T01:48:49.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 879ec5f6-1a3a-4806-803b-08bcf2687049 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40622025-01-09T01:48:50.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f87495d9-cd41-4604-866b-1a245c7efce7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40632025-01-09T01:48:50.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f87495d9-cd41-4604-866b-1a245c7efce7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40642025-01-09T01:48:50.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f87495d9-cd41-4604-866b-1a245c7efce7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40652025-01-09T01:48:52.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f70cd813-02fc-4c52-883a-48b34f5a1d4d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40662025-01-09T01:48:52.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f70cd813-02fc-4c52-883a-48b34f5a1d4d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40672025-01-09T01:48:52.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f70cd813-02fc-4c52-883a-48b34f5a1d4d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40682025-01-09T01:48:53.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09848316-7e6d-400a-8adb-8910730a6c0e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40692025-01-09T01:48:53.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09848316-7e6d-400a-8adb-8910730a6c0e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40702025-01-09T01:48:53.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 09848316-7e6d-400a-8adb-8910730a6c0e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40712025-01-09T01:48:54.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2afb46af-3274-4d27-9cd6-3b7e95bf5009 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40722025-01-09T01:48:54.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2afb46af-3274-4d27-9cd6-3b7e95bf5009 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40732025-01-09T01:48:54.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 2afb46af-3274-4d27-9cd6-3b7e95bf5009 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40742025-01-09T01:48:54.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5800a3da-a276-43cf-9f3d-3e235a7c2351 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
40752025-01-09T01:48:54.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5800a3da-a276-43cf-9f3d-3e235a7c2351 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
40762025-01-09T01:48:54.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5800a3da-a276-43cf-9f3d-3e235a7c2351 response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
40772025-01-09T01:48:55.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1832d4f8-9433-4d2d-93c8-04cf637708ea roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40782025-01-09T01:48:55.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1832d4f8-9433-4d2d-93c8-04cf637708ea resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40792025-01-09T01:48:55.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1832d4f8-9433-4d2d-93c8-04cf637708ea response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40802025-01-09T01:48:56.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f1154d72-5166-4f98-8ac0-aeae61d00e04 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40812025-01-09T01:48:56.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f1154d72-5166-4f98-8ac0-aeae61d00e04 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40822025-01-09T01:48:56.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f1154d72-5166-4f98-8ac0-aeae61d00e04 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
40832025-01-09T01:48:57.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
40842025-01-09T01:48:57.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40852025-01-09T01:48:57.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40862025-01-09T01:48:57.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
40872025-01-09T01:48:57.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40882025-01-09T01:48:57.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40892025-01-09T01:48:57.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40902025-01-09T01:48:57.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40912025-01-09T01:48:57.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40922025-01-09T01:48:57.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40932025-01-09T01:48:57.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40942025-01-09T01:48:57.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40952025-01-09T01:48:57.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40962025-01-09T01:48:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
40972025-01-09T01:48:57.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40982025-01-09T01:48:57.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40992025-01-09T01:48:57.080ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
41002025-01-09T01:48:57.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.575653ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
41012025-01-09T01:48:57.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41022025-01-09T01:48:57.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41032025-01-09T01:48:57.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.923674ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41042025-01-09T01:48:57.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3f15c30-529d-49e1-9cda-6171a091b9a8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41052025-01-09T01:48:57.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3f15c30-529d-49e1-9cda-6171a091b9a8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41062025-01-09T01:48:57.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3f15c30-529d-49e1-9cda-6171a091b9a8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41072025-01-09T01:48:58.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a38f7d0-a26c-4c79-8c0f-6b1afbf77733 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41082025-01-09T01:48:58.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a38f7d0-a26c-4c79-8c0f-6b1afbf77733 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41092025-01-09T01:48:58.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4a38f7d0-a26c-4c79-8c0f-6b1afbf77733 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41102025-01-09T01:48:59.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 808f124b-7999-4a54-94e4-3333c5404cce roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41112025-01-09T01:48:59.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 808f124b-7999-4a54-94e4-3333c5404cce resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41122025-01-09T01:48:59.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 808f124b-7999-4a54-94e4-3333c5404cce response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41132025-01-09T01:48:59.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 603 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 54d12c9d-faba-40b8-ad83-e5c0d8f5f569 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
41142025-01-09T01:49:00.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e0bec6b5-8730-4107-8a38-5518cf5a30cb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41152025-01-09T01:49:00.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e0bec6b5-8730-4107-8a38-5518cf5a30cb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41162025-01-09T01:49:00.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = e0bec6b5-8730-4107-8a38-5518cf5a30cb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41172025-01-09T01:49:01.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9fdd2e6d-cbbb-4c41-b524-f49ac651ea10 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41182025-01-09T01:49:01.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9fdd2e6d-cbbb-4c41-b524-f49ac651ea10 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41192025-01-09T01:49:01.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9fdd2e6d-cbbb-4c41-b524-f49ac651ea10 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41202025-01-09T01:49:02.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d044220a-802e-4e02-880c-6c90d9f37748 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41212025-01-09T01:49:02.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d044220a-802e-4e02-880c-6c90d9f37748 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41222025-01-09T01:49:02.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = d044220a-802e-4e02-880c-6c90d9f37748 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41232025-01-09T01:49:03.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db7ae5bf-4c2e-41da-b172-ebd57b765da8 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41242025-01-09T01:49:03.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db7ae5bf-4c2e-41da-b172-ebd57b765da8 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41252025-01-09T01:49:03.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = db7ae5bf-4c2e-41da-b172-ebd57b765da8 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41262025-01-09T01:49:04.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b16de92-eff5-4fd3-b90a-26db830de089 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41272025-01-09T01:49:04.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b16de92-eff5-4fd3-b90a-26db830de089 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41282025-01-09T01:49:04.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b16de92-eff5-4fd3-b90a-26db830de089 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41292025-01-09T01:49:05.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be3c4920-9d2d-4eff-93e8-27721258be30 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41302025-01-09T01:49:05.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be3c4920-9d2d-4eff-93e8-27721258be30 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41312025-01-09T01:49:05.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = be3c4920-9d2d-4eff-93e8-27721258be30 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41322025-01-09T01:49:06.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1d4c2c4-6f75-4433-8a88-7fc01dea0f0f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41332025-01-09T01:49:06.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1d4c2c4-6f75-4433-8a88-7fc01dea0f0f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41342025-01-09T01:49:06.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = b1d4c2c4-6f75-4433-8a88-7fc01dea0f0f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41352025-01-09T01:49:07.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
41362025-01-09T01:49:07.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41372025-01-09T01:49:07.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41382025-01-09T01:49:07.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
41392025-01-09T01:49:07.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41402025-01-09T01:49:07.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41412025-01-09T01:49:07.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41422025-01-09T01:49:07.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41432025-01-09T01:49:07.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41442025-01-09T01:49:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41452025-01-09T01:49:07.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41462025-01-09T01:49:07.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41472025-01-09T01:49:07.058ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.73109ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41482025-01-09T01:49:07.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41492025-01-09T01:49:07.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41502025-01-09T01:49:07.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41512025-01-09T01:49:07.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
41522025-01-09T01:49:07.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41532025-01-09T01:49:07.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41542025-01-09T01:49:07.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
41552025-01-09T01:49:07.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.756662ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
41562025-01-09T01:49:07.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 961f4bed-214f-4479-a710-6ab6b12e9e09 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41572025-01-09T01:49:07.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 961f4bed-214f-4479-a710-6ab6b12e9e09 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41582025-01-09T01:49:07.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 961f4bed-214f-4479-a710-6ab6b12e9e09 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41592025-01-09T01:49:08.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7feee627-875b-424f-8f7f-3a990c7a0cba roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41602025-01-09T01:49:08.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7feee627-875b-424f-8f7f-3a990c7a0cba resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41612025-01-09T01:49:08.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 7feee627-875b-424f-8f7f-3a990c7a0cba response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41622025-01-09T01:49:09.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3cc4e944-b924-4463-93be-9f122239944b roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41632025-01-09T01:49:09.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3cc4e944-b924-4463-93be-9f122239944b resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41642025-01-09T01:49:09.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3cc4e944-b924-4463-93be-9f122239944b response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41652025-01-09T01:49:09.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 672 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = bb578641-a61f-4d7b-9dff-d0c359703a9b response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
41662025-01-09T01:49:10.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a79f7798-6ec6-4f03-bee6-0dfdda15043d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41672025-01-09T01:49:10.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a79f7798-6ec6-4f03-bee6-0dfdda15043d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41682025-01-09T01:49:10.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a79f7798-6ec6-4f03-bee6-0dfdda15043d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41692025-01-09T01:49:11.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c2fc00af-f04b-4307-8647-81853840fcf5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41702025-01-09T01:49:11.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c2fc00af-f04b-4307-8647-81853840fcf5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41712025-01-09T01:49:11.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c2fc00af-f04b-4307-8647-81853840fcf5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41722025-01-09T01:49:12.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0450d137-4de9-469e-ac01-76ef5724504a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41732025-01-09T01:49:12.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0450d137-4de9-469e-ac01-76ef5724504a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41742025-01-09T01:49:12.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 0450d137-4de9-469e-ac01-76ef5724504a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41752025-01-09T01:49:13.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89233b24-98ae-4cff-bad4-8788ccba82f1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41762025-01-09T01:49:13.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89233b24-98ae-4cff-bad4-8788ccba82f1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41772025-01-09T01:49:13.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 89233b24-98ae-4cff-bad4-8788ccba82f1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41782025-01-09T01:49:14.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6eec9f04-3840-443c-81da-062befc5eedd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41792025-01-09T01:49:14.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6eec9f04-3840-443c-81da-062befc5eedd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41802025-01-09T01:49:14.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6eec9f04-3840-443c-81da-062befc5eedd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41812025-01-09T01:49:14.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 9f8afead-756f-4308-9170-2f08d0e910d4 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
41822025-01-09T01:49:14.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 9f8afead-756f-4308-9170-2f08d0e910d4 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
41832025-01-09T01:49:14.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 9f8afead-756f-4308-9170-2f08d0e910d4 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
41842025-01-09T01:49:14.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 038c9347-c8ad-4973-9531-81f4228ce2c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
41852025-01-09T01:49:14.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 038c9347-c8ad-4973-9531-81f4228ce2c3 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
41862025-01-09T01:49:14.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 038c9347-c8ad-4973-9531-81f4228ce2c3 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
41872025-01-09T01:49:15.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 05503053-81f0-4b44-a6a2-e0c4caa13ceb roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41882025-01-09T01:49:15.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 05503053-81f0-4b44-a6a2-e0c4caa13ceb resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41892025-01-09T01:49:15.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 05503053-81f0-4b44-a6a2-e0c4caa13ceb response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41902025-01-09T01:49:16.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bd5d0e45-9182-46b7-9209-da79016ebb84 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41912025-01-09T01:49:16.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bd5d0e45-9182-46b7-9209-da79016ebb84 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41922025-01-09T01:49:16.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = bd5d0e45-9182-46b7-9209-da79016ebb84 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
41932025-01-09T01:49:17.053ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 32 reason = Timeout
41942025-01-09T01:49:17.053ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41952025-01-09T01:49:17.053ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 94 reason = Timeout
41962025-01-09T01:49:17.053ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 32 reason = Timeout
41972025-01-09T01:49:17.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41982025-01-09T01:49:17.053ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 32 reason = Timeout
41992025-01-09T01:49:17.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42002025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42012025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42022025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42032025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 32 reason = Timeout
42042025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 32 reason = Timeout
42052025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42062025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42072025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
42082025-01-09T01:49:17.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42092025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 32 reason = Timeout
42102025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42112025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
42122025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
42132025-01-09T01:49:17.055ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42142025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42152025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
42162025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42172025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42182025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42192025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 94 reason = Timeout
42202025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42212025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 32 reason = Timeout
42222025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42232025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42242025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42252025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42262025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42272025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42282025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42292025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42302025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42312025-01-09T01:49:17.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42322025-01-09T01:49:17.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42332025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 32 reason = Timeout
42342025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 32 reason = Timeout
42352025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42362025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42372025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 32 reason = Timeout
42382025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42392025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 32 reason = Timeout
42402025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42412025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42422025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42432025-01-09T01:49:17.057ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1889, tv_nsec: 8178802 } })
42442025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42452025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42462025-01-09T01:49:17.057ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1889, tv_nsec: 8267274 } })
42472025-01-09T01:49:17.057ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
42482025-01-09T01:49:17.057ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
42492025-01-09T01:49:17.057ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.094396ms iteration = 32 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42502025-01-09T01:49:17.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42512025-01-09T01:49:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
42522025-01-09T01:49:17.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42532025-01-09T01:49:17.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42542025-01-09T01:49:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42552025-01-09T01:49:17.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42562025-01-09T01:49:17.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42572025-01-09T01:49:17.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42582025-01-09T01:49:17.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42592025-01-09T01:49:17.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42602025-01-09T01:49:17.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42612025-01-09T01:49:17.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42622025-01-09T01:49:17.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42632025-01-09T01:49:17.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42642025-01-09T01:49:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42652025-01-09T01:49:17.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42662025-01-09T01:49:17.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42672025-01-09T01:49:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42682025-01-09T01:49:17.069ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42692025-01-09T01:49:17.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42702025-01-09T01:49:17.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42712025-01-09T01:49:17.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42722025-01-09T01:49:17.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42732025-01-09T01:49:17.073ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-2a5ec8ce-31e5-4982-a156-7cc817b136d7.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1889, tv_nsec: 24058968 } })
42742025-01-09T01:49:17.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42752025-01-09T01:49:17.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42762025-01-09T01:49:17.073ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
42772025-01-09T01:49:17.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42782025-01-09T01:49:17.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42792025-01-09T01:49:17.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42802025-01-09T01:49:17.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42812025-01-09T01:49:17.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42822025-01-09T01:49:17.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42832025-01-09T01:49:17.076ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42842025-01-09T01:49:17.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42852025-01-09T01:49:17.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42862025-01-09T01:49:17.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42872025-01-09T01:49:17.093ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42882025-01-09T01:49:17.093ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42892025-01-09T01:49:17.093ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42902025-01-09T01:49:17.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42912025-01-09T01:49:17.099ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.646476ms iteration = 32 status = {"errors":[],"garbage_collect_requested":[]}
42922025-01-09T01:49:17.100ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42932025-01-09T01:49:17.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42942025-01-09T01:49:17.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.86597ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42952025-01-09T01:49:17.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42962025-01-09T01:49:17.110ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42972025-01-09T01:49:17.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42982025-01-09T01:49:17.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42992025-01-09T01:49:17.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43002025-01-09T01:49:17.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43012025-01-09T01:49:17.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43022025-01-09T01:49:17.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43032025-01-09T01:49:17.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.118137ms iteration = 32 status = {"errors":[],"finish_invoked_ok":[]}
43042025-01-09T01:49:17.119ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43052025-01-09T01:49:17.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43062025-01-09T01:49:17.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43072025-01-09T01:49:17.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43082025-01-09T01:49:17.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43092025-01-09T01:49:17.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43102025-01-09T01:49:17.123ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43112025-01-09T01:49:17.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43122025-01-09T01:49:17.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
43132025-01-09T01:49:17.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43142025-01-09T01:49:17.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43152025-01-09T01:49:17.125ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43162025-01-09T01:49:17.125ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 70.499944ms iteration = 32 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43172025-01-09T01:49:17.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 2a5ec8ce-31e5-4982-a156-7cc817b136d7, lookup_type: ById(2a5ec8ce-31e5-4982-a156-7cc817b136d7) } result = Ok(())
43182025-01-09T01:49:17.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43192025-01-09T01:49:17.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43202025-01-09T01:49:17.132ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43212025-01-09T01:49:17.132ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43222025-01-09T01:49:17.133ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1aa33088-ddcc-4a72-af99-f42dfd126f84", "content-length": "26", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43232025-01-09T01:49:17.133ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43242025-01-09T01:49:17.136ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.030333ms iteration = 32 status = 0
43252025-01-09T01:49:17.136ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43262025-01-09T01:49:17.141ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
43272025-01-09T01:49:17.141ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.727362ms iteration = 94 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
43282025-01-09T01:49:17.144ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43292025-01-09T01:49:17.144ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43302025-01-09T01:49:17.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43312025-01-09T01:49:17.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43322025-01-09T01:49:17.166ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43332025-01-09T01:49:17.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43342025-01-09T01:49:17.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 113.848902ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43352025-01-09T01:49:17.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.302468ms iteration = 94 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43362025-01-09T01:49:17.199ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43372025-01-09T01:49:17.199ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43382025-01-09T01:49:17.199ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.128508ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43392025-01-09T01:49:17.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 149.757079ms iteration = 32 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43402025-01-09T01:49:17.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43412025-01-09T01:49:17.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43422025-01-09T01:49:17.217ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 162.571345ms iteration = 35 status = {"physical_disks_added":0}
43432025-01-09T01:49:17.219ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
43442025-01-09T01:49:17.219ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43452025-01-09T01:49:17.220ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa3e82b5-c8be-49ff-9b1b-1a417b12e754", "content-length": "26", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43462025-01-09T01:49:17.220ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43472025-01-09T01:49:17.221ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43482025-01-09T01:49:17.242ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 188.751006ms iteration = 32 status = {}
43492025-01-09T01:49:17.257ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f zone_address = fd00:1122:3344:101::2
43502025-01-09T01:49:17.257ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43512025-01-09T01:49:17.257ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a0ef758-9441-4817-8941-9ab04dff73b5", "content-length": "26", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43522025-01-09T01:49:17.257ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43532025-01-09T01:49:17.259ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
43542025-01-09T01:49:17.300ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43552025-01-09T01:49:17.300ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43562025-01-09T01:49:17.300ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "38f0e362-9361-483f-b485-f0e437129eeb", "content-length": "372", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43572025-01-09T01:49:17.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43582025-01-09T01:49:17.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43592025-01-09T01:49:17.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43602025-01-09T01:49:17.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43612025-01-09T01:49:17.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43622025-01-09T01:49:17.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43632025-01-09T01:49:17.305ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642025-01-09T01:49:17.306ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43652025-01-09T01:49:17.307ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b3450cf-9e28-461b-8cbf-e0abfe796c0c", "content-length": "2", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43662025-01-09T01:49:17.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43672025-01-09T01:49:17.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43682025-01-09T01:49:17.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43692025-01-09T01:49:17.308ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43702025-01-09T01:49:17.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43712025-01-09T01:49:17.311ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 257.116856ms iteration = 32 status = null
43722025-01-09T01:49:17.343ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
43732025-01-09T01:49:17.343ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43742025-01-09T01:49:17.344ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "25571461-5b93-4418-816c-e50bd553339a", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43752025-01-09T01:49:17.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43762025-01-09T01:49:17.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43772025-01-09T01:49:17.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43782025-01-09T01:49:17.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43792025-01-09T01:49:17.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43802025-01-09T01:49:17.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43812025-01-09T01:49:17.353ZINFOnexus (BackgroundTasks): VPC route manager sled 2a5ec8ce-31e5-4982-a156-7cc817b136d7 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43822025-01-09T01:49:17.353ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43832025-01-09T01:49:17.354ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "efe3f638-e866-4fbe-b4cf-5d489000e603", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43842025-01-09T01:49:17.355ZDEBGnexus (BackgroundTasks): client request SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43852025-01-09T01:49:17.355ZDEBGnexus (BackgroundTasks): client response SledAgent = 2a5ec8ce-31e5-4982-a156-7cc817b136d7 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2825a2da-7b03-47cc-a615-a4d4ec011fdd", "content-length": "691", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43862025-01-09T01:49:17.355ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43872025-01-09T01:49:17.355ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43882025-01-09T01:49:17.355ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43892025-01-09T01:49:17.357ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 302.400854ms iteration = 33 status = {}
43902025-01-09T01:49:17.357ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 302.71473ms iteration = 33 status = {}
43912025-01-09T01:49:17.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43922025-01-09T01:49:17.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43932025-01-09T01:49:17.419ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a2b92b7e-3252-4dcd-9c69-f2c8ed2db1ee, rack_id: 59b29299-38cc-4366-91a5-ce2131096a5f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(e1ee9e8e-38d0-44a5-8303-e06f16612b1a) } rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
43942025-01-09T01:49:17.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43952025-01-09T01:49:17.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43962025-01-09T01:49:17.427ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
43972025-01-09T01:49:17.427ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2beb842c-63a2-4228-b0b1-a3dc903caf07", "content-length": "134", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
43982025-01-09T01:49:17.427ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
43992025-01-09T01:49:17.427ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = e1ee9e8e-38d0-44a5-8303-e06f16612b1a
44002025-01-09T01:49:17.427ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44012025-01-09T01:49:17.427ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44022025-01-09T01:49:17.427ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44032025-01-09T01:49:17.427ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44042025-01-09T01:49:17.427ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44052025-01-09T01:49:17.427ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44062025-01-09T01:49:17.428ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44072025-01-09T01:49:17.428ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44082025-01-09T01:49:17.428ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f
44092025-01-09T01:49:17.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44102025-01-09T01:49:17.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44112025-01-09T01:49:17.430ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44122025-01-09T01:49:17.431ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "63118601-26fe-4671-ba21-4d2777e14d08", "content-length": "2", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
44132025-01-09T01:49:17.431ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44142025-01-09T01:49:17.431ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "84ed2e44-ba1e-4aa1-a7e4-3e468012f468", "content-length": "52", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
44152025-01-09T01:49:17.431ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch_location = Switch0
44162025-01-09T01:49:17.431ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44172025-01-09T01:49:17.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "54fd71d7-0b33-40fa-833d-9a015d1c4bd7", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
44182025-01-09T01:49:17.535ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f switch = Switch0
44192025-01-09T01:49:17.535ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44202025-01-09T01:49:17.535ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 59b29299-38cc-4366-91a5-ce2131096a5f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "821ae464-c5d2-4a1f-9275-91513c0741b3", "content-length": "682", "date": "Thu, 09 Jan 2025 01:49:17 GMT"} })
44212025-01-09T01:49:17.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44222025-01-09T01:49:17.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44232025-01-09T01:49:17.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44242025-01-09T01:49:17.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44252025-01-09T01:49:17.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44262025-01-09T01:49:17.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44272025-01-09T01:49:17.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44282025-01-09T01:49:17.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44292025-01-09T01:49:17.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b21745e-fd42-45ce-bd8d-39d887dad9d5 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44302025-01-09T01:49:17.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b21745e-fd42-45ce-bd8d-39d887dad9d5 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44312025-01-09T01:49:17.557ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 502.87947ms iteration = 32 status = {}
44322025-01-09T01:49:17.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3b21745e-fd42-45ce-bd8d-39d887dad9d5 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44332025-01-09T01:49:18.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 335a8455-91ee-4110-b8b1-88b1f2afcb55 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44342025-01-09T01:49:18.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 335a8455-91ee-4110-b8b1-88b1f2afcb55 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44352025-01-09T01:49:18.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 335a8455-91ee-4110-b8b1-88b1f2afcb55 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44362025-01-09T01:49:19.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9262a283-3cb6-4605-838c-fcc6a190f317 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44372025-01-09T01:49:19.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9262a283-3cb6-4605-838c-fcc6a190f317 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44382025-01-09T01:49:19.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 9262a283-3cb6-4605-838c-fcc6a190f317 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44392025-01-09T01:49:19.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 553 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 64505b18-5754-475f-a430-53f820cbaeb4 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
44402025-01-09T01:49:20.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 624e836f-4be9-48af-8fbe-422353b352da roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44412025-01-09T01:49:20.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 624e836f-4be9-48af-8fbe-422353b352da resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44422025-01-09T01:49:20.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 624e836f-4be9-48af-8fbe-422353b352da response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44432025-01-09T01:49:21.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 48ff4ef4-ec5e-4f81-9d8e-e15f7b682e29 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44442025-01-09T01:49:21.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 48ff4ef4-ec5e-4f81-9d8e-e15f7b682e29 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44452025-01-09T01:49:21.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 48ff4ef4-ec5e-4f81-9d8e-e15f7b682e29 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44462025-01-09T01:49:22.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0e2466b-72da-45b0-b918-891646343b4e roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44472025-01-09T01:49:22.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0e2466b-72da-45b0-b918-891646343b4e resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44482025-01-09T01:49:22.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f0e2466b-72da-45b0-b918-891646343b4e response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44492025-01-09T01:49:23.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea30f842-8a7d-4312-8390-ece6dd0635b7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44502025-01-09T01:49:23.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea30f842-8a7d-4312-8390-ece6dd0635b7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44512025-01-09T01:49:23.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ea30f842-8a7d-4312-8390-ece6dd0635b7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44522025-01-09T01:49:24.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5025ef95-55a2-41d2-b5bf-a7fc726520ea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/11?limit=100
44532025-01-09T01:49:24.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5025ef95-55a2-41d2-b5bf-a7fc726520ea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/11?limit=100
44542025-01-09T01:49:24.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:50896 req_id = 5025ef95-55a2-41d2-b5bf-a7fc726520ea response_code = 200 uri = /nat/ipv4/changeset/11?limit=100
44552025-01-09T01:49:24.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 74c52b93-8525-4956-8990-9da18a0ec9f7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44562025-01-09T01:49:24.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 74c52b93-8525-4956-8990-9da18a0ec9f7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44572025-01-09T01:49:24.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 74c52b93-8525-4956-8990-9da18a0ec9f7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44582025-01-09T01:49:25.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4fe2400f-c6b7-471c-9778-e808523e51d9 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44592025-01-09T01:49:25.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4fe2400f-c6b7-471c-9778-e808523e51d9 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44602025-01-09T01:49:25.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4fe2400f-c6b7-471c-9778-e808523e51d9 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44612025-01-09T01:49:26.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81e27ed1-b9bc-460b-8b5c-798975348b96 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44622025-01-09T01:49:26.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81e27ed1-b9bc-460b-8b5c-798975348b96 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44632025-01-09T01:49:26.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 81e27ed1-b9bc-460b-8b5c-798975348b96 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44642025-01-09T01:49:27.054ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 95 reason = Timeout
44652025-01-09T01:49:27.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44662025-01-09T01:49:27.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44672025-01-09T01:49:27.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 95 reason = Timeout
44682025-01-09T01:49:27.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44692025-01-09T01:49:27.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44702025-01-09T01:49:27.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44712025-01-09T01:49:27.057ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44722025-01-09T01:49:27.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44732025-01-09T01:49:27.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.526372ms iteration = 95 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44742025-01-09T01:49:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44752025-01-09T01:49:27.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44762025-01-09T01:49:27.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44772025-01-09T01:49:27.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44782025-01-09T01:49:27.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44792025-01-09T01:49:27.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44802025-01-09T01:49:27.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
44812025-01-09T01:49:27.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44822025-01-09T01:49:27.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44832025-01-09T01:49:27.077ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
44842025-01-09T01:49:27.077ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.120412ms iteration = 95 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
44852025-01-09T01:49:27.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4761fc55-b508-4185-ac6c-9c3ae3340d59 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44862025-01-09T01:49:27.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4761fc55-b508-4185-ac6c-9c3ae3340d59 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44872025-01-09T01:49:27.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 4761fc55-b508-4185-ac6c-9c3ae3340d59 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44882025-01-09T01:49:28.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 350b95c4-3fb3-4be5-bad8-ca8c32a7dd46 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44892025-01-09T01:49:28.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 350b95c4-3fb3-4be5-bad8-ca8c32a7dd46 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44902025-01-09T01:49:28.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 350b95c4-3fb3-4be5-bad8-ca8c32a7dd46 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44912025-01-09T01:49:29.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 631 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 356af629-3f89-47ad-9686-733df9922e9a response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
44922025-01-09T01:49:29.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5eeffab-1699-4524-80c3-c609a92c6376 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44932025-01-09T01:49:29.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5eeffab-1699-4524-80c3-c609a92c6376 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44942025-01-09T01:49:29.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c5eeffab-1699-4524-80c3-c609a92c6376 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44952025-01-09T01:49:30.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 54b2e31a-b037-4dbc-9674-ee1b20d8a237 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44962025-01-09T01:49:30.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 54b2e31a-b037-4dbc-9674-ee1b20d8a237 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44972025-01-09T01:49:30.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 54b2e31a-b037-4dbc-9674-ee1b20d8a237 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44982025-01-09T01:49:31.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6a7cab8f-135f-46a6-9474-a6d513c21be1 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
44992025-01-09T01:49:31.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6a7cab8f-135f-46a6-9474-a6d513c21be1 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45002025-01-09T01:49:31.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 6a7cab8f-135f-46a6-9474-a6d513c21be1 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45012025-01-09T01:49:32.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1be587b4-a575-43a4-8c02-b137b4b6466d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45022025-01-09T01:49:32.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1be587b4-a575-43a4-8c02-b137b4b6466d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45032025-01-09T01:49:32.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 1be587b4-a575-43a4-8c02-b137b4b6466d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45042025-01-09T01:49:33.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 545b3f82-1620-4185-9a56-00e0c2928a7c roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45052025-01-09T01:49:33.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 545b3f82-1620-4185-9a56-00e0c2928a7c resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45062025-01-09T01:49:33.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 545b3f82-1620-4185-9a56-00e0c2928a7c response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45072025-01-09T01:49:34.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 52377d5b-4291-4ef7-80bc-513168e66bd0 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45082025-01-09T01:49:34.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 52377d5b-4291-4ef7-80bc-513168e66bd0 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45092025-01-09T01:49:34.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 52377d5b-4291-4ef7-80bc-513168e66bd0 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45102025-01-09T01:49:35.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3ef7aae-89fa-44b9-9a2b-ba5390305891 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45112025-01-09T01:49:35.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3ef7aae-89fa-44b9-9a2b-ba5390305891 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45122025-01-09T01:49:35.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = c3ef7aae-89fa-44b9-9a2b-ba5390305891 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45132025-01-09T01:49:36.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc859956-b5ea-4f24-9934-44a4cc2129dd roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45142025-01-09T01:49:36.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc859956-b5ea-4f24-9934-44a4cc2129dd resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45152025-01-09T01:49:36.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = dc859956-b5ea-4f24-9934-44a4cc2129dd response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45162025-01-09T01:49:37.054ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 96 reason = Timeout
45172025-01-09T01:49:37.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45182025-01-09T01:49:37.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45192025-01-09T01:49:37.054ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 96 reason = Timeout
45202025-01-09T01:49:37.054ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45212025-01-09T01:49:37.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45222025-01-09T01:49:37.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232025-01-09T01:49:37.057ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45242025-01-09T01:49:37.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45252025-01-09T01:49:37.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45262025-01-09T01:49:37.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45272025-01-09T01:49:37.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45282025-01-09T01:49:37.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.115876ms iteration = 96 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45292025-01-09T01:49:37.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45302025-01-09T01:49:37.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45312025-01-09T01:49:37.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322025-01-09T01:49:37.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 955da9d5-c8b1-467a-bada-b813ca146aad, lookup_type: ById(955da9d5-c8b1-467a-bada-b813ca146aad) } result = Ok(())
45332025-01-09T01:49:37.065ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45342025-01-09T01:49:37.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45352025-01-09T01:49:37.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 955da9d5-c8b1-467a-bada-b813ca146aad original_time_created = 2025-01-09 01:33:39.442017 UTC target_id = 955da9d5-c8b1-467a-bada-b813ca146aad time_created = 2025-01-09 01:33:39.442017 UTC
45362025-01-09T01:49:37.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.695436ms iteration = 96 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"955da9d5-c8b1-467a-bada-b813ca146aad","time_created":"2025-01-09T01:33:39.442017Z"}
45372025-01-09T01:49:37.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab5ef795-f815-4e6b-8ded-92081e2718d7 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45382025-01-09T01:49:37.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab5ef795-f815-4e6b-8ded-92081e2718d7 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45392025-01-09T01:49:37.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = ab5ef795-f815-4e6b-8ded-92081e2718d7 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45402025-01-09T01:49:39.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 63488bab-f5f1-4afa-9c90-40cd00c9f214 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45412025-01-09T01:49:39.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 63488bab-f5f1-4afa-9c90-40cd00c9f214 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45422025-01-09T01:49:39.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 63488bab-f5f1-4afa-9c90-40cd00c9f214 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45432025-01-09T01:49:39.745ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:55235 method = GET remote_addr = [fd00:1122:3344:101::d]:51062 req_id = 00ec9960-5029-45eb-935b-b485a9178220 response_code = 200 uri = /74d09270-c94b-4c18-b2b3-d5f83a0dc096
45442025-01-09T01:49:40.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a864a32b-8ec8-4c17-8a66-437afa706750 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45452025-01-09T01:49:40.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a864a32b-8ec8-4c17-8a66-437afa706750 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45462025-01-09T01:49:40.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a864a32b-8ec8-4c17-8a66-437afa706750 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45472025-01-09T01:49:41.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a4a51431-887a-4c90-b3fc-b76f90a59041 roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45482025-01-09T01:49:41.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a4a51431-887a-4c90-b3fc-b76f90a59041 resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45492025-01-09T01:49:41.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = a4a51431-887a-4c90-b3fc-b76f90a59041 response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45502025-01-09T01:49:42.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ca30a33-108f-4fb1-8585-10de4d68848d roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45512025-01-09T01:49:42.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ca30a33-108f-4fb1-8585-10de4d68848d resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45522025-01-09T01:49:42.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = 3ca30a33-108f-4fb1-8585-10de4d68848d response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45532025-01-09T01:49:43.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f760221b-d070-4e75-b982-4ff4f8465b4f roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45542025-01-09T01:49:43.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f760221b-d070-4e75-b982-4ff4f8465b4f resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45552025-01-09T01:49:43.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f760221b-d070-4e75-b982-4ff4f8465b4f response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45562025-01-09T01:49:44.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f66db241-f08a-4c9f-94ec-d6a3d345c26a roles = RoleSet { roles: {} } uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45572025-01-09T01:49:44.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f66db241-f08a-4c9f-94ec-d6a3d345c26a resource = Database result = Ok(()) uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45582025-01-09T01:49:44.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:45475 req_id = f66db241-f08a-4c9f-94ec-d6a3d345c26a response_code = 200 uri = /probes/2a5ec8ce-31e5-4982-a156-7cc817b136d7
45592025-01-09T01:49:44.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4989b56b-a8f1-4c08-ad9b-63c3a0eb6e55 roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
45602025-01-09T01:49:44.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4989b56b-a8f1-4c08-ad9b-63c3a0eb6e55 resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
45612025-01-09T01:49:44.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4989b56b-a8f1-4c08-ad9b-63c3a0eb6e55 response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?sort_by=id_ascending
45622025-01-09T01:49:44.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4faba0bd-2b02-4fa7-82d2-22bf840ce47a roles = RoleSet { roles: {} } uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
45632025-01-09T01:49:44.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4faba0bd-2b02-4fa7-82d2-22bf840ce47a resource = Database result = Ok(()) uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D
45642025-01-09T01:49:44.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45875 req_id = 4faba0bd-2b02-4fa7-82d2-22bf840ce47a response_code = 200 uri = /metrics/collectors/ba5ebd3e-b5e4-46af-a4f1-d5a3e28b622a/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYzM4ZGQ0Mi1mM2QwLTQ5NTAtOTlkZi01YTFiYTU4MDc3MWEifX0%3D