Max level shown:
12024-10-16T20:00:03.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d1e3dc10-0785-42b8-91e3-f655d958cf9a roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22024-10-16T20:00:03.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d1e3dc10-0785-42b8-91e3-f655d958cf9a resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
32024-10-16T20:00:03.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d1e3dc10-0785-42b8-91e3-f655d958cf9a response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
42024-10-16T20:00:03.941ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
52024-10-16T20:00:03.941ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62024-10-16T20:00:03.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72024-10-16T20:00:03.942ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
82024-10-16T20:00:03.942ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92024-10-16T20:00:03.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102024-10-16T20:00:03.943ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112024-10-16T20:00:03.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122024-10-16T20:00:03.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132024-10-16T20:00:03.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.824978ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142024-10-16T20:00:03.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
152024-10-16T20:00:03.971ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
162024-10-16T20:00:03.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
172024-10-16T20:00:03.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
182024-10-16T20:00:03.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
192024-10-16T20:00:03.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
202024-10-16T20:00:03.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
212024-10-16T20:00:03.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-10-16T20:00:03.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232024-10-16T20:00:03.987ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
242024-10-16T20:00:03.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.961735ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
252024-10-16T20:00:04.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 498f8cf7-0115-49f8-aa01-681c138f86b3 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
262024-10-16T20:00:04.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 498f8cf7-0115-49f8-aa01-681c138f86b3 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
272024-10-16T20:00:04.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 498f8cf7-0115-49f8-aa01-681c138f86b3 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
282024-10-16T20:00:05.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6ceacffc-6525-4163-a657-523b84e90c28 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
292024-10-16T20:00:05.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6ceacffc-6525-4163-a657-523b84e90c28 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
302024-10-16T20:00:05.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6ceacffc-6525-4163-a657-523b84e90c28 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
312024-10-16T20:00:06.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1361 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 49982576-3695-4010-90b3-b7a1246a485e response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
322024-10-16T20:00:06.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e73b0459-d368-4eda-bfbe-356a73bcaffb roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
332024-10-16T20:00:06.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e73b0459-d368-4eda-bfbe-356a73bcaffb resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
342024-10-16T20:00:06.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e73b0459-d368-4eda-bfbe-356a73bcaffb response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
352024-10-16T20:00:07.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b4e34da4-08a8-4c36-8c10-173e94be0e45 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
362024-10-16T20:00:07.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b4e34da4-08a8-4c36-8c10-173e94be0e45 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
372024-10-16T20:00:07.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b4e34da4-08a8-4c36-8c10-173e94be0e45 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
382024-10-16T20:00:08.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1623038f-e8b1-4949-a52b-342ec36f229d roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
392024-10-16T20:00:08.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1623038f-e8b1-4949-a52b-342ec36f229d resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
402024-10-16T20:00:08.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1623038f-e8b1-4949-a52b-342ec36f229d response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
412024-10-16T20:00:09.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0d902152-d525-48f3-acaa-a0afb3b0bdd9 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
422024-10-16T20:00:09.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0d902152-d525-48f3-acaa-a0afb3b0bdd9 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
432024-10-16T20:00:09.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0d902152-d525-48f3-acaa-a0afb3b0bdd9 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
442024-10-16T20:00:10.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = aa4f49b7-5c55-4940-afec-04347327ac23 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
452024-10-16T20:00:10.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = aa4f49b7-5c55-4940-afec-04347327ac23 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
462024-10-16T20:00:10.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = aa4f49b7-5c55-4940-afec-04347327ac23 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
472024-10-16T20:00:11.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 42ccb5d4-9d76-4446-a01f-ec28b28cc168 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
482024-10-16T20:00:11.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 42ccb5d4-9d76-4446-a01f-ec28b28cc168 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
492024-10-16T20:00:11.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 42ccb5d4-9d76-4446-a01f-ec28b28cc168 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
502024-10-16T20:00:12.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 83f31f48-a4c7-450e-b248-08be24f85d41 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
512024-10-16T20:00:12.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 83f31f48-a4c7-450e-b248-08be24f85d41 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
522024-10-16T20:00:12.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 83f31f48-a4c7-450e-b248-08be24f85d41 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
532024-10-16T20:00:12.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 4ea9d98b-a70f-4053-8a24-425775d8f6bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
542024-10-16T20:00:12.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 4ea9d98b-a70f-4053-8a24-425775d8f6bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
552024-10-16T20:00:12.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2741 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 4ea9d98b-a70f-4053-8a24-425775d8f6bf response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
562024-10-16T20:00:12.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5d9d48b8-0752-4659-896c-fcfd623f367c roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
572024-10-16T20:00:12.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5d9d48b8-0752-4659-896c-fcfd623f367c resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
582024-10-16T20:00:12.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5d9d48b8-0752-4659-896c-fcfd623f367c response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
592024-10-16T20:00:13.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5385cdcf-1176-43e6-ac0f-1a17c2e522a9 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
602024-10-16T20:00:13.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5385cdcf-1176-43e6-ac0f-1a17c2e522a9 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
612024-10-16T20:00:13.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5385cdcf-1176-43e6-ac0f-1a17c2e522a9 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
622024-10-16T20:00:13.868ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
632024-10-16T20:00:13.869ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
642024-10-16T20:00:13.869ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
652024-10-16T20:00:13.869ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
662024-10-16T20:00:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
672024-10-16T20:00:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
682024-10-16T20:00:13.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4759, tv_nsec: 866000982 } })
692024-10-16T20:00:13.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1066
702024-10-16T20:00:13.872ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4759, tv_nsec: 866988334 } })
712024-10-16T20:00:13.873ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1066
722024-10-16T20:00:14.004ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
732024-10-16T20:00:14.004ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
742024-10-16T20:00:14.005ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
752024-10-16T20:00:14.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.58\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
762024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
772024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
782024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
792024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
802024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
812024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
822024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
832024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
842024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
852024-10-16T20:00:14.006ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
862024-10-16T20:00:14.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.26\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
872024-10-16T20:00:14.007ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
882024-10-16T20:00:14.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.03\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
892024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
902024-10-16T20:00:14.008ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
912024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
922024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
932024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
942024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
952024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
962024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 17.26\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
972024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
982024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
992024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1002024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
1012024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1022024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1032024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
1042024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
1052024-10-16T20:00:14.008ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b825c3e7-8aed-443f-bd3b-e4f72e44222d", "content-length": "26", "date": "Wed, 16 Oct 2024 20:00:13 GMT"} })
1062024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1072024-10-16T20:00:14.008ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1082024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1092024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1102024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1112024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1122024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1132024-10-16T20:00:14.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1142024-10-16T20:00:14.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1152024-10-16T20:00:14.009ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1162024-10-16T20:00:14.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1172024-10-16T20:00:14.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1182024-10-16T20:00:14.013ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
1192024-10-16T20:00:14.014ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1202024-10-16T20:00:14.017ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10a7cb2b-8ed0-469e-90a9-97967b905f55", "content-length": "26", "date": "Wed, 16 Oct 2024 20:00:13 GMT"} })
1212024-10-16T20:00:14.017ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1222024-10-16T20:00:14.019ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.852921ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1232024-10-16T20:00:14.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1242024-10-16T20:00:14.021ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1252024-10-16T20:00:14.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1262024-10-16T20:00:14.023ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1272024-10-16T20:00:14.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1282024-10-16T20:00:14.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1292024-10-16T20:00:14.031ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1302024-10-16T20:00:14.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1312024-10-16T20:00:14.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1322024-10-16T20:00:14.038ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1332024-10-16T20:00:14.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1342024-10-16T20:00:14.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 45.910714ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1352024-10-16T20:00:14.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1362024-10-16T20:00:14.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1372024-10-16T20:00:14.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1382024-10-16T20:00:14.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1392024-10-16T20:00:14.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1402024-10-16T20:00:14.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1412024-10-16T20:00:14.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1422024-10-16T20:00:14.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1432024-10-16T20:00:14.080ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.344268ms iteration = 10 status = {}
1442024-10-16T20:00:14.084ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4760, tv_nsec: 78476005 } })
1452024-10-16T20:00:14.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1462024-10-16T20:00:14.085ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1066 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
1472024-10-16T20:00:14.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1482024-10-16T20:00:14.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1492024-10-16T20:00:14.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1502024-10-16T20:00:14.088ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1512024-10-16T20:00:14.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1522024-10-16T20:00:14.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1532024-10-16T20:00:14.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1542024-10-16T20:00:14.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1552024-10-16T20:00:14.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1562024-10-16T20:00:14.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1572024-10-16T20:00:14.094ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1582024-10-16T20:00:14.094ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1592024-10-16T20:00:14.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1602024-10-16T20:00:14.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1612024-10-16T20:00:14.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1622024-10-16T20:00:14.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1632024-10-16T20:00:14.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1642024-10-16T20:00:14.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1652024-10-16T20:00:14.108ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1662024-10-16T20:00:14.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1672024-10-16T20:00:14.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1682024-10-16T20:00:14.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1692024-10-16T20:00:14.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1702024-10-16T20:00:14.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1712024-10-16T20:00:14.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1722024-10-16T20:00:14.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1732024-10-16T20:00:14.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
1742024-10-16T20:00:14.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1752024-10-16T20:00:14.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1762024-10-16T20:00:14.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1772024-10-16T20:00:14.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1782024-10-16T20:00:14.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1792024-10-16T20:00:14.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1802024-10-16T20:00:14.136ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812024-10-16T20:00:14.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 132.068699ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1822024-10-16T20:00:14.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1832024-10-16T20:00:14.139ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1842024-10-16T20:00:14.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1852024-10-16T20:00:14.141ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
1862024-10-16T20:00:14.141ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.394132ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
1872024-10-16T20:00:14.163ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
1882024-10-16T20:00:14.165ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad8fcaa1-c7b2-4db8-93ea-9b4d98a588be", "content-length": "1", "date": "Wed, 16 Oct 2024 20:00:13 GMT"} })
1892024-10-16T20:00:14.166ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1902024-10-16T20:00:14.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1912024-10-16T20:00:14.169ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1922024-10-16T20:00:14.169ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1932024-10-16T20:00:14.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1942024-10-16T20:00:14.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1952024-10-16T20:00:14.176ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 307.694498ms iteration = 10 status = null
1962024-10-16T20:00:14.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1972024-10-16T20:00:14.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8219fdd9-0a75-42c9-91db-deb66a850e5b, lookup_type: ById(8219fdd9-0a75-42c9-91db-deb66a850e5b) } result = Ok(())
1982024-10-16T20:00:14.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1992024-10-16T20:00:14.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2002024-10-16T20:00:14.191ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1074 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 zone_address = fd00:1122:3344:101::2
2012024-10-16T20:00:14.191ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2022024-10-16T20:00:14.193ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4490791-7a0b-43e0-9c0c-0d280cf7be0d", "content-length": "26", "date": "Wed, 16 Oct 2024 20:00:13 GMT"} })
2032024-10-16T20:00:14.193ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1079 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2042024-10-16T20:00:14.200ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 193.065619ms iteration = 10 status = 0
2052024-10-16T20:00:14.202ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
2062024-10-16T20:00:14.236ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2072024-10-16T20:00:14.236ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2082024-10-16T20:00:14.236ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 229.670878ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2092024-10-16T20:00:14.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2102024-10-16T20:00:14.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2112024-10-16T20:00:14.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2122024-10-16T20:00:14.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2132024-10-16T20:00:14.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2142024-10-16T20:00:14.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2152024-10-16T20:00:14.274ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 267.543977ms iteration = 13 status = {"physical_disks_added":0}
2162024-10-16T20:00:14.341ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913/state
2172024-10-16T20:00:14.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2182024-10-16T20:00:14.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2192024-10-16T20:00:14.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2202024-10-16T20:00:14.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2212024-10-16T20:00:14.365ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2222024-10-16T20:00:14.365ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2232024-10-16T20:00:14.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2242024-10-16T20:00:14.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2252024-10-16T20:00:14.406ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66211944-054d-446c-afc3-b1a33ad80dff, rack_id: dbc07659-6078-4fa6-9892-1d25efe44b81, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c33f3d0a-20b1-42d9-bb7b-a442a73c3582) } rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
2262024-10-16T20:00:14.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2272024-10-16T20:00:14.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2282024-10-16T20:00:14.413ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a0a48e3-d4c6-455d-a404-3c456c6306df", "content-length": "525", "date": "Wed, 16 Oct 2024 20:00:14 GMT"} })
2292024-10-16T20:00:14.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2302024-10-16T20:00:14.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2312024-10-16T20:00:14.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2322024-10-16T20:00:14.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ffbc15d-66bb-4988-b0f6-e07fe89e5d1c", "content-length": "121", "date": "Wed, 16 Oct 2024 20:00:13 GMT"} })
2332024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
2342024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c33f3d0a-20b1-42d9-bb7b-a442a73c3582
2352024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2362024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2372024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2382024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2392024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2402024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2412024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2422024-10-16T20:00:14.417ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2432024-10-16T20:00:14.418ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
2442024-10-16T20:00:14.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2452024-10-16T20:00:14.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2462024-10-16T20:00:14.420ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2472024-10-16T20:00:14.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "56df75c1-fce7-4581-9ef8-7156d26a2b59", "content-length": "2", "date": "Wed, 16 Oct 2024 20:00:13 GMT"} })
2482024-10-16T20:00:14.420ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2492024-10-16T20:00:14.420ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9988ddcb-48d7-4c56-b771-97f6a0f5aea8", "content-length": "52", "date": "Wed, 16 Oct 2024 20:00:13 GMT"} })
2502024-10-16T20:00:14.420ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
2512024-10-16T20:00:14.421ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2522024-10-16T20:00:14.454ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2532024-10-16T20:00:14.462ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {367a7cb6-ef5d-4e42-a066-60614409ad53: {10.151.2.176: {ad4ddc3d-fd37-4ee6-aa29-77039caa79b8}, 10.151.2.175: {ad4ddc3d-fd37-4ee6-aa29-77039caa79b8}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2542024-10-16T20:00:14.462ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2552024-10-16T20:00:14.508ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1cb91047-9622-4101-bb55-146d98d16383", "date": "Wed, 16 Oct 2024 20:00:14 GMT"} })
2562024-10-16T20:00:14.509ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch = Switch0
2572024-10-16T20:00:14.509ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
2582024-10-16T20:00:14.509ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c99fd4bb-8abe-443b-b926-ddd30d2d693f", "date": "Wed, 16 Oct 2024 20:00:14 GMT"} })
2592024-10-16T20:00:14.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2602024-10-16T20:00:14.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2612024-10-16T20:00:14.509ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0bb9591-bcda-4ca3-aae8-c7bac5a24391", "content-length": "669", "date": "Wed, 16 Oct 2024 20:00:14 GMT"} })
2622024-10-16T20:00:14.509ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea177861-d24d-40b5-a6be-8bb2e7cef9ed", "content-length": "811", "date": "Wed, 16 Oct 2024 20:00:14 GMT"} })
2632024-10-16T20:00:14.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2642024-10-16T20:00:14.509ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14283386) }} sled = sock
2652024-10-16T20:00:14.509ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2662024-10-16T20:00:14.509ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2672024-10-16T20:00:14.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2682024-10-16T20:00:14.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2692024-10-16T20:00:14.511ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 504.641615ms iteration = 10 status = {}
2702024-10-16T20:00:14.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2712024-10-16T20:00:14.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2722024-10-16T20:00:14.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2732024-10-16T20:00:14.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2742024-10-16T20:00:14.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2752024-10-16T20:00:14.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2762024-10-16T20:00:14.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2772024-10-16T20:00:14.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2782024-10-16T20:00:14.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2792024-10-16T20:00:14.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2802024-10-16T20:00:14.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2812024-10-16T20:00:14.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2822024-10-16T20:00:14.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2832024-10-16T20:00:14.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2842024-10-16T20:00:14.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2852024-10-16T20:00:14.525ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 519.267581ms iteration = 10 status = {}
2862024-10-16T20:00:14.525ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2872024-10-16T20:00:14.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2882024-10-16T20:00:14.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2892024-10-16T20:00:14.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2902024-10-16T20:00:14.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2912024-10-16T20:00:14.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2922024-10-16T20:00:14.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2932024-10-16T20:00:14.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2942024-10-16T20:00:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2952024-10-16T20:00:14.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2962024-10-16T20:00:14.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2972024-10-16T20:00:14.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2982024-10-16T20:00:14.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2992024-10-16T20:00:14.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3002024-10-16T20:00:14.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3012024-10-16T20:00:14.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3022024-10-16T20:00:14.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, lookup_type: ById(fcb878a2-735b-4f01-9b6b-44a1f7c3291d) }, key: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, lookup_type: ById(e9f305bd-a42d-4d83-bc23-693c3bdddaf1) }, key: 911ef94b-134b-4348-ae8c-b5b74e33bddd, lookup_type: ById(911ef94b-134b-4348-ae8c-b5b74e33bddd) }, key: 4bcef9b8-776c-4019-90d2-10a2467616ee, lookup_type: ById(4bcef9b8-776c-4019-90d2-10a2467616ee) } result = Ok(())
3032024-10-16T20:00:14.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3042024-10-16T20:00:14.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3052024-10-16T20:00:14.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3062024-10-16T20:00:14.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3072024-10-16T20:00:14.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3082024-10-16T20:00:14.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3092024-10-16T20:00:14.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3102024-10-16T20:00:14.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, lookup_type: ById(fcb878a2-735b-4f01-9b6b-44a1f7c3291d) }, key: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, lookup_type: ById(e9f305bd-a42d-4d83-bc23-693c3bdddaf1) }, key: 911ef94b-134b-4348-ae8c-b5b74e33bddd, lookup_type: ById(911ef94b-134b-4348-ae8c-b5b74e33bddd) }, key: 4bcef9b8-776c-4019-90d2-10a2467616ee, lookup_type: ById(4bcef9b8-776c-4019-90d2-10a2467616ee) } result = Ok(())
3112024-10-16T20:00:14.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3122024-10-16T20:00:14.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3132024-10-16T20:00:14.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3142024-10-16T20:00:14.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3152024-10-16T20:00:14.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3162024-10-16T20:00:14.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3172024-10-16T20:00:14.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3182024-10-16T20:00:14.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3192024-10-16T20:00:14.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3202024-10-16T20:00:14.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3212024-10-16T20:00:14.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3222024-10-16T20:00:14.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3232024-10-16T20:00:14.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3242024-10-16T20:00:14.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3252024-10-16T20:00:14.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3262024-10-16T20:00:14.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3272024-10-16T20:00:14.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3282024-10-16T20:00:14.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, lookup_type: ById(fcb878a2-735b-4f01-9b6b-44a1f7c3291d) }, key: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, lookup_type: ById(e9f305bd-a42d-4d83-bc23-693c3bdddaf1) }, key: 911ef94b-134b-4348-ae8c-b5b74e33bddd, lookup_type: ById(911ef94b-134b-4348-ae8c-b5b74e33bddd) }, key: f2bf56ba-9979-4c25-bebd-4156b377243f, lookup_type: ByName("default") } result = Ok(())
3292024-10-16T20:00:14.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3302024-10-16T20:00:14.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3312024-10-16T20:00:14.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ab04d17e-5286-4927-8b66-594e268f24cc roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3322024-10-16T20:00:14.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3332024-10-16T20:00:14.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ab04d17e-5286-4927-8b66-594e268f24cc resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3342024-10-16T20:00:14.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3352024-10-16T20:00:14.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3362024-10-16T20:00:14.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ab04d17e-5286-4927-8b66-594e268f24cc response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3372024-10-16T20:00:14.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3382024-10-16T20:00:14.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3392024-10-16T20:00:14.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3402024-10-16T20:00:14.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3412024-10-16T20:00:14.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3422024-10-16T20:00:14.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3432024-10-16T20:00:14.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3442024-10-16T20:00:14.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3452024-10-16T20:00:14.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3462024-10-16T20:00:14.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3472024-10-16T20:00:14.723ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, lookup_type: ById(fcb878a2-735b-4f01-9b6b-44a1f7c3291d) }, key: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, lookup_type: ById(e9f305bd-a42d-4d83-bc23-693c3bdddaf1) }, key: 911ef94b-134b-4348-ae8c-b5b74e33bddd, lookup_type: ById(911ef94b-134b-4348-ae8c-b5b74e33bddd) }, key: ad4ddc3d-fd37-4ee6-aa29-77039caa79b8, lookup_type: ByName("default") } result = Ok(())
3482024-10-16T20:00:14.723ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3492024-10-16T20:00:14.726ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "01659096-c898-4116-b681-241dca019ef8", "date": "Wed, 16 Oct 2024 20:00:14 GMT"} })
3502024-10-16T20:00:14.728ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 721.644672ms iteration = 11 status = {}
3512024-10-16T20:00:15.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 451997f4-1c16-435b-9487-09bdc6335835 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3522024-10-16T20:00:15.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 451997f4-1c16-435b-9487-09bdc6335835 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3532024-10-16T20:00:15.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 451997f4-1c16-435b-9487-09bdc6335835 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3542024-10-16T20:00:16.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = c1bd82bc-2cc6-4c99-8934-f51b845444af response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
3552024-10-16T20:00:16.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0e0d9fff-88ce-493b-9ad3-e1e74fdf802c roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3562024-10-16T20:00:16.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0e0d9fff-88ce-493b-9ad3-e1e74fdf802c resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3572024-10-16T20:00:16.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0e0d9fff-88ce-493b-9ad3-e1e74fdf802c response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3582024-10-16T20:00:17.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a786774d-0c44-48fe-800b-3912542bf71c roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3592024-10-16T20:00:17.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a786774d-0c44-48fe-800b-3912542bf71c resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3602024-10-16T20:00:17.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a786774d-0c44-48fe-800b-3912542bf71c response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3612024-10-16T20:00:18.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 09f7b2da-90e5-4598-af26-de22c0161587 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3622024-10-16T20:00:18.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 09f7b2da-90e5-4598-af26-de22c0161587 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3632024-10-16T20:00:18.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 09f7b2da-90e5-4598-af26-de22c0161587 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3642024-10-16T20:00:19.795ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4e67518-f6ca-40e1-88eb-7f3cbef06faf", "content-length": "131", "date": "Wed, 16 Oct 2024 20:00:19 GMT"} })
3652024-10-16T20:00:19.795ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 sled_id = 8219fdd9-0a75-42c9-91db-deb66a850e5b state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-16T20:00:12.413364210Z }, migration_in: None, migration_out: None } vmm_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3662024-10-16T20:00:19.795ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 sled_id = 8219fdd9-0a75-42c9-91db-deb66a850e5b vmm_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-16T20:00:12.413364210Z }
3672024-10-16T20:00:19.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 roles = RoleSet { roles: {} } sled_id = 8219fdd9-0a75-42c9-91db-deb66a850e5b vmm_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3682024-10-16T20:00:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 resource = Database result = Ok(()) sled_id = 8219fdd9-0a75-42c9-91db-deb66a850e5b vmm_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3692024-10-16T20:00:19.800ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 415380b0-17f2-4715-9bd6-93d86d2a93f0 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-10-16T20:00:19.795347661Z }
3702024-10-16T20:00:19.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 415380b0-17f2-4715-9bd6-93d86d2a93f0 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3712024-10-16T20:00:19.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 415380b0-17f2-4715-9bd6-93d86d2a93f0 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3722024-10-16T20:00:19.831ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:61672
3732024-10-16T20:00:19.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:61672 req_id = 912a14cb-1c1e-476c-9c27-05e316f28330 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3742024-10-16T20:00:19.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:61672 req_id = 912a14cb-1c1e-476c-9c27-05e316f28330 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3752024-10-16T20:00:19.833ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:48339
3762024-10-16T20:00:19.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:61672 req_id = 912a14cb-1c1e-476c-9c27-05e316f28330 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3772024-10-16T20:00:19.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48339 req_id = 7d37f06f-c8e5-454e-afc2-2c67034c21bd roles = RoleSet { roles: {} } uri = /metrics/producers
3782024-10-16T20:00:19.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48339 req_id = 7d37f06f-c8e5-454e-afc2-2c67034c21bd resource = Database result = Ok(()) uri = /metrics/producers
3792024-10-16T20:00:19.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57228 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 415380b0-17f2-4715-9bd6-93d86d2a93f0 response_code = 204 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3802024-10-16T20:00:19.853ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 54fdc4f3-beac-4c25-b1f8-0c7596570d16 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-16T20:00:19.853203728Z }
3812024-10-16T20:00:19.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 54fdc4f3-beac-4c25-b1f8-0c7596570d16 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3822024-10-16T20:00:19.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 54fdc4f3-beac-4c25-b1f8-0c7596570d16 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3832024-10-16T20:00:19.855ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
3842024-10-16T20:00:19.857ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 5.850797509s iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
3852024-10-16T20:00:19.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10795 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 54fdc4f3-beac-4c25-b1f8-0c7596570d16 response_code = 204 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
3862024-10-16T20:00:19.903ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = f3710494-36b7-4736-839b-65e01f5ecb38
3872024-10-16T20:00:19.903ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 uri = http://[fd00:1122:3344:101::d]:12223/producers
3882024-10-16T20:00:19.904ZDEBGnexus: client response oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "801a82c8-c77b-46ed-8088-07cc823bf433", "date": "Wed, 16 Oct 2024 20:00:19 GMT"} })
3892024-10-16T20:00:19.904ZINFOnexus: assigned collector to new producer collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 file = nexus/src/app/oximeter.rs:133 producer_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2
3902024-10-16T20:00:19.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71618 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:48339 req_id = 7d37f06f-c8e5-454e-afc2-2c67034c21bd response_code = 201 uri = /metrics/producers
3912024-10-16T20:00:20.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5f866872-df77-425e-a7a0-cd5267ab43c6 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3922024-10-16T20:00:20.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5f866872-df77-425e-a7a0-cd5267ab43c6 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3932024-10-16T20:00:20.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5f866872-df77-425e-a7a0-cd5267ab43c6 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3942024-10-16T20:00:21.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 94548582-60e9-462b-a94e-b77239abe0fa roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3952024-10-16T20:00:21.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 94548582-60e9-462b-a94e-b77239abe0fa resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3962024-10-16T20:00:21.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 94548582-60e9-462b-a94e-b77239abe0fa response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3972024-10-16T20:00:22.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c9981b21-226e-47c2-8979-cca3f51db18a roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3982024-10-16T20:00:22.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c9981b21-226e-47c2-8979-cca3f51db18a resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
3992024-10-16T20:00:22.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c9981b21-226e-47c2-8979-cca3f51db18a response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4002024-10-16T20:00:23.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b066d5b0-2c15-4b0a-a582-01e20112e52d roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4012024-10-16T20:00:23.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b066d5b0-2c15-4b0a-a582-01e20112e52d resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4022024-10-16T20:00:23.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b066d5b0-2c15-4b0a-a582-01e20112e52d response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4032024-10-16T20:00:24.007ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
4042024-10-16T20:00:24.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
4052024-10-16T20:00:24.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4062024-10-16T20:00:24.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4072024-10-16T20:00:24.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4082024-10-16T20:00:24.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4092024-10-16T20:00:24.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4102024-10-16T20:00:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4112024-10-16T20:00:24.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4122024-10-16T20:00:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4132024-10-16T20:00:24.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4142024-10-16T20:00:24.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4152024-10-16T20:00:24.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4162024-10-16T20:00:24.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
4172024-10-16T20:00:24.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4182024-10-16T20:00:24.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4192024-10-16T20:00:24.033ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
4202024-10-16T20:00:24.033ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.410092ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
4212024-10-16T20:00:24.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4222024-10-16T20:00:24.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4232024-10-16T20:00:24.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.779697ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4242024-10-16T20:00:24.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e19573ec-328c-4b7b-b3ff-d5bbb51c485c roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4252024-10-16T20:00:24.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e19573ec-328c-4b7b-b3ff-d5bbb51c485c resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4262024-10-16T20:00:24.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e19573ec-328c-4b7b-b3ff-d5bbb51c485c response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4272024-10-16T20:00:25.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8cec98e1-a560-480c-a717-723a752aea7d roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4282024-10-16T20:00:25.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8cec98e1-a560-480c-a717-723a752aea7d resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4292024-10-16T20:00:25.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8cec98e1-a560-480c-a717-723a752aea7d response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4302024-10-16T20:00:26.477ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9382 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 37215b1e-7316-4433-b1d3-5b1c8542b88c response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
4312024-10-16T20:00:26.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 54c8078f-7ff4-4abb-9373-d2f60c87d11a roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4322024-10-16T20:00:26.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 54c8078f-7ff4-4abb-9373-d2f60c87d11a resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4332024-10-16T20:00:26.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 54c8078f-7ff4-4abb-9373-d2f60c87d11a response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4342024-10-16T20:00:28.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 09c83594-cc4d-4787-9bdf-adfa9dd10ad8 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4352024-10-16T20:00:28.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 09c83594-cc4d-4787-9bdf-adfa9dd10ad8 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4362024-10-16T20:00:28.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 09c83594-cc4d-4787-9bdf-adfa9dd10ad8 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4372024-10-16T20:00:29.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f7ef60b1-27df-40cb-81a6-a2fcc6986d76 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4382024-10-16T20:00:29.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f7ef60b1-27df-40cb-81a6-a2fcc6986d76 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4392024-10-16T20:00:29.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f7ef60b1-27df-40cb-81a6-a2fcc6986d76 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4402024-10-16T20:00:30.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 270bbf47-d03b-4c34-9dbe-414ab8caa585 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4412024-10-16T20:00:30.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 270bbf47-d03b-4c34-9dbe-414ab8caa585 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4422024-10-16T20:00:30.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 270bbf47-d03b-4c34-9dbe-414ab8caa585 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4432024-10-16T20:00:30.494ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c00e0d3f-e044-41de-aa27-019ad0e06267 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-10-16T20:00:30.494470458Z }
4442024-10-16T20:00:30.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c00e0d3f-e044-41de-aa27-019ad0e06267 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4452024-10-16T20:00:30.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c00e0d3f-e044-41de-aa27-019ad0e06267 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4462024-10-16T20:00:30.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12430 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c00e0d3f-e044-41de-aa27-019ad0e06267 response_code = 204 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4472024-10-16T20:00:31.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f1628d01-9f4b-4564-8ffe-d6acbd3a73a8 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4482024-10-16T20:00:31.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f1628d01-9f4b-4564-8ffe-d6acbd3a73a8 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4492024-10-16T20:00:31.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f1628d01-9f4b-4564-8ffe-d6acbd3a73a8 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4502024-10-16T20:00:31.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = a4c6b353-4827-42ea-a44e-ac61e376c647 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
4512024-10-16T20:00:31.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = a4c6b353-4827-42ea-a44e-ac61e376c647 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
4522024-10-16T20:00:31.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = a4c6b353-4827-42ea-a44e-ac61e376c647 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
4532024-10-16T20:00:31.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = f69a48b8-493e-4055-a745-2a90fe879c90 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
4542024-10-16T20:00:31.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = f69a48b8-493e-4055-a745-2a90fe879c90 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
4552024-10-16T20:00:31.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = f69a48b8-493e-4055-a745-2a90fe879c90 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
4562024-10-16T20:00:32.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 240eae34-ed52-40ab-a4db-621bd0eb161f roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4572024-10-16T20:00:32.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 240eae34-ed52-40ab-a4db-621bd0eb161f resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4582024-10-16T20:00:32.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1775 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 240eae34-ed52-40ab-a4db-621bd0eb161f response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
4592024-10-16T20:00:32.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = ba9b13e4-4792-4d3f-8839-bc5f2661ada5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
4602024-10-16T20:00:32.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = ba9b13e4-4792-4d3f-8839-bc5f2661ada5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
4612024-10-16T20:00:32.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = ba9b13e4-4792-4d3f-8839-bc5f2661ada5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
4622024-10-16T20:00:32.920ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-16T20:00:32.920596676Z }
4632024-10-16T20:00:32.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4642024-10-16T20:00:32.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4652024-10-16T20:00:32.957ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 vmm_needs_update = true
4662024-10-16T20:00:32.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4672024-10-16T20:00:32.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4682024-10-16T20:00:32.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4692024-10-16T20:00:32.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4702024-10-16T20:00:32.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4712024-10-16T20:00:32.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4722024-10-16T20:00:32.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4732024-10-16T20:00:32.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4742024-10-16T20:00:32.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4752024-10-16T20:00:32.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4762024-10-16T20:00:32.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4772024-10-16T20:00:32.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4782024-10-16T20:00:32.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4792024-10-16T20:00:32.972ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, lookup_type: ById(fcb878a2-735b-4f01-9b6b-44a1f7c3291d) }, key: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, lookup_type: ById(e9f305bd-a42d-4d83-bc23-693c3bdddaf1) }, key: 169df468-1fff-4ce6-bf29-edc50fc8e5b2, lookup_type: ById(169df468-1fff-4ce6-bf29-edc50fc8e5b2) } result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4802024-10-16T20:00:32.972ZINFOnexus (dropshot_internal): starting update saga for 169df468-1fff-4ce6-bf29-edc50fc8e5b2 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-16T20:00:32.920596676Z }
4812024-10-16T20:00:32.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51563 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 response_code = 204 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4822024-10-16T20:00:32.972ZDEBGnexus (dropshot_internal): preparing instance-update saga for 169df468-1fff-4ce6-bf29-edc50fc8e5b2... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f78ae6ad-a086-4f05-83e7-c8512bd4f3c7 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4832024-10-16T20:00:32.972ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update
4842024-10-16T20:00:32.972ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"169df468-1fff-4ce6-bf29-edc50fc8e5b2","lookup_type":{"ById":"169df468-1fff-4ce6-bf29-edc50fc8e5b2"},"parent":{"key":"e9f305bd-a42d-4d83-bc23-693c3bdddaf1","lookup_type":{"ById":"e9f305bd-a42d-4d83-bc23-693c3bdddaf1"},"parent":{"key":"fcb878a2-735b-4f01-9b6b-44a1f7c3291d","lookup_type":{"ById":"fcb878a2-735b-4f01-9b6b-44a1f7c3291d"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
4852024-10-16T20:00:32.972ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update
4862024-10-16T20:00:32.972ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7efb8454-68f6-4d42-a706-bdf7a3c129b5 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-16T20:00:32.920596676Z }
4872024-10-16T20:00:32.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7efb8454-68f6-4d42-a706-bdf7a3c129b5 roles = RoleSet { roles: {} } uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4882024-10-16T20:00:32.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7efb8454-68f6-4d42-a706-bdf7a3c129b5 resource = Database result = Ok(()) uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4892024-10-16T20:00:32.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4564 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7efb8454-68f6-4d42-a706-bdf7a3c129b5 response_code = 204 uri = /vmms/c6d08ec1-a673-4cfc-a6bf-433d5f4a5913
4902024-10-16T20:00:33.009ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update
4912024-10-16T20:00:33.009ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
4922024-10-16T20:00:33.009ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
4932024-10-16T20:00:33.009ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
4942024-10-16T20:00:33.014ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
4952024-10-16T20:00:33.014ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
4962024-10-16T20:00:33.018ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
4972024-10-16T20:00:33.018ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
4982024-10-16T20:00:33.021ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
4992024-10-16T20:00:33.021ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("be06d521-64b8-411e-a2d4-207dd6babd33")) node_id = 0 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
5002024-10-16T20:00:33.024ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5012024-10-16T20:00:33.024ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
5022024-10-16T20:00:33.029ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update
5032024-10-16T20:00:33.032ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5042024-10-16T20:00:33.032ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5052024-10-16T20:00:33.034ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5062024-10-16T20:00:33.034ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5072024-10-16T20:00:33.035ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5082024-10-16T20:00:33.035ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5092024-10-16T20:00:33.037ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5102024-10-16T20:00:33.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5112024-10-16T20:00:33.038ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5122024-10-16T20:00:33.039ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5132024-10-16T20:00:33.040ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5142024-10-16T20:00:33.040ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5152024-10-16T20:00:33.041ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5162024-10-16T20:00:33.044ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, lookup_type: ById(fcb878a2-735b-4f01-9b6b-44a1f7c3291d) }, key: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, lookup_type: ById(e9f305bd-a42d-4d83-bc23-693c3bdddaf1) }, key: 169df468-1fff-4ce6-bf29-edc50fc8e5b2, lookup_type: ById(169df468-1fff-4ce6-bf29-edc50fc8e5b2) } result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5172024-10-16T20:00:33.044ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance updater_id = be06d521-64b8-411e-a2d4-207dd6babd33
5182024-10-16T20:00:33.044ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5192024-10-16T20:00:33.044ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5202024-10-16T20:00:33.053ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance updater_id = be06d521-64b8-411e-a2d4-207dd6babd33
5212024-10-16T20:00:33.053ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5222024-10-16T20:00:33.053ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance
5232024-10-16T20:00:33.057ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 locked_gen = Generation(Generation(2)) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = LockInstance updater_id = be06d521-64b8-411e-a2d4-207dd6babd33
5242024-10-16T20:00:33.057ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5252024-10-16T20:00:33.057ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("be06d521-64b8-411e-a2d4-207dd6babd33")}) node_id = 1 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
5262024-10-16T20:00:33.060ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5272024-10-16T20:00:33.060ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
5282024-10-16T20:00:33.065ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5292024-10-16T20:00:33.066ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5302024-10-16T20:00:33.067ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5312024-10-16T20:00:33.067ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5322024-10-16T20:00:33.068ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5332024-10-16T20:00:33.069ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5342024-10-16T20:00:33.070ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5352024-10-16T20:00:33.073ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, lookup_type: ById(fcb878a2-735b-4f01-9b6b-44a1f7c3291d) }, key: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, lookup_type: ById(e9f305bd-a42d-4d83-bc23-693c3bdddaf1) }, key: 169df468-1fff-4ce6-bf29-edc50fc8e5b2, lookup_type: ById(169df468-1fff-4ce6-bf29-edc50fc8e5b2) } result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5362024-10-16T20:00:33.073ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5372024-10-16T20:00:33.073ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
5382024-10-16T20:00:33.078ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: c6d08ec1-a673-4cfc-a6bf-433d5f4a5913, time_created: 2024-10-16T20:00:11.868417Z, time_deleted: None, instance_id: 169df468-1fff-4ce6-bf29-edc50fc8e5b2, sled_id: 8219fdd9-0a75-42c9-91db-deb66a850e5b, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-10-16T20:00:32.920596Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-10-16T20:00:09.339237Z, gen: Generation(Generation(3)), propolis_id: Some(c6d08ec1-a673-4cfc-a6bf-433d5f4a5913), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-10-16T20:00:33.078509188Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
5392024-10-16T20:00:33.078ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
5402024-10-16T20:00:33.078ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"169df468-1fff-4ce6-bf29-edc50fc8e5b2","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"c6d08ec1-a673-4cfc-a6bf-433d5f4a5913"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"169df468-1fff-4ce6-bf29-edc50fc8e5b2","lookup_type":{"ById":"169df468-1fff-4ce6-bf29-edc50fc8e5b2"},"parent":{"key":"e9f305bd-a42d-4d83-bc23-693c3bdddaf1","lookup_type":{"ById":"e9f305bd-a42d-4d83-bc23-693c3bdddaf1"},"parent":{"key":"fcb878a2-735b-4f01-9b6b-44a1f7c3291d","lookup_type":{"ById":"fcb878a2-735b-4f01-9b6b-44a1f7c3291d"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"be06d521-64b8-411e-a2d4-207dd6babd33"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"e9f305bd-a42d-4d83-bc23-693c3bdddaf1","ram_diff":1073741824},"destroy_active_vmm":"c6d08ec1-a673-4cfc-a6bf-433d5f4a5913","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-10-16T20:00:33.078509188Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5412024-10-16T20:00:33.078ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
5422024-10-16T20:00:33.112ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
5432024-10-16T20:00:33.112ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5442024-10-16T20:00:33.112ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5452024-10-16T20:00:33.112ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5462024-10-16T20:00:33.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c3993047-e8ed-4924-ac66-1dfd528ed799 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
5472024-10-16T20:00:33.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c3993047-e8ed-4924-ac66-1dfd528ed799 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
5482024-10-16T20:00:33.119ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5492024-10-16T20:00:33.119ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5502024-10-16T20:00:33.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2271 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c3993047-e8ed-4924-ac66-1dfd528ed799 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
5512024-10-16T20:00:33.124ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5522024-10-16T20:00:33.124ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5532024-10-16T20:00:33.127ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5542024-10-16T20:00:33.127ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("daf78338-1cba-40f9-9e8d-89a4e495ed40")) node_id = 0 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5552024-10-16T20:00:33.131ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5562024-10-16T20:00:33.131ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5572024-10-16T20:00:33.137ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 parent_lock = UpdaterLock { updater_id: be06d521-64b8-411e-a2d4-207dd6babd33, locked_gen: Generation(Generation(2)) } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
5582024-10-16T20:00:33.137ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = BecomeUpdater
5592024-10-16T20:00:33.137ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = BecomeUpdater
5602024-10-16T20:00:33.145ZDEBGnexus (SagaExecutor): inherited lock from be06d521-64b8-411e-a2d4-207dd6babd33 to daf78338-1cba-40f9-9e8d-89a4e495ed40 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = be06d521-64b8-411e-a2d4-207dd6babd33 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = BecomeUpdater updater_id = daf78338-1cba-40f9-9e8d-89a4e495ed40
5612024-10-16T20:00:33.145ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
5622024-10-16T20:00:33.145ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5632024-10-16T20:00:33.145ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("daf78338-1cba-40f9-9e8d-89a4e495ed40")}) node_id = 1 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5642024-10-16T20:00:33.148ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5652024-10-16T20:00:33.148ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5662024-10-16T20:00:33.151ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5672024-10-16T20:00:33.151ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5682024-10-16T20:00:33.154ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5692024-10-16T20:00:33.154ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5702024-10-16T20:00:33.160ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
5712024-10-16T20:00:33.162ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2
5722024-10-16T20:00:33.164ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UpdateNetworkConfig
5732024-10-16T20:00:33.165ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UpdateNetworkConfig
5742024-10-16T20:00:33.168ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UpdateNetworkConfig
5752024-10-16T20:00:33.168ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UpdateNetworkConfig
5762024-10-16T20:00:33.170ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
5772024-10-16T20:00:33.170ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UpdateNetworkConfig
5782024-10-16T20:00:33.171ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UpdateNetworkConfig
5792024-10-16T20:00:33.172ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
5802024-10-16T20:00:33.172ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5812024-10-16T20:00:33.172ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5822024-10-16T20:00:33.174ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
5832024-10-16T20:00:33.175ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
5842024-10-16T20:00:33.175ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5852024-10-16T20:00:33.175ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5862024-10-16T20:00:33.181ZDEBGnexus: notifying dendrite of updates instance_id = Some(169df468-1fff-4ce6-bf29-edc50fc8e5b2 (instance)) switch = switch0
5872024-10-16T20:00:33.182ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4779, tv_nsec: 176402394 } })
5882024-10-16T20:00:33.182ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1066
5892024-10-16T20:00:33.212ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
5902024-10-16T20:00:33.212ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5912024-10-16T20:00:33.213ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac1acec8-5138-4ef0-956e-516899f20b87", "content-length": "26", "date": "Wed, 16 Oct 2024 20:00:33 GMT"} })
5922024-10-16T20:00:33.213ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5932024-10-16T20:00:33.213ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5942024-10-16T20:00:33.242ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
5952024-10-16T20:00:33.242ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "b67c7bff-35e9-4d54-ba0c-8e1211cf7f53", "content-length": "4", "date": "Wed, 16 Oct 2024 20:00:33 GMT"} })
5962024-10-16T20:00:33.245ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5972024-10-16T20:00:33.245ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
5982024-10-16T20:00:33.248ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
5992024-10-16T20:00:33.248ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6002024-10-16T20:00:33.252ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ReleaseVirtualProvisioning
6012024-10-16T20:00:33.252ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ReleaseVirtualProvisioning
6022024-10-16T20:00:33.264ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-10-16T20:00:33.255118Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, time_modified: Some(2024-10-16T20:00:33.255118Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, time_modified: Some(2024-10-16T20:00:33.255118Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6032024-10-16T20:00:33.264ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6042024-10-16T20:00:33.264ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6052024-10-16T20:00:33.267ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6062024-10-16T20:00:33.267ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6072024-10-16T20:00:33.271ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6082024-10-16T20:00:33.271ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UnassignOximeterProducer
6092024-10-16T20:00:33.271ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UnassignOximeterProducer
6102024-10-16T20:00:33.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = acc386aa-4b9f-46a6-9377-63f2f1a42e9e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
6112024-10-16T20:00:33.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = acc386aa-4b9f-46a6-9377-63f2f1a42e9e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
6122024-10-16T20:00:33.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = acc386aa-4b9f-46a6-9377-63f2f1a42e9e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
6132024-10-16T20:00:33.278ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 producer_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6142024-10-16T20:00:33.278ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UnassignOximeterProducer
6152024-10-16T20:00:33.278ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = UnassignOximeterProducer
6162024-10-16T20:00:33.313ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6172024-10-16T20:00:33.313ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/169df468-1fff-4ce6-bf29-edc50fc8e5b2
6182024-10-16T20:00:33.316ZDEBGnexus (SagaExecutor): client response oximeter-collector = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/169df468-1fff-4ce6-bf29-edc50fc8e5b2", status: 204, headers: {"x-request-id": "416837bf-8c4c-4469-abe1-8dcd354fc20a", "date": "Wed, 16 Oct 2024 20:00:33 GMT"} }) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6192024-10-16T20:00:33.316ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 producer_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6202024-10-16T20:00:33.317ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6212024-10-16T20:00:33.317ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6222024-10-16T20:00:33.320ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6232024-10-16T20:00:33.320ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6242024-10-16T20:00:33.326ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 lock = UpdaterLock { updater_id: daf78338-1cba-40f9-9e8d-89a4e495ed40, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-10-16T20:00:33.078509188Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6252024-10-16T20:00:33.326ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = CommitInstanceUpdates
6262024-10-16T20:00:33.327ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = CommitInstanceUpdates
6272024-10-16T20:00:33.385ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 new_runtime = InstanceRuntimeState { time_updated: 2024-10-16T20:00:33.078509188Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6282024-10-16T20:00:33.385ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6292024-10-16T20:00:33.385ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6302024-10-16T20:00:33.385ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Signaled
6312024-10-16T20:00:33.385ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6322024-10-16T20:00:33.385ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Signaled
6332024-10-16T20:00:33.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6342024-10-16T20:00:33.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6352024-10-16T20:00:33.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6362024-10-16T20:00:33.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6372024-10-16T20:00:33.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6382024-10-16T20:00:33.389ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6392024-10-16T20:00:33.389ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6402024-10-16T20:00:33.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6412024-10-16T20:00:33.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6422024-10-16T20:00:33.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6432024-10-16T20:00:33.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6442024-10-16T20:00:33.393ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6452024-10-16T20:00:33.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6462024-10-16T20:00:33.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6472024-10-16T20:00:33.394ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6482024-10-16T20:00:33.394ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("169df468-1fff-4ce6-bf29-edc50fc8e5b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c6d08ec1-a673-4cfc-a6bf-433d5f4a5913")}) node_id = 7 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6492024-10-16T20:00:33.397ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6502024-10-16T20:00:33.397ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6512024-10-16T20:00:33.401ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6522024-10-16T20:00:33.401ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6532024-10-16T20:00:33.406ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6542024-10-16T20:00:33.406ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6552024-10-16T20:00:33.409ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6562024-10-16T20:00:33.409ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ReleaseSledResources
6572024-10-16T20:00:33.409ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ReleaseSledResources
6582024-10-16T20:00:33.415ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6592024-10-16T20:00:33.415ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6602024-10-16T20:00:33.419ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6612024-10-16T20:00:33.419ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6622024-10-16T20:00:33.421ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 propolis_id = c6d08ec1-a673-4cfc-a6bf-433d5f4a5913 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6632024-10-16T20:00:33.421ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = MarkVmmDeleted
6642024-10-16T20:00:33.422ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = MarkVmmDeleted
6652024-10-16T20:00:33.425ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6662024-10-16T20:00:33.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6672024-10-16T20:00:33.430ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6682024-10-16T20:00:33.430ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6692024-10-16T20:00:33.433ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6702024-10-16T20:00:33.433ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6712024-10-16T20:00:33.436ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6722024-10-16T20:00:33.436ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6732024-10-16T20:00:33.443ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6742024-10-16T20:00:33.443ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6752024-10-16T20:00:33.447ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6762024-10-16T20:00:33.447ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6772024-10-16T20:00:33.448ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6782024-10-16T20:00:33.448ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6792024-10-16T20:00:33.476ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6802024-10-16T20:00:33.476ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6812024-10-16T20:00:33.476ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "172685ab-a103-43b8-a1f3-bf8ec1929b40", "content-length": "372", "date": "Wed, 16 Oct 2024 20:00:33 GMT"} })
6822024-10-16T20:00:33.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6832024-10-16T20:00:33.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6842024-10-16T20:00:33.477ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6852024-10-16T20:00:33.477ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6862024-10-16T20:00:33.478ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6872024-10-16T20:00:33.481ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, lookup_type: ById(fcb878a2-735b-4f01-9b6b-44a1f7c3291d) }, key: e9f305bd-a42d-4d83-bc23-693c3bdddaf1, lookup_type: ById(e9f305bd-a42d-4d83-bc23-693c3bdddaf1) }, key: 169df468-1fff-4ce6-bf29-edc50fc8e5b2, lookup_type: ById(169df468-1fff-4ce6-bf29-edc50fc8e5b2) } result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6882024-10-16T20:00:33.481ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6892024-10-16T20:00:33.481ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_node = ChainSuccessorSaga
6902024-10-16T20:00:33.486ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 karmic_state = WillReincarnate needs_reincarnation = false saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update
6912024-10-16T20:00:33.486ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6922024-10-16T20:00:33.486ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6932024-10-16T20:00:33.490ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
6942024-10-16T20:00:33.490ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
6952024-10-16T20:00:33.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3fdc7347-45e0-4018-91a8-c0604ccbb0f9", "date": "Wed, 16 Oct 2024 20:00:33 GMT"} })
6962024-10-16T20:00:33.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6972024-10-16T20:00:33.490ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
6982024-10-16T20:00:33.490ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
6992024-10-16T20:00:33.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7002024-10-16T20:00:33.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7012024-10-16T20:00:33.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7022024-10-16T20:00:33.494ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7032024-10-16T20:00:33.494ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
7042024-10-16T20:00:33.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7052024-10-16T20:00:33.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7062024-10-16T20:00:33.497ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7072024-10-16T20:00:33.497ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f
7082024-10-16T20:00:33.499ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7092024-10-16T20:00:33.499ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7102024-10-16T20:00:33.500ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3552c43e-2d1e-4350-b210-8204bab50128", "date": "Wed, 16 Oct 2024 20:00:33 GMT"} })
7112024-10-16T20:00:33.502ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 116.479632ms iteration = 12 status = {}
7122024-10-16T20:00:33.513ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7132024-10-16T20:00:33.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7142024-10-16T20:00:33.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152024-10-16T20:00:33.516ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7162024-10-16T20:00:33.516ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7172024-10-16T20:00:33.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7182024-10-16T20:00:33.518ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192024-10-16T20:00:33.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7202024-10-16T20:00:33.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7212024-10-16T20:00:33.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7222024-10-16T20:00:33.545ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7232024-10-16T20:00:33.545ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f saga_name = instance-update saga_result = SagaResult { saga_id: e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f, saga_log: SagaLog { saga_id: e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("daf78338-1cba-40f9-9e8d-89a4e495ed40")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("daf78338-1cba-40f9-9e8d-89a4e495ed40")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("169df468-1fff-4ce6-bf29-edc50fc8e5b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c6d08ec1-a673-4cfc-a6bf-433d5f4a5913")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("169df468-1fff-4ce6-bf29-edc50fc8e5b2"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c6d08ec1-a673-4cfc-a6bf-433d5f4a5913")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("daf78338-1cba-40f9-9e8d-89a4e495ed40"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("daf78338-1cba-40f9-9e8d-89a4e495ed40")}} }) }
7242024-10-16T20:00:33.545ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = e14e90f4-62e6-4b1f-a6b4-2498e67e5f5f instance_id = 169df468-1fff-4ce6-bf29-edc50fc8e5b2 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update
7252024-10-16T20:00:33.546ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7262024-10-16T20:00:33.546ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
7272024-10-16T20:00:33.550ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7282024-10-16T20:00:33.550ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
7292024-10-16T20:00:33.557ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7302024-10-16T20:00:33.557ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
7312024-10-16T20:00:33.561ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7322024-10-16T20:00:33.561ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557
7332024-10-16T20:00:33.567ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update sec_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7342024-10-16T20:00:33.567ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = cf177dd7-7c4a-4a4e-a480-82f1a21ec557 saga_name = start-instance-update saga_result = SagaResult { saga_id: cf177dd7-7c4a-4a4e-a480-82f1a21ec557, saga_log: SagaLog { saga_id: cf177dd7-7c4a-4a4e-a480-82f1a21ec557, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("be06d521-64b8-411e-a2d4-207dd6babd33")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("be06d521-64b8-411e-a2d4-207dd6babd33")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("be06d521-64b8-411e-a2d4-207dd6babd33"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("be06d521-64b8-411e-a2d4-207dd6babd33")}} }) }
7352024-10-16T20:00:33.609ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7362024-10-16T20:00:33.610ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6c0bd00-f924-4b4f-83e1-f0242b27d24e", "content-length": "691", "date": "Wed, 16 Oct 2024 20:00:33 GMT"} })
7372024-10-16T20:00:33.610ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7382024-10-16T20:00:33.610ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7392024-10-16T20:00:33.610ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7402024-10-16T20:00:33.612ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 226.478835ms iteration = 11 status = {}
7412024-10-16T20:00:34.008ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
7422024-10-16T20:00:34.008ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
7432024-10-16T20:00:34.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7442024-10-16T20:00:34.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7452024-10-16T20:00:34.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7462024-10-16T20:00:34.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7472024-10-16T20:00:34.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482024-10-16T20:00:34.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7492024-10-16T20:00:34.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7502024-10-16T20:00:34.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7512024-10-16T20:00:34.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7522024-10-16T20:00:34.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7532024-10-16T20:00:34.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542024-10-16T20:00:34.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
7552024-10-16T20:00:34.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7562024-10-16T20:00:34.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7572024-10-16T20:00:34.027ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
7582024-10-16T20:00:34.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.150209ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
7592024-10-16T20:00:34.037ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7602024-10-16T20:00:34.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7612024-10-16T20:00:34.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.65395ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7622024-10-16T20:00:34.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 15560c63-bc50-4e9d-8014-da78447b7bcb roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7632024-10-16T20:00:34.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 15560c63-bc50-4e9d-8014-da78447b7bcb resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7642024-10-16T20:00:34.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 15560c63-bc50-4e9d-8014-da78447b7bcb response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7652024-10-16T20:00:34.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 943bc49f-290b-4ac2-9855-4d4c7342514a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
7662024-10-16T20:00:34.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 943bc49f-290b-4ac2-9855-4d4c7342514a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
7672024-10-16T20:00:34.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 943bc49f-290b-4ac2-9855-4d4c7342514a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
7682024-10-16T20:00:35.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 41969000-953c-41ec-b724-c5e49c84fd2a roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7692024-10-16T20:00:35.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 41969000-953c-41ec-b724-c5e49c84fd2a resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7702024-10-16T20:00:35.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 41969000-953c-41ec-b724-c5e49c84fd2a response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7712024-10-16T20:00:35.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 0256d787-3299-41b8-a1e3-9f1bf4bff2ec roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
7722024-10-16T20:00:35.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 0256d787-3299-41b8-a1e3-9f1bf4bff2ec resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
7732024-10-16T20:00:35.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 0256d787-3299-41b8-a1e3-9f1bf4bff2ec response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
7742024-10-16T20:00:36.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d2a36a2a-a2e2-439b-b19a-87f285acb79c roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7752024-10-16T20:00:36.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d2a36a2a-a2e2-439b-b19a-87f285acb79c resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7762024-10-16T20:00:36.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d2a36a2a-a2e2-439b-b19a-87f285acb79c response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7772024-10-16T20:00:36.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1446 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = e289c8b6-05ac-4c64-9a24-e71237a9806f response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
7782024-10-16T20:00:37.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 740f4506-2245-49f0-8d70-ccf538735746 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7792024-10-16T20:00:37.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 740f4506-2245-49f0-8d70-ccf538735746 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7802024-10-16T20:00:37.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 740f4506-2245-49f0-8d70-ccf538735746 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7812024-10-16T20:00:38.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 46438ea1-3a8d-4ff8-841c-7bf4c74f83d0 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7822024-10-16T20:00:38.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 46438ea1-3a8d-4ff8-841c-7bf4c74f83d0 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7832024-10-16T20:00:38.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 46438ea1-3a8d-4ff8-841c-7bf4c74f83d0 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7842024-10-16T20:00:39.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = afd77491-2cd9-4236-8fe6-cef52b01ae01 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7852024-10-16T20:00:39.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = afd77491-2cd9-4236-8fe6-cef52b01ae01 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7862024-10-16T20:00:39.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = afd77491-2cd9-4236-8fe6-cef52b01ae01 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7872024-10-16T20:00:40.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3218bf4a-38fe-4348-a9d7-d7033f0125e7 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7882024-10-16T20:00:40.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3218bf4a-38fe-4348-a9d7-d7033f0125e7 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7892024-10-16T20:00:40.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3218bf4a-38fe-4348-a9d7-d7033f0125e7 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7902024-10-16T20:00:41.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8a120628-416e-4b60-ab07-128cd2e4a1a2 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7912024-10-16T20:00:41.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8a120628-416e-4b60-ab07-128cd2e4a1a2 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7922024-10-16T20:00:41.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8a120628-416e-4b60-ab07-128cd2e4a1a2 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7932024-10-16T20:00:42.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 128a6a1f-043f-4d77-a49e-ff26d5c69e3b roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7942024-10-16T20:00:42.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 128a6a1f-043f-4d77-a49e-ff26d5c69e3b resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7952024-10-16T20:00:42.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 128a6a1f-043f-4d77-a49e-ff26d5c69e3b response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7962024-10-16T20:00:43.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5d638430-5e7a-4a60-8e2e-040cbb7977fd roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7972024-10-16T20:00:43.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5d638430-5e7a-4a60-8e2e-040cbb7977fd resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7982024-10-16T20:00:43.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2115 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5d638430-5e7a-4a60-8e2e-040cbb7977fd response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
7992024-10-16T20:00:43.550ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:50405
8002024-10-16T20:00:43.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50405 req_id = 4ec07437-f849-4820-8421-5c87b553d6cf roles = RoleSet { roles: {} } uri = /metrics/producers
8012024-10-16T20:00:43.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50405 req_id = 4ec07437-f849-4820-8421-5c87b553d6cf resource = Database result = Ok(()) uri = /metrics/producers
8022024-10-16T20:00:43.626ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = f3710494-36b7-4736-839b-65e01f5ecb38
8032024-10-16T20:00:43.626ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 uri = http://[fd00:1122:3344:101::d]:12223/producers
8042024-10-16T20:00:43.627ZDEBGnexus: client response oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "534b9e3a-fca0-4c3c-b55d-5d1ec4cf587a", "date": "Wed, 16 Oct 2024 20:00:43 GMT"} })
8052024-10-16T20:00:43.627ZINFOnexus: assigned collector to new producer collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 file = nexus/src/app/oximeter.rs:133 producer_id = a0495e0c-c1b9-402d-964a-04391f96f259
8062024-10-16T20:00:43.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77527 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50405 req_id = 4ec07437-f849-4820-8421-5c87b553d6cf response_code = 201 uri = /metrics/producers
8072024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
8082024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
8092024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
8102024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8112024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
8122024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
8132024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
8142024-10-16T20:00:43.869ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-16 19:50:43.869113944 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
8152024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
8162024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
8172024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8182024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
8192024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
8202024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8212024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8222024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
8232024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
8242024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
8252024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8262024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8272024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
8282024-10-16T20:00:43.869ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7eaa8248-3c51-4c26-80cb-61296f525a84.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0230ae5-ea49-40dd-a6ee-3123741a5ad1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0230ae5-ea49-40dd-a6ee-3123741a5ad1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4789, tv_nsec: 863953745 } })
8292024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8302024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8312024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
8322024-10-16T20:00:43.869ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("10b74d3e-6165-421b-9b1c-d25aa0300fac.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("acd61760-31de-4024-8375-b671bb18b6bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd72e5f8-d0ea-4356-91b4-5a51d2a67d6f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd72e5f8-d0ea-4356-91b4-5a51d2a67d6f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 4789, tv_nsec: 864078288 } })
8332024-10-16T20:00:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8342024-10-16T20:00:43.870ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
8352024-10-16T20:00:43.870ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.125646ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
8362024-10-16T20:00:43.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8372024-10-16T20:00:43.870ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
8382024-10-16T20:00:43.870ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.31678ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
8392024-10-16T20:00:43.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8402024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8412024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
8422024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8432024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8442024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
8452024-10-16T20:00:43.872ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
8462024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8472024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
8482024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
8492024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
8502024-10-16T20:00:43.872ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21
8512024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
8522024-10-16T20:00:43.872ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
8532024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.04\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21"}
8542024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
8552024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
8562024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8572024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8582024-10-16T20:00:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8592024-10-16T20:00:43.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
8602024-10-16T20:00:43.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4789, tv_nsec: 867277601 } })
8612024-10-16T20:00:43.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
8622024-10-16T20:00:43.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4789, tv_nsec: 867382744 } })
8632024-10-16T20:00:43.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8642024-10-16T20:00:43.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8652024-10-16T20:00:43.873ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1066
8662024-10-16T20:00:43.873ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1066
8672024-10-16T20:00:43.873ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-16 19:50:43.869113944 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
8682024-10-16T20:00:43.873ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.689247ms iteration = 6 status = {"expiration":"2024-10-16T19:50:43.869113944Z","pruned":[]}
8692024-10-16T20:00:43.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8702024-10-16T20:00:43.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8712024-10-16T20:00:43.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8722024-10-16T20:00:43.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8732024-10-16T20:00:43.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8742024-10-16T20:00:43.877ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.33632ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
8752024-10-16T20:00:43.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8762024-10-16T20:00:43.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8772024-10-16T20:00:43.879ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8782024-10-16T20:00:43.880ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8792024-10-16T20:00:43.880ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8802024-10-16T20:00:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8812024-10-16T20:00:43.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8822024-10-16T20:00:43.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
8832024-10-16T20:00:43.881ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8842024-10-16T20:00:43.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8852024-10-16T20:00:43.882ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862024-10-16T20:00:43.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8872024-10-16T20:00:43.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8882024-10-16T20:00:43.890ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
8892024-10-16T20:00:43.890ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8902024-10-16T20:00:43.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8912024-10-16T20:00:43.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8922024-10-16T20:00:43.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8932024-10-16T20:00:43.923ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
8942024-10-16T20:00:43.923ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
8952024-10-16T20:00:43.923ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
8962024-10-16T20:00:43.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8972024-10-16T20:00:43.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8982024-10-16T20:00:43.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8992024-10-16T20:00:43.926ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
9002024-10-16T20:00:43.926ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
9012024-10-16T20:00:43.926ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 54.022709ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
9022024-10-16T20:00:43.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9032024-10-16T20:00:43.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9042024-10-16T20:00:43.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9052024-10-16T20:00:43.933ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
9062024-10-16T20:00:43.933ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
9072024-10-16T20:00:43.933ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
9082024-10-16T20:00:43.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9092024-10-16T20:00:43.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9102024-10-16T20:00:43.935ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9112024-10-16T20:00:43.940ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
9122024-10-16T20:00:43.940ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
9132024-10-16T20:00:43.940ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.541799ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
9142024-10-16T20:00:43.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9152024-10-16T20:00:43.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9162024-10-16T20:00:43.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9172024-10-16T20:00:43.944ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9182024-10-16T20:00:43.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9192024-10-16T20:00:43.944ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9202024-10-16T20:00:43.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9212024-10-16T20:00:43.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9222024-10-16T20:00:43.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9232024-10-16T20:00:43.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9242024-10-16T20:00:43.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9252024-10-16T20:00:43.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9262024-10-16T20:00:43.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9272024-10-16T20:00:43.960ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9282024-10-16T20:00:43.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9292024-10-16T20:00:43.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9302024-10-16T20:00:43.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9312024-10-16T20:00:43.985ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
9322024-10-16T20:00:43.985ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 11536a5a-1133-48e5-a207-83092315920d dns_zone_name = oxide.test found_so_far = 0 version = 2
9332024-10-16T20:00:43.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9342024-10-16T20:00:43.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9352024-10-16T20:00:43.991ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9362024-10-16T20:00:43.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
9372024-10-16T20:00:43.993ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9382024-10-16T20:00:43.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9392024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
9402024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 22.721\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
9412024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
9422024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9432024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
9442024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9452024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9462024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9472024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9482024-10-16T20:00:44.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9492024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
9502024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d2145840-5973-4480-bc99-a5959766b75f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
9512024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
9522024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9532024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9542024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9552024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
9562024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9572024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
9582024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.07\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
9592024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
9602024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.99\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
9612024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
9622024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
9632024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9642024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
9652024-10-16T20:00:44.007ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9662024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 17.331\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
9672024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
9682024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9692024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
9702024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9712024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
9722024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9732024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9742024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
9752024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
9762024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9772024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9782024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9792024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9802024-10-16T20:00:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9812024-10-16T20:00:44.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9822024-10-16T20:00:44.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9832024-10-16T20:00:44.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9842024-10-16T20:00:44.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9852024-10-16T20:00:44.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9862024-10-16T20:00:44.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9872024-10-16T20:00:44.009ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
9882024-10-16T20:00:44.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9892024-10-16T20:00:44.011ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.220426ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9902024-10-16T20:00:44.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9912024-10-16T20:00:44.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9922024-10-16T20:00:44.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9932024-10-16T20:00:44.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9942024-10-16T20:00:44.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9952024-10-16T20:00:44.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9962024-10-16T20:00:44.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9972024-10-16T20:00:44.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9982024-10-16T20:00:44.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9992024-10-16T20:00:44.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10002024-10-16T20:00:44.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10012024-10-16T20:00:44.019ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10022024-10-16T20:00:44.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10032024-10-16T20:00:44.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10042024-10-16T20:00:44.021ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
10052024-10-16T20:00:44.021ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10062024-10-16T20:00:44.021ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ee70b7-bf1b-4a6b-89dc-daaba834d808", "content-length": "26", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
10072024-10-16T20:00:44.021ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10082024-10-16T20:00:44.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10092024-10-16T20:00:44.022ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10102024-10-16T20:00:44.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10112024-10-16T20:00:44.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10122024-10-16T20:00:44.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10132024-10-16T20:00:44.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10142024-10-16T20:00:44.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10152024-10-16T20:00:44.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10162024-10-16T20:00:44.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10172024-10-16T20:00:44.023ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10182024-10-16T20:00:44.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10192024-10-16T20:00:44.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10202024-10-16T20:00:44.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10212024-10-16T20:00:44.026ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4790, tv_nsec: 20370543 } })
10222024-10-16T20:00:44.026ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1066 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
10232024-10-16T20:00:44.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10242024-10-16T20:00:44.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10252024-10-16T20:00:44.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10262024-10-16T20:00:44.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10272024-10-16T20:00:44.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10282024-10-16T20:00:44.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10292024-10-16T20:00:44.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10302024-10-16T20:00:44.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10312024-10-16T20:00:44.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10322024-10-16T20:00:44.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10332024-10-16T20:00:44.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10342024-10-16T20:00:44.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10352024-10-16T20:00:44.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10362024-10-16T20:00:44.032ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10372024-10-16T20:00:44.032ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.81773ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
10382024-10-16T20:00:44.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10392024-10-16T20:00:44.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10402024-10-16T20:00:44.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10412024-10-16T20:00:44.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
10422024-10-16T20:00:44.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10432024-10-16T20:00:44.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10442024-10-16T20:00:44.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10452024-10-16T20:00:44.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10462024-10-16T20:00:44.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10472024-10-16T20:00:44.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10482024-10-16T20:00:44.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10492024-10-16T20:00:44.039ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 11536a5a-1133-48e5-a207-83092315920d dns_zone_name = oxide.test found_so_far = 1 version = 2
10502024-10-16T20:00:44.039ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
10512024-10-16T20:00:44.040ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-16 19:56:14.769900 UTC dns_group = external generation = 2
10522024-10-16T20:00:44.040ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 170.931401ms iteration = 7 status = {"generation":2}
10532024-10-16T20:00:44.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10542024-10-16T20:00:44.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10552024-10-16T20:00:44.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10562024-10-16T20:00:44.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10572024-10-16T20:00:44.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10582024-10-16T20:00:44.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10592024-10-16T20:00:44.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.475088ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10602024-10-16T20:00:44.049ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
10612024-10-16T20:00:44.049ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.347138ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
10622024-10-16T20:00:44.051ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10632024-10-16T20:00:44.051ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10642024-10-16T20:00:44.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10652024-10-16T20:00:44.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10662024-10-16T20:00:44.052ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-16T19:55:41.523549Z, time_modified: 2024-10-16T19:55:41.523549Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, db_silo: Silo { identity: SiloIdentity { id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-16T19:56:14.712503Z, time_modified: 2024-10-16T19:56:14.712503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d9557d3f8c1e45f833d66c20e7d222f3a136fcb2ae53fec6ded640f0af43d6dc" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, db_silo: Silo { identity: SiloIdentity { id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-16T19:56:14.712503Z, time_modified: 2024-10-16T19:56:14.712503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d9557d3f8c1e45f833d66c20e7d222f3a136fcb2ae53fec6ded640f0af43d6dc" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
10672024-10-16T20:00:44.052ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 183.266663ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fcb878a2-735b-4f01-9b6b-44a1f7c3291d","tls_certs":["d9557d3f8c1e45f833d66c20e7d222f3a136fcb2ae53fec6ded640f0af43d6dc"]}},"default_endpoint":{"silo_id":"fcb878a2-735b-4f01-9b6b-44a1f7c3291d","tls_certs":["d9557d3f8c1e45f833d66c20e7d222f3a136fcb2ae53fec6ded640f0af43d6dc"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
10682024-10-16T20:00:44.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10692024-10-16T20:00:44.054ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
10702024-10-16T20:00:44.054ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 182.2495ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
10712024-10-16T20:00:44.055ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10722024-10-16T20:00:44.055ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10732024-10-16T20:00:44.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10742024-10-16T20:00:44.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10752024-10-16T20:00:44.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10762024-10-16T20:00:44.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10772024-10-16T20:00:44.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10782024-10-16T20:00:44.060ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d2145840-5973-4480-bc99-a5959766b75f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
10792024-10-16T20:00:44.060ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
10802024-10-16T20:00:44.060ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-16 19:56:14.256102 UTC dns_group = internal generation = 1
10812024-10-16T20:00:44.060ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 190.944019ms iteration = 7 status = {"generation":1}
10822024-10-16T20:00:44.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10832024-10-16T20:00:44.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10842024-10-16T20:00:44.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10852024-10-16T20:00:44.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10862024-10-16T20:00:44.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10872024-10-16T20:00:44.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10882024-10-16T20:00:44.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10892024-10-16T20:00:44.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10902024-10-16T20:00:44.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10912024-10-16T20:00:44.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8219fdd9-0a75-42c9-91db-deb66a850e5b, lookup_type: ById(8219fdd9-0a75-42c9-91db-deb66a850e5b) } result = Ok(())
10922024-10-16T20:00:44.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10932024-10-16T20:00:44.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10942024-10-16T20:00:44.070ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.166569ms iteration = 11 status = 0
10952024-10-16T20:00:44.078ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.635081ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10962024-10-16T20:00:44.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10972024-10-16T20:00:44.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10982024-10-16T20:00:44.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10992024-10-16T20:00:44.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11002024-10-16T20:00:44.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11012024-10-16T20:00:44.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11022024-10-16T20:00:44.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11032024-10-16T20:00:44.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11042024-10-16T20:00:44.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11052024-10-16T20:00:44.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11062024-10-16T20:00:44.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11072024-10-16T20:00:44.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11082024-10-16T20:00:44.090ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11092024-10-16T20:00:44.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11102024-10-16T20:00:44.090ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11112024-10-16T20:00:44.090ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11122024-10-16T20:00:44.090ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.287851ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11132024-10-16T20:00:44.092ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11142024-10-16T20:00:44.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11152024-10-16T20:00:44.094ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11162024-10-16T20:00:44.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11172024-10-16T20:00:44.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11182024-10-16T20:00:44.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11192024-10-16T20:00:44.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11202024-10-16T20:00:44.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11212024-10-16T20:00:44.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11222024-10-16T20:00:44.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11232024-10-16T20:00:44.102ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11242024-10-16T20:00:44.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11252024-10-16T20:00:44.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11262024-10-16T20:00:44.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11272024-10-16T20:00:44.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11282024-10-16T20:00:44.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11292024-10-16T20:00:44.110ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11302024-10-16T20:00:44.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11312024-10-16T20:00:44.119ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11322024-10-16T20:00:44.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11332024-10-16T20:00:44.122ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11342024-10-16T20:00:44.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11352024-10-16T20:00:44.124ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11362024-10-16T20:00:44.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11372024-10-16T20:00:44.136ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
11382024-10-16T20:00:44.136ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11392024-10-16T20:00:44.137ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "520f7d3e-05bf-4ce3-ba92-38d0b21af210", "content-length": "26", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
11402024-10-16T20:00:44.137ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11412024-10-16T20:00:44.138ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11422024-10-16T20:00:44.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11432024-10-16T20:00:44.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11442024-10-16T20:00:44.142ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
11452024-10-16T20:00:44.159ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.385862ms iteration = 14 status = {"physical_disks_added":0}
11462024-10-16T20:00:44.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
11472024-10-16T20:00:44.179ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c2b88c4a-aea3-40dd-a8cc-408276248a53", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11482024-10-16T20:00:44.179ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11492024-10-16T20:00:44.180ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "83aa320c-1bc7-4c93-9391-818b8b8811f6", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11502024-10-16T20:00:44.180ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11512024-10-16T20:00:44.182ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
11522024-10-16T20:00:44.182ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 313.04892ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
11532024-10-16T20:00:44.259ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11542024-10-16T20:00:44.259ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11552024-10-16T20:00:44.260ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ae5b66b-910a-49c7-8924-88efe618a88a", "content-length": "372", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
11562024-10-16T20:00:44.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11572024-10-16T20:00:44.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11582024-10-16T20:00:44.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11592024-10-16T20:00:44.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11602024-10-16T20:00:44.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11612024-10-16T20:00:44.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11622024-10-16T20:00:44.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11632024-10-16T20:00:44.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11642024-10-16T20:00:44.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11652024-10-16T20:00:44.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11662024-10-16T20:00:44.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11672024-10-16T20:00:44.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11682024-10-16T20:00:44.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11692024-10-16T20:00:44.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11702024-10-16T20:00:44.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11712024-10-16T20:00:44.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11722024-10-16T20:00:44.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11732024-10-16T20:00:44.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11742024-10-16T20:00:44.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11752024-10-16T20:00:44.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11762024-10-16T20:00:44.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11772024-10-16T20:00:44.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11782024-10-16T20:00:44.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11792024-10-16T20:00:44.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11802024-10-16T20:00:44.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11812024-10-16T20:00:44.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11822024-10-16T20:00:44.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11832024-10-16T20:00:44.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11842024-10-16T20:00:44.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852024-10-16T20:00:44.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11862024-10-16T20:00:44.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11872024-10-16T20:00:44.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11882024-10-16T20:00:44.286ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 5ba193bf-b575-4578-8e50-6cb5693d79d5, kind: Service { id: f0230ae5-ea49-40dd-a6ee-3123741a5ad1 }, name: Name("external-dns-f0230ae5-ea49-40dd-a6ee-3123741a5ad1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 127])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d80acc8f-cafc-4b5a-8336-f0e41acc41b9, kind: Service { id: 7eaa8248-3c51-4c26-80cb-61296f525a84 }, name: Name("external-dns-7eaa8248-3c51-4c26-80cb-61296f525a84"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 2e5a54ab-54b0-4101-a83b-861e2e4e38db, kind: Service { id: da154c54-202b-4830-b72b-dc8102e57077 }, name: Name("nexus-da154c54-202b-4830-b72b-dc8102e57077"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bb17ce1-1507-4ac6-afb0-4554bb9fa378, kind: Service { id: ead62755-a923-4c3e-b6ba-c13f8a0dfa76 }, name: Name("nexus-ead62755-a923-4c3e-b6ba-c13f8a0dfa76"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 16])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 845e72e6-2434-49a7-88b9-4a85e617dadc, kind: Service { id: bb888a52-e1f5-4893-bec6-0b8ff00c7df7 }, name: Name("nexus-bb888a52-e1f5-4893-bec6-0b8ff00c7df7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
11892024-10-16T20:00:44.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11902024-10-16T20:00:44.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11912024-10-16T20:00:44.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11922024-10-16T20:00:44.290ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
11932024-10-16T20:00:44.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11942024-10-16T20:00:44.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11952024-10-16T20:00:44.290ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
11962024-10-16T20:00:44.302ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11972024-10-16T20:00:44.302ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11982024-10-16T20:00:44.303ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e933137f-029f-4501-9c25-c5c0665ba3b3", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
11992024-10-16T20:00:44.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12002024-10-16T20:00:44.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12012024-10-16T20:00:44.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0df799d9-7e61-4217-9056-318a3b491909 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
12022024-10-16T20:00:44.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0df799d9-7e61-4217-9056-318a3b491909 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
12032024-10-16T20:00:44.397ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 528.448131ms iteration = 11 status = {}
12042024-10-16T20:00:44.398ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1074 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 zone_address = fd00:1122:3344:101::2
12052024-10-16T20:00:44.398ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12062024-10-16T20:00:44.398ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e299676-5325-430d-ac52-bfa21be0d35a", "content-length": "26", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12072024-10-16T20:00:44.398ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1079 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12082024-10-16T20:00:44.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
12092024-10-16T20:00:44.414ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12102024-10-16T20:00:44.414ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfc0fd51-5ac9-4238-aaf6-7f1e2df7cae3", "content-length": "691", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12112024-10-16T20:00:44.414ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12122024-10-16T20:00:44.414ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12132024-10-16T20:00:44.414ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12142024-10-16T20:00:44.415ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 407.63634ms iteration = 12 status = {}
12152024-10-16T20:00:44.416ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
12162024-10-16T20:00:44.416ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5ba193bf-b575-4578-8e50-6cb5693d79d5, kind: Service { id: f0230ae5-ea49-40dd-a6ee-3123741a5ad1 }, name: Name("external-dns-f0230ae5-ea49-40dd-a6ee-3123741a5ad1"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 127])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d80acc8f-cafc-4b5a-8336-f0e41acc41b9, kind: Service { id: 7eaa8248-3c51-4c26-80cb-61296f525a84 }, name: Name("external-dns-7eaa8248-3c51-4c26-80cb-61296f525a84"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2e5a54ab-54b0-4101-a83b-861e2e4e38db, kind: Service { id: da154c54-202b-4830-b72b-dc8102e57077 }, name: Name("nexus-da154c54-202b-4830-b72b-dc8102e57077"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 248])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7bb17ce1-1507-4ac6-afb0-4554bb9fa378, kind: Service { id: ead62755-a923-4c3e-b6ba-c13f8a0dfa76 }, name: Name("nexus-ead62755-a923-4c3e-b6ba-c13f8a0dfa76"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 16])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 845e72e6-2434-49a7-88b9-4a85e617dadc, kind: Service { id: bb888a52-e1f5-4893-bec6-0b8ff00c7df7 }, name: Name("nexus-bb888a52-e1f5-4893-bec6-0b8ff00c7df7"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 193, 166])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12172024-10-16T20:00:44.416ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
12182024-10-16T20:00:44.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0df799d9-7e61-4217-9056-318a3b491909 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
12192024-10-16T20:00:44.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12202024-10-16T20:00:44.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12212024-10-16T20:00:44.423ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12222024-10-16T20:00:44.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12232024-10-16T20:00:44.424ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12242024-10-16T20:00:44.425ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1889c83f-325a-4c39-82b2-a6771bb67cfb", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12252024-10-16T20:00:44.425ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12262024-10-16T20:00:44.427ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eba6b542-fe67-4c74-b725-0e9aa0bb0a8f", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12272024-10-16T20:00:44.427ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12282024-10-16T20:00:44.427ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12292024-10-16T20:00:44.427ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12302024-10-16T20:00:44.428ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "336318bc-7bb0-45b1-a463-75962165b3fe", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12312024-10-16T20:00:44.429ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "380ad8bb-73cf-4607-838c-89acb3fa8178", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12322024-10-16T20:00:44.429ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12332024-10-16T20:00:44.430ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 423.025074ms iteration = 13 status = {}
12342024-10-16T20:00:44.431ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12352024-10-16T20:00:44.431ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 562.660555ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
12362024-10-16T20:00:44.462ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12372024-10-16T20:00:44.463ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b1af075-2fd2-4416-9e1f-2cfe01a46fe3", "content-length": "2", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12382024-10-16T20:00:44.464ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12392024-10-16T20:00:44.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12402024-10-16T20:00:44.466ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 597.7417ms iteration = 11 status = null
12412024-10-16T20:00:44.470ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 8219fdd9-0a75-42c9-91db-deb66a850e5b, time_created: 2024-10-16T19:56:11.253473Z, time_modified: 2024-10-16T19:56:11.253473Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: dbc07659-6078-4fa6-9892-1d25efe44b81, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
12422024-10-16T20:00:44.470ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
12432024-10-16T20:00:44.470ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12442024-10-16T20:00:44.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12452024-10-16T20:00:44.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
12462024-10-16T20:00:44.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
12472024-10-16T20:00:44.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12482024-10-16T20:00:44.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 8219fdd9-0a75-42c9-91db-deb66a850e5b, lookup_type: ById(8219fdd9-0a75-42c9-91db-deb66a850e5b) } result = Ok(())
12492024-10-16T20:00:44.538ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12502024-10-16T20:00:44.566ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "9496e858-21ab-4e97-b13f-53fa846d40ed", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12512024-10-16T20:00:44.567ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
12522024-10-16T20:00:44.567ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 694.976111ms
12532024-10-16T20:00:44.567ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 694.987631ms iteration = 2 status = {}
12542024-10-16T20:00:44.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12552024-10-16T20:00:44.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12562024-10-16T20:00:44.576ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66211944-054d-446c-afc3-b1a33ad80dff, rack_id: dbc07659-6078-4fa6-9892-1d25efe44b81, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c33f3d0a-20b1-42d9-bb7b-a442a73c3582) } rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
12572024-10-16T20:00:44.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12582024-10-16T20:00:44.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12592024-10-16T20:00:44.587ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12602024-10-16T20:00:44.587ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f2b3ce-21e8-4b13-a2af-1248db31b7f0", "content-length": "121", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12612024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
12622024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c33f3d0a-20b1-42d9-bb7b-a442a73c3582
12632024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12642024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12652024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12662024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12672024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12682024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12692024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12702024-10-16T20:00:44.587ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12712024-10-16T20:00:44.588ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
12722024-10-16T20:00:44.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12732024-10-16T20:00:44.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12742024-10-16T20:00:44.590ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12752024-10-16T20:00:44.590ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5db6ca5b-2ede-4fec-9ac8-4cbc11f1d9e5", "content-length": "2", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12762024-10-16T20:00:44.590ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12772024-10-16T20:00:44.590ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec95edd5-3fd1-4a79-a8ea-5d69b1aa5bff", "content-length": "52", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12782024-10-16T20:00:44.590ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
12792024-10-16T20:00:44.590ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12802024-10-16T20:00:44.686ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3f83d19e-2d8c-4fb4-b2e5-e6ce8e033489", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12812024-10-16T20:00:44.686ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch = Switch0
12822024-10-16T20:00:44.686ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12832024-10-16T20:00:44.686ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc6e340d-23ab-474e-bdbe-1d5eeb588d6f", "content-length": "669", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
12842024-10-16T20:00:44.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12852024-10-16T20:00:44.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12862024-10-16T20:00:44.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12872024-10-16T20:00:44.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12882024-10-16T20:00:44.692ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12892024-10-16T20:00:44.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12902024-10-16T20:00:44.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12912024-10-16T20:00:44.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12922024-10-16T20:00:44.701ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 695.217206ms iteration = 11 status = {}
12932024-10-16T20:00:44.761ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:55395
12942024-10-16T20:00:44.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55395 req_id = a499aa36-47ba-40cc-8d2a-bce6611d7083 roles = RoleSet { roles: {} } uri = /metrics/producers
12952024-10-16T20:00:44.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55395 req_id = a499aa36-47ba-40cc-8d2a-bce6611d7083 resource = Database result = Ok(()) uri = /metrics/producers
12962024-10-16T20:00:44.812ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:42038
12972024-10-16T20:00:44.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42038 req_id = 2e5b1518-5ce8-42d0-b20d-8ec7aa2a0a93 roles = RoleSet { roles: {} } uri = /metrics/producers
12982024-10-16T20:00:44.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42038 req_id = 2e5b1518-5ce8-42d0-b20d-8ec7aa2a0a93 resource = Database result = Ok(()) uri = /metrics/producers
12992024-10-16T20:00:44.837ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = f3710494-36b7-4736-839b-65e01f5ecb38
13002024-10-16T20:00:44.837ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 uri = http://[fd00:1122:3344:101::d]:12223/producers
13012024-10-16T20:00:44.837ZDEBGnexus: client response oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "a11be4c9-d738-410a-97aa-dc5fcc52ae26", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
13022024-10-16T20:00:44.837ZINFOnexus: assigned collector to new producer collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 file = nexus/src/app/oximeter.rs:133 producer_id = 8219fdd9-0a75-42c9-91db-deb66a850e5b
13032024-10-16T20:00:44.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78236 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55395 req_id = a499aa36-47ba-40cc-8d2a-bce6611d7083 response_code = 201 uri = /metrics/producers
13042024-10-16T20:00:44.891ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = f3710494-36b7-4736-839b-65e01f5ecb38
13052024-10-16T20:00:44.891ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 uri = http://[fd00:1122:3344:101::d]:12223/producers
13062024-10-16T20:00:44.891ZDEBGnexus: client response oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "634cf5b3-8131-4512-a044-56418028119f", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
13072024-10-16T20:00:44.891ZINFOnexus: assigned collector to new producer collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 file = nexus/src/app/oximeter.rs:133 producer_id = e26fc07e-df65-4167-8a2b-71e9ef4436ad
13082024-10-16T20:00:44.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80933 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42038 req_id = 2e5b1518-5ce8-42d0-b20d-8ec7aa2a0a93 response_code = 201 uri = /metrics/producers
13092024-10-16T20:00:45.432ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:61667
13102024-10-16T20:00:45.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61667 req_id = 4a356dec-910b-485b-98c3-cac83f68096a roles = RoleSet { roles: {} } uri = /metrics/producers
13112024-10-16T20:00:45.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61667 req_id = 4a356dec-910b-485b-98c3-cac83f68096a resource = Database result = Ok(()) uri = /metrics/producers
13122024-10-16T20:00:45.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 79bb21fc-b004-4b3c-96d0-73dc09312c86 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13132024-10-16T20:00:45.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 79bb21fc-b004-4b3c-96d0-73dc09312c86 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13142024-10-16T20:00:45.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 79bb21fc-b004-4b3c-96d0-73dc09312c86 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13152024-10-16T20:00:45.497ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = f3710494-36b7-4736-839b-65e01f5ecb38
13162024-10-16T20:00:45.497ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 uri = http://[fd00:1122:3344:101::d]:12223/producers
13172024-10-16T20:00:45.497ZDEBGnexus: client response oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "b26519c6-8d80-459a-86ed-3a33ce1837fe", "date": "Wed, 16 Oct 2024 20:00:44 GMT"} })
13182024-10-16T20:00:45.497ZINFOnexus: assigned collector to new producer collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 file = nexus/src/app/oximeter.rs:133 producer_id = 9ecefdc7-360a-479c-989e-70367afe1460
13192024-10-16T20:00:45.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66489 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61667 req_id = 4a356dec-910b-485b-98c3-cac83f68096a response_code = 201 uri = /metrics/producers
13202024-10-16T20:00:46.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c22c39b4-407e-4bba-b6a4-099c6abb967d roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13212024-10-16T20:00:46.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c22c39b4-407e-4bba-b6a4-099c6abb967d resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13222024-10-16T20:00:46.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c22c39b4-407e-4bba-b6a4-099c6abb967d response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13232024-10-16T20:00:46.469ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1307 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 60016166-32eb-424e-a743-2588f0aaf741 response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
13242024-10-16T20:00:47.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d45d232c-9fc7-4003-bcc4-b6649c4637d6 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13252024-10-16T20:00:47.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d45d232c-9fc7-4003-bcc4-b6649c4637d6 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13262024-10-16T20:00:47.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d45d232c-9fc7-4003-bcc4-b6649c4637d6 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13272024-10-16T20:00:48.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a71dee9e-09db-451d-bebe-10b65cf868c3 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13282024-10-16T20:00:48.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a71dee9e-09db-451d-bebe-10b65cf868c3 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13292024-10-16T20:00:48.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a71dee9e-09db-451d-bebe-10b65cf868c3 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13302024-10-16T20:00:49.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f3011630-9d8d-422d-8269-f1c5a788c419 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13312024-10-16T20:00:49.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f3011630-9d8d-422d-8269-f1c5a788c419 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13322024-10-16T20:00:49.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f3011630-9d8d-422d-8269-f1c5a788c419 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13332024-10-16T20:00:50.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 30fd6286-e250-44ae-94f3-36ad337f2964 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13342024-10-16T20:00:50.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 30fd6286-e250-44ae-94f3-36ad337f2964 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13352024-10-16T20:00:50.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 30fd6286-e250-44ae-94f3-36ad337f2964 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13362024-10-16T20:00:51.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = fbfbbab8-d394-46ce-b263-6b6ac4b9b5b4 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13372024-10-16T20:00:51.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = fbfbbab8-d394-46ce-b263-6b6ac4b9b5b4 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13382024-10-16T20:00:51.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = fbfbbab8-d394-46ce-b263-6b6ac4b9b5b4 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13392024-10-16T20:00:52.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0c5252cf-6ab8-404b-8d6c-6d531c4111f8 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13402024-10-16T20:00:52.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0c5252cf-6ab8-404b-8d6c-6d531c4111f8 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13412024-10-16T20:00:52.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0c5252cf-6ab8-404b-8d6c-6d531c4111f8 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13422024-10-16T20:00:53.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0a9c0553-825d-4442-9911-148a0dae249b roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13432024-10-16T20:00:53.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0a9c0553-825d-4442-9911-148a0dae249b resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13442024-10-16T20:00:53.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0a9c0553-825d-4442-9911-148a0dae249b response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13452024-10-16T20:00:54.007ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
13462024-10-16T20:00:54.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
13472024-10-16T20:00:54.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13482024-10-16T20:00:54.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13492024-10-16T20:00:54.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13502024-10-16T20:00:54.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13512024-10-16T20:00:54.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13522024-10-16T20:00:54.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13532024-10-16T20:00:54.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13542024-10-16T20:00:54.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13552024-10-16T20:00:54.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13562024-10-16T20:00:54.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13572024-10-16T20:00:54.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13582024-10-16T20:00:54.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13592024-10-16T20:00:54.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13602024-10-16T20:00:54.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
13612024-10-16T20:00:54.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13622024-10-16T20:00:54.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13632024-10-16T20:00:54.025ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
13642024-10-16T20:00:54.025ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.538262ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
13652024-10-16T20:00:54.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.64539ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13662024-10-16T20:00:54.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2c78d4c7-294b-4187-af2e-cf8536e1c85a roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13672024-10-16T20:00:54.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2c78d4c7-294b-4187-af2e-cf8536e1c85a resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13682024-10-16T20:00:54.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2c78d4c7-294b-4187-af2e-cf8536e1c85a response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13692024-10-16T20:00:55.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1a5977dd-f350-4011-9222-177e2465e947 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13702024-10-16T20:00:55.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1a5977dd-f350-4011-9222-177e2465e947 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13712024-10-16T20:00:55.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1a5977dd-f350-4011-9222-177e2465e947 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13722024-10-16T20:00:56.468ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1333 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 12b032a7-809e-4535-98fe-c0915f8e12b2 response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
13732024-10-16T20:00:56.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b29ecc4b-124a-4bb5-a0d8-1def31b8cafd roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13742024-10-16T20:00:56.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b29ecc4b-124a-4bb5-a0d8-1def31b8cafd resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13752024-10-16T20:00:56.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b29ecc4b-124a-4bb5-a0d8-1def31b8cafd response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13762024-10-16T20:00:57.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 63881949-cc2a-488e-9c58-35252bfd0a33 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13772024-10-16T20:00:57.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 63881949-cc2a-488e-9c58-35252bfd0a33 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13782024-10-16T20:00:57.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 63881949-cc2a-488e-9c58-35252bfd0a33 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13792024-10-16T20:00:58.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bc125f7d-a027-403f-98cd-96ffd7c1b9cd roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13802024-10-16T20:00:58.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bc125f7d-a027-403f-98cd-96ffd7c1b9cd resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13812024-10-16T20:00:58.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bc125f7d-a027-403f-98cd-96ffd7c1b9cd response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13822024-10-16T20:00:59.598ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33796
13832024-10-16T20:00:59.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 196ff86e-9683-4437-8316-dbdced99a3f4 roles = RoleSet { roles: {} } uri = /metrics/producers
13842024-10-16T20:00:59.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 196ff86e-9683-4437-8316-dbdced99a3f4 resource = Database result = Ok(()) uri = /metrics/producers
13852024-10-16T20:00:59.644ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = f3710494-36b7-4736-839b-65e01f5ecb38
13862024-10-16T20:00:59.644ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 uri = http://[fd00:1122:3344:101::d]:12223/producers
13872024-10-16T20:00:59.644ZDEBGnexus: client response oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "e8b9d60f-621c-4f2e-9687-9b22f7fd98f5", "date": "Wed, 16 Oct 2024 20:00:59 GMT"} })
13882024-10-16T20:00:59.644ZINFOnexus: assigned collector to new producer collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 file = nexus/src/app/oximeter.rs:133 producer_id = 5568e46c-4ddc-497d-92ff-f8cf9b100a08
13892024-10-16T20:00:59.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46941 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33796 req_id = 196ff86e-9683-4437-8316-dbdced99a3f4 response_code = 201 uri = /metrics/producers
13902024-10-16T20:00:59.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ac1e440e-db69-467f-a860-c3fec218781f roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13912024-10-16T20:00:59.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ac1e440e-db69-467f-a860-c3fec218781f resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13922024-10-16T20:00:59.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ac1e440e-db69-467f-a860-c3fec218781f response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13932024-10-16T20:01:00.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f4d5ab22-2a1f-4b9c-8f38-529cd2809098 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13942024-10-16T20:01:00.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f4d5ab22-2a1f-4b9c-8f38-529cd2809098 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13952024-10-16T20:01:00.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f4d5ab22-2a1f-4b9c-8f38-529cd2809098 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13962024-10-16T20:01:01.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a73db16b-f17c-416b-af76-89a174747f99 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13972024-10-16T20:01:01.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a73db16b-f17c-416b-af76-89a174747f99 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13982024-10-16T20:01:01.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a73db16b-f17c-416b-af76-89a174747f99 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
13992024-10-16T20:01:02.785ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:57341
14002024-10-16T20:01:02.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57341 req_id = 98e4aa02-0e9c-4bdf-b394-f51a5769ceda roles = RoleSet { roles: {} } uri = /metrics/producers
14012024-10-16T20:01:02.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57341 req_id = 98e4aa02-0e9c-4bdf-b394-f51a5769ceda resource = Database result = Ok(()) uri = /metrics/producers
14022024-10-16T20:01:02.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5ac6ea35-6e68-45bb-9938-8a7415190520 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14032024-10-16T20:01:02.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5ac6ea35-6e68-45bb-9938-8a7415190520 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14042024-10-16T20:01:02.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 5ac6ea35-6e68-45bb-9938-8a7415190520 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14052024-10-16T20:01:02.830ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = f3710494-36b7-4736-839b-65e01f5ecb38
14062024-10-16T20:01:02.830ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 uri = http://[fd00:1122:3344:101::d]:12223/producers
14072024-10-16T20:01:02.830ZDEBGnexus: client response oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "7a12334e-8cdd-4061-bbad-b33ea8b5b333", "date": "Wed, 16 Oct 2024 20:01:02 GMT"} })
14082024-10-16T20:01:02.830ZINFOnexus: assigned collector to new producer collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 file = nexus/src/app/oximeter.rs:133 producer_id = 61f9bbef-0d96-41e7-9789-c75317fc45f9
14092024-10-16T20:01:02.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47957 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57341 req_id = 98e4aa02-0e9c-4bdf-b394-f51a5769ceda response_code = 201 uri = /metrics/producers
14102024-10-16T20:01:03.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7f8d416c-9467-455b-ad84-4978f8fa0f34 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14112024-10-16T20:01:03.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7f8d416c-9467-455b-ad84-4978f8fa0f34 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14122024-10-16T20:01:03.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7f8d416c-9467-455b-ad84-4978f8fa0f34 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14132024-10-16T20:01:04.007ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
14142024-10-16T20:01:04.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
14152024-10-16T20:01:04.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14162024-10-16T20:01:04.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14172024-10-16T20:01:04.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14182024-10-16T20:01:04.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14192024-10-16T20:01:04.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14202024-10-16T20:01:04.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212024-10-16T20:01:04.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14222024-10-16T20:01:04.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.653203ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14232024-10-16T20:01:04.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14242024-10-16T20:01:04.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14252024-10-16T20:01:04.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14262024-10-16T20:01:04.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14272024-10-16T20:01:04.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14282024-10-16T20:01:04.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14292024-10-16T20:01:04.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
14302024-10-16T20:01:04.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14312024-10-16T20:01:04.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14322024-10-16T20:01:04.027ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
14332024-10-16T20:01:04.027ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.356837ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
14342024-10-16T20:01:04.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8903c5ca-ab4c-4605-9313-28e77b1554ca roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14352024-10-16T20:01:04.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8903c5ca-ab4c-4605-9313-28e77b1554ca resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14362024-10-16T20:01:04.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8903c5ca-ab4c-4605-9313-28e77b1554ca response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14372024-10-16T20:01:05.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 5f04709e-f090-4c3b-93e7-7f6ed051eb58 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
14382024-10-16T20:01:05.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 5f04709e-f090-4c3b-93e7-7f6ed051eb58 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
14392024-10-16T20:01:05.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 5f04709e-f090-4c3b-93e7-7f6ed051eb58 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
14402024-10-16T20:01:05.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2aaf4e19-1732-497d-aeb2-c4ebe70454b9 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14412024-10-16T20:01:05.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2aaf4e19-1732-497d-aeb2-c4ebe70454b9 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14422024-10-16T20:01:05.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2aaf4e19-1732-497d-aeb2-c4ebe70454b9 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14432024-10-16T20:01:06.468ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 1b2d8f47-f1f1-421d-8111-580bd78e0c74 response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
14442024-10-16T20:01:06.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 17cf6f53-8313-47df-b165-acb02cf18b01 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14452024-10-16T20:01:06.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 17cf6f53-8313-47df-b165-acb02cf18b01 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14462024-10-16T20:01:06.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2624 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 17cf6f53-8313-47df-b165-acb02cf18b01 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14472024-10-16T20:01:07.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 16c9a862-86af-410c-802a-a0bf799d699e roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14482024-10-16T20:01:07.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 16c9a862-86af-410c-802a-a0bf799d699e resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14492024-10-16T20:01:07.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 16c9a862-86af-410c-802a-a0bf799d699e response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14502024-10-16T20:01:08.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 428edcc5-289d-4ef0-a2c1-92a2f301bdc4 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14512024-10-16T20:01:08.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 428edcc5-289d-4ef0-a2c1-92a2f301bdc4 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14522024-10-16T20:01:08.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 428edcc5-289d-4ef0-a2c1-92a2f301bdc4 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14532024-10-16T20:01:09.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 59f1824a-bf3c-4099-89e7-294db04c36ac roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14542024-10-16T20:01:09.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 59f1824a-bf3c-4099-89e7-294db04c36ac resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14552024-10-16T20:01:09.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 59f1824a-bf3c-4099-89e7-294db04c36ac response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14562024-10-16T20:01:10.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 4341b410-3106-44fe-928e-4e4b3a08bc02 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14572024-10-16T20:01:10.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 4341b410-3106-44fe-928e-4e4b3a08bc02 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14582024-10-16T20:01:10.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 4341b410-3106-44fe-928e-4e4b3a08bc02 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14592024-10-16T20:01:11.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 374c28b7-3b8e-4b5b-a8a4-09998633308d roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14602024-10-16T20:01:12.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 374c28b7-3b8e-4b5b-a8a4-09998633308d resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14612024-10-16T20:01:12.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 374c28b7-3b8e-4b5b-a8a4-09998633308d response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14622024-10-16T20:01:13.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 21dd1a0e-ede4-42d5-9436-f08bea08e2ae roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14632024-10-16T20:01:13.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 21dd1a0e-ede4-42d5-9436-f08bea08e2ae resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14642024-10-16T20:01:13.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 21dd1a0e-ede4-42d5-9436-f08bea08e2ae response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
14652024-10-16T20:01:13.869ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
14662024-10-16T20:01:13.869ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14672024-10-16T20:01:13.869ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
14682024-10-16T20:01:13.869ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14692024-10-16T20:01:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14702024-10-16T20:01:13.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14712024-10-16T20:01:13.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4819, tv_nsec: 865987202 } })
14722024-10-16T20:01:13.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1066
14732024-10-16T20:01:13.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4819, tv_nsec: 866543424 } })
14742024-10-16T20:01:13.872ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1066
14752024-10-16T20:01:13.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
14762024-10-16T20:01:13.937ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14772024-10-16T20:01:13.937ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33928f7f-60d6-4dd1-916e-7c13cdecaea8", "content-length": "26", "date": "Wed, 16 Oct 2024 20:01:13 GMT"} })
14782024-10-16T20:01:13.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14792024-10-16T20:01:13.937ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
14802024-10-16T20:01:13.937ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14812024-10-16T20:01:13.938ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aced4cf3-742b-4789-8729-9c383d79a8eb", "content-length": "26", "date": "Wed, 16 Oct 2024 20:01:13 GMT"} })
14822024-10-16T20:01:13.938ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14832024-10-16T20:01:13.938ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14842024-10-16T20:01:13.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14852024-10-16T20:01:14.000ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14862024-10-16T20:01:14.000ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 131.445135ms iteration = 12 status = {}
14872024-10-16T20:01:14.000ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7463630-8225-4680-bd20-c713c8c300de", "content-length": "2", "date": "Wed, 16 Oct 2024 20:01:13 GMT"} })
14882024-10-16T20:01:14.002ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14892024-10-16T20:01:14.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14902024-10-16T20:01:14.004ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 135.563839ms iteration = 12 status = null
14912024-10-16T20:01:14.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
14922024-10-16T20:01:14.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
14932024-10-16T20:01:14.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14942024-10-16T20:01:14.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.631\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
14952024-10-16T20:01:14.006ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
14962024-10-16T20:01:14.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14972024-10-16T20:01:14.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14982024-10-16T20:01:14.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14992024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
15002024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15012024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
15022024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15032024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15042024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
15052024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
15062024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.15\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
15072024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
15082024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15092024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.38\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15102024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
15112024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
15122024-10-16T20:01:14.007ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15132024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.91\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15142024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15152024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
15162024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
15172024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
15182024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15192024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15202024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
15212024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
15222024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15232024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15242024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15252024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15262024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15272024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15282024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15292024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15302024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15312024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15322024-10-16T20:01:14.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15332024-10-16T20:01:14.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15342024-10-16T20:01:14.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15352024-10-16T20:01:14.009ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.473706ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15362024-10-16T20:01:14.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15372024-10-16T20:01:14.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15382024-10-16T20:01:14.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15392024-10-16T20:01:14.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15402024-10-16T20:01:14.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15412024-10-16T20:01:14.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15422024-10-16T20:01:14.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15432024-10-16T20:01:14.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15442024-10-16T20:01:14.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15452024-10-16T20:01:14.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-10-16T20:01:14.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-10-16T20:01:14.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15482024-10-16T20:01:14.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15492024-10-16T20:01:14.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15502024-10-16T20:01:14.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15512024-10-16T20:01:14.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15522024-10-16T20:01:14.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15532024-10-16T20:01:14.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15542024-10-16T20:01:14.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15552024-10-16T20:01:14.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15562024-10-16T20:01:14.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15572024-10-16T20:01:14.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15582024-10-16T20:01:14.017ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15592024-10-16T20:01:14.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15602024-10-16T20:01:14.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15612024-10-16T20:01:14.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.677327ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15622024-10-16T20:01:14.020ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.304648ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15632024-10-16T20:01:14.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15642024-10-16T20:01:14.020ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4820, tv_nsec: 15628144 } })
15652024-10-16T20:01:14.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15662024-10-16T20:01:14.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672024-10-16T20:01:14.021ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1066 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
15682024-10-16T20:01:14.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15692024-10-16T20:01:14.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15702024-10-16T20:01:14.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15712024-10-16T20:01:14.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15722024-10-16T20:01:14.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15732024-10-16T20:01:14.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15742024-10-16T20:01:14.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15752024-10-16T20:01:14.025ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15762024-10-16T20:01:14.025ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.413372ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15772024-10-16T20:01:14.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7344dbe4-8bcf-4902-91dc-24da6cebaecc roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
15782024-10-16T20:01:14.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15792024-10-16T20:01:14.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15802024-10-16T20:01:14.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7344dbe4-8bcf-4902-91dc-24da6cebaecc resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
15812024-10-16T20:01:14.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7344dbe4-8bcf-4902-91dc-24da6cebaecc response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
15822024-10-16T20:01:14.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15832024-10-16T20:01:14.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15842024-10-16T20:01:14.048ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15852024-10-16T20:01:14.049ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15862024-10-16T20:01:14.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15872024-10-16T20:01:14.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15882024-10-16T20:01:14.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892024-10-16T20:01:14.051ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15902024-10-16T20:01:14.051ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15912024-10-16T20:01:14.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15922024-10-16T20:01:14.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15932024-10-16T20:01:14.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8219fdd9-0a75-42c9-91db-deb66a850e5b, lookup_type: ById(8219fdd9-0a75-42c9-91db-deb66a850e5b) } result = Ok(())
15942024-10-16T20:01:14.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15952024-10-16T20:01:14.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15962024-10-16T20:01:14.055ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.929059ms iteration = 12 status = 0
15972024-10-16T20:01:14.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15982024-10-16T20:01:14.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15992024-10-16T20:01:14.056ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1074 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 zone_address = fd00:1122:3344:101::2
16002024-10-16T20:01:14.056ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16012024-10-16T20:01:14.056ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e241905-2a8b-4cef-b669-1d5903efdcfb", "content-length": "26", "date": "Wed, 16 Oct 2024 20:01:13 GMT"} })
16022024-10-16T20:01:14.056ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1079 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16032024-10-16T20:01:14.057ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
16042024-10-16T20:01:14.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16052024-10-16T20:01:14.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16062024-10-16T20:01:14.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16072024-10-16T20:01:14.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
16082024-10-16T20:01:14.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16092024-10-16T20:01:14.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16102024-10-16T20:01:14.069ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
16112024-10-16T20:01:14.069ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.408831ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
16122024-10-16T20:01:14.082ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16132024-10-16T20:01:14.082ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16142024-10-16T20:01:14.082ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 75.623785ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16152024-10-16T20:01:14.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16162024-10-16T20:01:14.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16172024-10-16T20:01:14.143ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16182024-10-16T20:01:14.143ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16192024-10-16T20:01:14.143ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "04a6f09f-39a2-480c-a500-c06d2578a772", "content-length": "372", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16202024-10-16T20:01:14.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16212024-10-16T20:01:14.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16222024-10-16T20:01:14.149ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.966956ms iteration = 15 status = {"physical_disks_added":0}
16232024-10-16T20:01:14.161ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16242024-10-16T20:01:14.161ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16252024-10-16T20:01:14.161ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "647f956f-441a-4176-9317-cca584bf38e7", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16262024-10-16T20:01:14.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16272024-10-16T20:01:14.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16282024-10-16T20:01:14.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16292024-10-16T20:01:14.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16302024-10-16T20:01:14.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16312024-10-16T20:01:14.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16322024-10-16T20:01:14.173ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16332024-10-16T20:01:14.173ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16342024-10-16T20:01:14.173ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0c878508-902f-4597-8907-e62097f8742b", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16352024-10-16T20:01:14.175ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 167.8435ms iteration = 14 status = {}
16362024-10-16T20:01:14.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16372024-10-16T20:01:14.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16382024-10-16T20:01:14.193ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66211944-054d-446c-afc3-b1a33ad80dff, rack_id: dbc07659-6078-4fa6-9892-1d25efe44b81, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c33f3d0a-20b1-42d9-bb7b-a442a73c3582) } rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
16392024-10-16T20:01:14.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16402024-10-16T20:01:14.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16412024-10-16T20:01:14.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16422024-10-16T20:01:14.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16432024-10-16T20:01:14.202ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16442024-10-16T20:01:14.202ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "552afbe3-70ad-4e85-9cb4-cc9acbf79ed9", "content-length": "121", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16452024-10-16T20:01:14.202ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
16462024-10-16T20:01:14.202ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c33f3d0a-20b1-42d9-bb7b-a442a73c3582
16472024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16482024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16492024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16502024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16512024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16522024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16532024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16542024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16552024-10-16T20:01:14.203ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
16562024-10-16T20:01:14.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16572024-10-16T20:01:14.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16582024-10-16T20:01:14.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592024-10-16T20:01:14.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16602024-10-16T20:01:14.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16612024-10-16T20:01:14.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16622024-10-16T20:01:14.205ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16632024-10-16T20:01:14.205ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9022e567-f0c8-4820-8697-8e3ab4caaf37", "content-length": "2", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16642024-10-16T20:01:14.205ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16652024-10-16T20:01:14.205ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0477558e-5614-41b3-bd0f-34b178cff4f1", "content-length": "52", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16662024-10-16T20:01:14.205ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
16672024-10-16T20:01:14.205ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16682024-10-16T20:01:14.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16692024-10-16T20:01:14.208ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16702024-10-16T20:01:14.208ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16712024-10-16T20:01:14.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16722024-10-16T20:01:14.240ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16732024-10-16T20:01:14.294ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0b6ab02f-880d-4e31-b2aa-3466283ab3d2", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16742024-10-16T20:01:14.294ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch = Switch0
16752024-10-16T20:01:14.294ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16762024-10-16T20:01:14.294ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1770c53-926f-4767-b3f3-6de47915c670", "content-length": "691", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16772024-10-16T20:01:14.294ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
16782024-10-16T20:01:14.294ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
16792024-10-16T20:01:14.294ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
16802024-10-16T20:01:14.294ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "17f99b9c-c746-40b2-91da-582abc967e39", "content-length": "669", "date": "Wed, 16 Oct 2024 20:01:14 GMT"} })
16812024-10-16T20:01:14.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16822024-10-16T20:01:14.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16832024-10-16T20:01:14.295ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 287.946214ms iteration = 13 status = {}
16842024-10-16T20:01:14.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16852024-10-16T20:01:14.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16862024-10-16T20:01:14.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16872024-10-16T20:01:14.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16882024-10-16T20:01:14.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16892024-10-16T20:01:14.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16902024-10-16T20:01:14.311ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 305.451126ms iteration = 12 status = {}
16912024-10-16T20:01:15.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6cffae07-c885-4dec-bd3e-14ff24ebd411 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
16922024-10-16T20:01:15.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6cffae07-c885-4dec-bd3e-14ff24ebd411 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
16932024-10-16T20:01:15.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6cffae07-c885-4dec-bd3e-14ff24ebd411 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
16942024-10-16T20:01:16.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d1e68420-27dd-42df-9d0b-d7d49318d2bd roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
16952024-10-16T20:01:16.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d1e68420-27dd-42df-9d0b-d7d49318d2bd resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
16962024-10-16T20:01:16.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d1e68420-27dd-42df-9d0b-d7d49318d2bd response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
16972024-10-16T20:01:16.468ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1348 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = e6f62651-ddfb-47dc-93a1-7e6df79e5de9 response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
16982024-10-16T20:01:16.469ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
16992024-10-16T20:01:16.469ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
17002024-10-16T20:01:16.499ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
17012024-10-16T20:01:16.499ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:50938
17022024-10-16T20:01:16.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50938 req_id = 4570943e-2a16-42a0-af20-9242521238c9 roles = RoleSet { roles: {} } uri = /metrics/producers
17032024-10-16T20:01:16.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50938 req_id = 4570943e-2a16-42a0-af20-9242521238c9 resource = Database result = Ok(()) uri = /metrics/producers
17042024-10-16T20:01:16.543ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = f3710494-36b7-4736-839b-65e01f5ecb38
17052024-10-16T20:01:16.543ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 uri = http://[fd00:1122:3344:101::d]:12223/producers
17062024-10-16T20:01:16.543ZDEBGnexus: client response oximeter-collector = f3710494-36b7-4736-839b-65e01f5ecb38 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "7db6b00d-e357-4aa9-bca7-74405056a964", "date": "Wed, 16 Oct 2024 20:01:16 GMT"} })
17072024-10-16T20:01:16.543ZINFOnexus: assigned collector to new producer collector_id = f3710494-36b7-4736-839b-65e01f5ecb38 file = nexus/src/app/oximeter.rs:133 producer_id = bb888a52-e1f5-4893-bec6-0b8ff00c7df7
17082024-10-16T20:01:16.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45574 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:50938 req_id = 4570943e-2a16-42a0-af20-9242521238c9 response_code = 201 uri = /metrics/producers
17092024-10-16T20:01:16.545ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4570943e-2a16-42a0-af20-9242521238c9", "content-length": "41", "date": "Wed, 16 Oct 2024 20:01:16 GMT"} })
17102024-10-16T20:01:16.546ZDEBGnexus (producer-registration-task): registered with nexus successfully
17112024-10-16T20:01:16.546ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
17122024-10-16T20:01:17.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 05dca9bd-3b7a-4482-8561-e27b503fedc8 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17132024-10-16T20:01:17.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 05dca9bd-3b7a-4482-8561-e27b503fedc8 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17142024-10-16T20:01:17.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 05dca9bd-3b7a-4482-8561-e27b503fedc8 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17152024-10-16T20:01:18.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 046e6954-da8a-4098-8dd1-2922900f8747 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17162024-10-16T20:01:18.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 046e6954-da8a-4098-8dd1-2922900f8747 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17172024-10-16T20:01:18.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1987 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 046e6954-da8a-4098-8dd1-2922900f8747 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17182024-10-16T20:01:19.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 9b9c6ae1-d3d7-42c1-a9fd-5588efa73101 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17192024-10-16T20:01:19.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 9b9c6ae1-d3d7-42c1-a9fd-5588efa73101 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17202024-10-16T20:01:19.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 9b9c6ae1-d3d7-42c1-a9fd-5588efa73101 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17212024-10-16T20:01:20.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f1e0adc7-9ac2-4cac-9f2c-e2c5c35d42e3 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17222024-10-16T20:01:20.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f1e0adc7-9ac2-4cac-9f2c-e2c5c35d42e3 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17232024-10-16T20:01:20.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f1e0adc7-9ac2-4cac-9f2c-e2c5c35d42e3 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17242024-10-16T20:01:21.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b6a7709a-52d7-4dda-8a8b-3dd79681fddb roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17252024-10-16T20:01:21.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b6a7709a-52d7-4dda-8a8b-3dd79681fddb resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17262024-10-16T20:01:21.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b6a7709a-52d7-4dda-8a8b-3dd79681fddb response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17272024-10-16T20:01:22.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 434ff1ad-081d-4728-bf18-4af514b10d27 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17282024-10-16T20:01:22.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 434ff1ad-081d-4728-bf18-4af514b10d27 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17292024-10-16T20:01:22.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 434ff1ad-081d-4728-bf18-4af514b10d27 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17302024-10-16T20:01:23.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0bbffeb0-4a02-43cd-b048-3bc130907b08 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17312024-10-16T20:01:23.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0bbffeb0-4a02-43cd-b048-3bc130907b08 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17322024-10-16T20:01:23.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0bbffeb0-4a02-43cd-b048-3bc130907b08 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17332024-10-16T20:01:24.006ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
17342024-10-16T20:01:24.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
17352024-10-16T20:01:24.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17362024-10-16T20:01:24.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17372024-10-16T20:01:24.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17382024-10-16T20:01:24.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17392024-10-16T20:01:24.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402024-10-16T20:01:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17412024-10-16T20:01:24.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17422024-10-16T20:01:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17432024-10-16T20:01:24.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17442024-10-16T20:01:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17452024-10-16T20:01:24.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17462024-10-16T20:01:24.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
17472024-10-16T20:01:24.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17482024-10-16T20:01:24.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17492024-10-16T20:01:24.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
17502024-10-16T20:01:24.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.556662ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
17512024-10-16T20:01:24.033ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17522024-10-16T20:01:24.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17532024-10-16T20:01:24.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.88748ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17542024-10-16T20:01:24.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = effe356c-12e1-4e44-aba3-0ee717e237b5 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17552024-10-16T20:01:24.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = effe356c-12e1-4e44-aba3-0ee717e237b5 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17562024-10-16T20:01:24.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = effe356c-12e1-4e44-aba3-0ee717e237b5 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17572024-10-16T20:01:25.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2e346d75-a758-4502-adc8-bd1d32b08ec1 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17582024-10-16T20:01:25.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2e346d75-a758-4502-adc8-bd1d32b08ec1 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17592024-10-16T20:01:25.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2353 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 2e346d75-a758-4502-adc8-bd1d32b08ec1 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17602024-10-16T20:01:26.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d6a5a77a-3058-4b55-a853-631d115750c7 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17612024-10-16T20:01:26.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d6a5a77a-3058-4b55-a853-631d115750c7 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17622024-10-16T20:01:26.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d6a5a77a-3058-4b55-a853-631d115750c7 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17632024-10-16T20:01:26.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1451 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 04f5ce46-5c92-46ba-8e7a-1470f314435a response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
17642024-10-16T20:01:27.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 82addb5e-ba85-41ca-adf1-67ca22233723 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17652024-10-16T20:01:27.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 82addb5e-ba85-41ca-adf1-67ca22233723 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17662024-10-16T20:01:27.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 82addb5e-ba85-41ca-adf1-67ca22233723 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17672024-10-16T20:01:28.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = de180a35-5195-426a-ab51-747415b00949 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17682024-10-16T20:01:28.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = de180a35-5195-426a-ab51-747415b00949 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17692024-10-16T20:01:28.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = de180a35-5195-426a-ab51-747415b00949 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17702024-10-16T20:01:29.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = db991d68-a276-4840-9a34-bb510ee3db8a roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17712024-10-16T20:01:29.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = db991d68-a276-4840-9a34-bb510ee3db8a resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17722024-10-16T20:01:29.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = db991d68-a276-4840-9a34-bb510ee3db8a response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17732024-10-16T20:01:30.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3e7d583d-d695-47e3-a8e5-6ad27f6b1a65 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17742024-10-16T20:01:30.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3e7d583d-d695-47e3-a8e5-6ad27f6b1a65 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17752024-10-16T20:01:30.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3e7d583d-d695-47e3-a8e5-6ad27f6b1a65 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17762024-10-16T20:01:31.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1ce4ba6d-63a8-4dec-a219-ef7c0935bf8d roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17772024-10-16T20:01:31.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1ce4ba6d-63a8-4dec-a219-ef7c0935bf8d resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17782024-10-16T20:01:31.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1ce4ba6d-63a8-4dec-a219-ef7c0935bf8d response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17792024-10-16T20:01:32.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 781980db-cdf4-4b8f-9cfa-44271feee0dd roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17802024-10-16T20:01:32.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 781980db-cdf4-4b8f-9cfa-44271feee0dd resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17812024-10-16T20:01:32.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 781980db-cdf4-4b8f-9cfa-44271feee0dd response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17822024-10-16T20:01:33.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 81c67b07-b758-48b4-aba6-92aeeb079a41 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17832024-10-16T20:01:33.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 81c67b07-b758-48b4-aba6-92aeeb079a41 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17842024-10-16T20:01:33.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 81c67b07-b758-48b4-aba6-92aeeb079a41 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
17852024-10-16T20:01:34.007ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
17862024-10-16T20:01:34.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
17872024-10-16T20:01:34.007ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17882024-10-16T20:01:34.007ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17892024-10-16T20:01:34.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17902024-10-16T20:01:34.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17912024-10-16T20:01:34.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17922024-10-16T20:01:34.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17932024-10-16T20:01:34.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17942024-10-16T20:01:34.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17952024-10-16T20:01:34.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17962024-10-16T20:01:34.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17972024-10-16T20:01:34.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17982024-10-16T20:01:34.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17992024-10-16T20:01:34.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002024-10-16T20:01:34.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
18012024-10-16T20:01:34.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18022024-10-16T20:01:34.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18032024-10-16T20:01:34.026ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
18042024-10-16T20:01:34.026ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.505705ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
18052024-10-16T20:01:34.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.805083ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18062024-10-16T20:01:34.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ddeb591e-56a2-4159-8af4-714185398d15 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18072024-10-16T20:01:34.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ddeb591e-56a2-4159-8af4-714185398d15 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18082024-10-16T20:01:34.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = ddeb591e-56a2-4159-8af4-714185398d15 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18092024-10-16T20:01:35.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 2e280a0f-fc9b-45e6-827f-85772844b429 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
18102024-10-16T20:01:35.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 2e280a0f-fc9b-45e6-827f-85772844b429 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
18112024-10-16T20:01:35.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 2e280a0f-fc9b-45e6-827f-85772844b429 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
18122024-10-16T20:01:35.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a1be9081-2992-4d7c-8688-92662e74bf3b roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18132024-10-16T20:01:35.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a1be9081-2992-4d7c-8688-92662e74bf3b resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18142024-10-16T20:01:35.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a1be9081-2992-4d7c-8688-92662e74bf3b response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18152024-10-16T20:01:36.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 4e3c0282-6868-4f11-9978-5b28a39cc435 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18162024-10-16T20:01:36.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 4e3c0282-6868-4f11-9978-5b28a39cc435 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18172024-10-16T20:01:36.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 4e3c0282-6868-4f11-9978-5b28a39cc435 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18182024-10-16T20:01:36.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1447 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 2471e23b-1c18-4ccb-909f-f6e4e680f472 response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
18192024-10-16T20:01:37.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b592090d-e3a8-45ab-8b83-9f05a021ba77 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18202024-10-16T20:01:37.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b592090d-e3a8-45ab-8b83-9f05a021ba77 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18212024-10-16T20:01:37.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2645 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b592090d-e3a8-45ab-8b83-9f05a021ba77 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18222024-10-16T20:01:38.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = af39f51d-de25-46ca-bc5f-c9f6eb079164 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18232024-10-16T20:01:38.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = af39f51d-de25-46ca-bc5f-c9f6eb079164 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18242024-10-16T20:01:38.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2471 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = af39f51d-de25-46ca-bc5f-c9f6eb079164 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18252024-10-16T20:01:39.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f89f021e-f6f1-4e79-83c3-6081b2e51cfe roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18262024-10-16T20:01:39.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f89f021e-f6f1-4e79-83c3-6081b2e51cfe resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18272024-10-16T20:01:39.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f89f021e-f6f1-4e79-83c3-6081b2e51cfe response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18282024-10-16T20:01:40.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c27778fe-210c-4946-b346-1ef00de5a595 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18292024-10-16T20:01:40.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c27778fe-210c-4946-b346-1ef00de5a595 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18302024-10-16T20:01:40.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c27778fe-210c-4946-b346-1ef00de5a595 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18312024-10-16T20:01:41.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f55f2f3b-a437-47ce-99e1-780bb33f12bf roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18322024-10-16T20:01:41.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f55f2f3b-a437-47ce-99e1-780bb33f12bf resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18332024-10-16T20:01:41.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f55f2f3b-a437-47ce-99e1-780bb33f12bf response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18342024-10-16T20:01:42.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 9dfb3cdd-7885-491b-9865-2ccdcebd9e81 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18352024-10-16T20:01:42.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 9dfb3cdd-7885-491b-9865-2ccdcebd9e81 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18362024-10-16T20:01:42.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 9dfb3cdd-7885-491b-9865-2ccdcebd9e81 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18372024-10-16T20:01:43.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f40eea97-85e2-42c5-bf92-ace49a1c9e1d roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18382024-10-16T20:01:43.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f40eea97-85e2-42c5-bf92-ace49a1c9e1d resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18392024-10-16T20:01:43.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f40eea97-85e2-42c5-bf92-ace49a1c9e1d response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
18402024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
18412024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
18422024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
18432024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18442024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18452024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
18462024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
18472024-10-16T20:01:43.868ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-16 19:51:43.868576151 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18482024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
18492024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18502024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18512024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
18522024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18532024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18542024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
18552024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
18562024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18572024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
18582024-10-16T20:01:43.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18592024-10-16T20:01:43.869ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7eaa8248-3c51-4c26-80cb-61296f525a84.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f0230ae5-ea49-40dd-a6ee-3123741a5ad1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f0230ae5-ea49-40dd-a6ee-3123741a5ad1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 4849, tv_nsec: 864227940 } })
18602024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18612024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18622024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18632024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18642024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18652024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18662024-10-16T20:01:43.869ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("10b74d3e-6165-421b-9b1c-d25aa0300fac.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("acd61760-31de-4024-8375-b671bb18b6bf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd72e5f8-d0ea-4356-91b4-5a51d2a67d6f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd72e5f8-d0ea-4356-91b4-5a51d2a67d6f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 4849, tv_nsec: 864347753 } })
18672024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
18682024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 944.902\u{b5}s iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
18692024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
18702024-10-16T20:01:43.869ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.122595ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
18712024-10-16T20:01:43.871ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4849, tv_nsec: 866665496 } })
18722024-10-16T20:01:43.871ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-16 19:51:43.868576151 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18732024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.001109ms iteration = 7 status = {"expiration":"2024-10-16T19:51:43.868576151Z","pruned":[]}
18742024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
18752024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18762024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18772024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
18782024-10-16T20:01:43.871ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21
18792024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.36\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21"}
18802024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
18812024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
18822024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18832024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
18842024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
18852024-10-16T20:01:43.871ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18862024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18872024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18882024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18892024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18902024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18912024-10-16T20:01:43.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1066
18922024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18932024-10-16T20:01:43.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18942024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18952024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18962024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18972024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18982024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18992024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19002024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19012024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19022024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19032024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19042024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19052024-10-16T20:01:43.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19062024-10-16T20:01:43.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19072024-10-16T20:01:43.873ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4849, tv_nsec: 868596980 } })
19082024-10-16T20:01:43.873ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1066
19092024-10-16T20:01:43.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19102024-10-16T20:01:43.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19112024-10-16T20:01:43.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19122024-10-16T20:01:43.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19132024-10-16T20:01:43.876ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19142024-10-16T20:01:43.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19152024-10-16T20:01:43.877ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.67477ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
19162024-10-16T20:01:43.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19172024-10-16T20:01:43.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-10-16T20:01:43.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
19192024-10-16T20:01:43.879ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19202024-10-16T20:01:43.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19212024-10-16T20:01:43.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19222024-10-16T20:01:43.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19232024-10-16T20:01:43.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19242024-10-16T20:01:43.880ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19252024-10-16T20:01:43.880ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19262024-10-16T20:01:43.880ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.7114ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19272024-10-16T20:01:43.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282024-10-16T20:01:43.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19292024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19302024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19312024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19322024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19332024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19342024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19352024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19362024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19372024-10-16T20:01:43.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19382024-10-16T20:01:43.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19392024-10-16T20:01:43.884ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19402024-10-16T20:01:43.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19412024-10-16T20:01:43.885ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19422024-10-16T20:01:43.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19432024-10-16T20:01:43.887ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19442024-10-16T20:01:43.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19452024-10-16T20:01:43.887ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19462024-10-16T20:01:43.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19472024-10-16T20:01:43.889ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19482024-10-16T20:01:43.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19492024-10-16T20:01:43.890ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19502024-10-16T20:01:43.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19512024-10-16T20:01:43.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19522024-10-16T20:01:43.893ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 22.193279ms iteration = 4 status = {"nsuccess":5}
19532024-10-16T20:01:43.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542024-10-16T20:01:43.895ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19552024-10-16T20:01:43.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19562024-10-16T20:01:43.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19572024-10-16T20:01:43.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19582024-10-16T20:01:43.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19592024-10-16T20:01:43.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19602024-10-16T20:01:43.898ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19612024-10-16T20:01:43.898ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 11536a5a-1133-48e5-a207-83092315920d dns_zone_name = oxide.test found_so_far = 0 version = 2
19622024-10-16T20:01:43.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19632024-10-16T20:01:43.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19642024-10-16T20:01:43.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19652024-10-16T20:01:43.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19662024-10-16T20:01:43.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19672024-10-16T20:01:43.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19682024-10-16T20:01:43.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19692024-10-16T20:01:43.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19702024-10-16T20:01:43.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19712024-10-16T20:01:43.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19722024-10-16T20:01:43.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19732024-10-16T20:01:43.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19742024-10-16T20:01:43.906ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 11536a5a-1133-48e5-a207-83092315920d dns_zone_name = oxide.test found_so_far = 1 version = 2
19752024-10-16T20:01:43.907ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
19762024-10-16T20:01:43.907ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-16 19:56:14.769900 UTC dns_group = external generation = 2
19772024-10-16T20:01:43.907ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 38.424581ms iteration = 8 status = {"generation":2}
19782024-10-16T20:01:43.912ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19792024-10-16T20:01:43.912ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19802024-10-16T20:01:43.912ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19812024-10-16T20:01:43.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19822024-10-16T20:01:43.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19832024-10-16T20:01:43.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19842024-10-16T20:01:43.918ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19852024-10-16T20:01:43.918ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19862024-10-16T20:01:43.918ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 46.862785ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19872024-10-16T20:01:43.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19882024-10-16T20:01:43.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19892024-10-16T20:01:43.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19902024-10-16T20:01:43.963ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-16T19:55:41.523549Z, time_modified: 2024-10-16T19:55:41.523549Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, db_silo: Silo { identity: SiloIdentity { id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-16T19:56:14.712503Z, time_modified: 2024-10-16T19:56:14.712503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d9557d3f8c1e45f833d66c20e7d222f3a136fcb2ae53fec6ded640f0af43d6dc" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, db_silo: Silo { identity: SiloIdentity { id: fcb878a2-735b-4f01-9b6b-44a1f7c3291d, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-16T19:56:14.712503Z, time_modified: 2024-10-16T19:56:14.712503Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "d9557d3f8c1e45f833d66c20e7d222f3a136fcb2ae53fec6ded640f0af43d6dc" }] }) }
19912024-10-16T20:01:43.963ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 94.879586ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"fcb878a2-735b-4f01-9b6b-44a1f7c3291d","tls_certs":["d9557d3f8c1e45f833d66c20e7d222f3a136fcb2ae53fec6ded640f0af43d6dc"]}},"default_endpoint":{"silo_id":"fcb878a2-735b-4f01-9b6b-44a1f7c3291d","tls_certs":["d9557d3f8c1e45f833d66c20e7d222f3a136fcb2ae53fec6ded640f0af43d6dc"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19922024-10-16T20:01:43.974ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19932024-10-16T20:01:43.974ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = d2145840-5973-4480-bc99-a5959766b75f dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19942024-10-16T20:01:43.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19952024-10-16T20:01:43.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19962024-10-16T20:01:43.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19972024-10-16T20:01:43.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19982024-10-16T20:01:43.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19992024-10-16T20:01:43.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20002024-10-16T20:01:43.979ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20012024-10-16T20:01:43.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20022024-10-16T20:01:43.981ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = d2145840-5973-4480-bc99-a5959766b75f dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
20032024-10-16T20:01:43.981ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20042024-10-16T20:01:43.981ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-16 19:56:14.256102 UTC dns_group = internal generation = 1
20052024-10-16T20:01:43.981ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 113.38329ms iteration = 8 status = {"generation":1}
20062024-10-16T20:01:43.994ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
20072024-10-16T20:01:43.994ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20082024-10-16T20:01:43.994ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5588508a-82b0-4fd1-a5d4-f81aeeb13e7f", "content-length": "26", "date": "Wed, 16 Oct 2024 20:01:43 GMT"} })
20092024-10-16T20:01:43.994ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20102024-10-16T20:01:43.996ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20112024-10-16T20:01:43.997ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
20122024-10-16T20:01:43.999ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
20132024-10-16T20:01:44.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
20142024-10-16T20:01:44.000ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20152024-10-16T20:01:44.001ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c96e281-3c11-41e2-b3b0-b449e3bf5370", "content-length": "26", "date": "Wed, 16 Oct 2024 20:01:43 GMT"} })
20162024-10-16T20:01:44.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20172024-10-16T20:01:44.002ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20182024-10-16T20:01:44.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
20192024-10-16T20:01:44.004ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.48\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
20202024-10-16T20:01:44.005ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
20212024-10-16T20:01:44.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20222024-10-16T20:01:44.005ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
20232024-10-16T20:01:44.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20242024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20252024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20262024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
20272024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
20282024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20292024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20302024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20312024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
20322024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.07\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20332024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
20342024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.17\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
20352024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
20362024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
20372024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20382024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.141\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
20392024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
20402024-10-16T20:01:44.006ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20412024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
20422024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20432024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20442024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
20452024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
20462024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
20472024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
20482024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20492024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20502024-10-16T20:01:44.006ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20512024-10-16T20:01:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20522024-10-16T20:01:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20532024-10-16T20:01:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20542024-10-16T20:01:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20552024-10-16T20:01:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20562024-10-16T20:01:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20572024-10-16T20:01:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20582024-10-16T20:01:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20592024-10-16T20:01:44.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20602024-10-16T20:01:44.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20612024-10-16T20:01:44.011ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.457842ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20622024-10-16T20:01:44.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20632024-10-16T20:01:44.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20642024-10-16T20:01:44.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20652024-10-16T20:01:44.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20662024-10-16T20:01:44.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20672024-10-16T20:01:44.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20682024-10-16T20:01:44.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20692024-10-16T20:01:44.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20702024-10-16T20:01:44.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20712024-10-16T20:01:44.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20722024-10-16T20:01:44.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20732024-10-16T20:01:44.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20742024-10-16T20:01:44.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20752024-10-16T20:01:44.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20762024-10-16T20:01:44.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20772024-10-16T20:01:44.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20782024-10-16T20:01:44.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20792024-10-16T20:01:44.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20802024-10-16T20:01:44.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20812024-10-16T20:01:44.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20822024-10-16T20:01:44.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20832024-10-16T20:01:44.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20842024-10-16T20:01:44.019ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4850, tv_nsec: 14281912 } })
20852024-10-16T20:01:44.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1066 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
20862024-10-16T20:01:44.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20872024-10-16T20:01:44.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20882024-10-16T20:01:44.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20892024-10-16T20:01:44.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20902024-10-16T20:01:44.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20912024-10-16T20:01:44.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20922024-10-16T20:01:44.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20932024-10-16T20:01:44.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20942024-10-16T20:01:44.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20952024-10-16T20:01:44.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20962024-10-16T20:01:44.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20972024-10-16T20:01:44.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20982024-10-16T20:01:44.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20992024-10-16T20:01:44.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21002024-10-16T20:01:44.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21012024-10-16T20:01:44.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21022024-10-16T20:01:44.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21032024-10-16T20:01:44.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21042024-10-16T20:01:44.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21052024-10-16T20:01:44.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21062024-10-16T20:01:44.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21072024-10-16T20:01:44.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21082024-10-16T20:01:44.059ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
21092024-10-16T20:01:44.059ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 188.387431ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
21102024-10-16T20:01:44.062ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21112024-10-16T20:01:44.062ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21122024-10-16T20:01:44.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21132024-10-16T20:01:44.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21142024-10-16T20:01:44.066ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21152024-10-16T20:01:44.068ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21162024-10-16T20:01:44.068ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.398768ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21172024-10-16T20:01:44.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
21182024-10-16T20:01:44.069ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21192024-10-16T20:01:44.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21202024-10-16T20:01:44.129ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.322496ms iteration = 16 status = {"physical_disks_added":0}
21212024-10-16T20:01:44.132ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21222024-10-16T20:01:44.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21232024-10-16T20:01:44.161ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21242024-10-16T20:01:44.161ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fb49baec-5d1e-458d-80ba-0dd96c9babb2", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21252024-10-16T20:01:44.161ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21262024-10-16T20:01:44.163ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0860ba96-84c2-4d98-8a6c-e300f323861d", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21272024-10-16T20:01:44.163ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21282024-10-16T20:01:44.164ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
21292024-10-16T20:01:44.164ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 296.105852ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21302024-10-16T20:01:44.172ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21312024-10-16T20:01:44.172ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6f106b8-815b-4bd9-898c-322983f42780", "content-length": "2", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
21322024-10-16T20:01:44.173ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
21332024-10-16T20:01:44.173ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1074 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 zone_address = fd00:1122:3344:101::2
21342024-10-16T20:01:44.173ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21352024-10-16T20:01:44.173ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21362024-10-16T20:01:44.173ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e62e686-3553-4dc3-8cfa-feebe5c6ce41", "content-length": "26", "date": "Wed, 16 Oct 2024 20:01:43 GMT"} })
21372024-10-16T20:01:44.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21382024-10-16T20:01:44.173ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1079 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21392024-10-16T20:01:44.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
21402024-10-16T20:01:44.273ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 405.043771ms iteration = 13 status = {}
21412024-10-16T20:01:44.290ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21422024-10-16T20:01:44.290ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21432024-10-16T20:01:44.290ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "65016983-dec9-47a5-b839-4322499c8c8f", "content-length": "372", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
21442024-10-16T20:01:44.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21452024-10-16T20:01:44.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21462024-10-16T20:01:44.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 285.705183ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21472024-10-16T20:01:44.294ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21482024-10-16T20:01:44.294ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21492024-10-16T20:01:44.294ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3e21b0eb-27bb-418f-bdd8-eab94dadad70", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21502024-10-16T20:01:44.294ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21512024-10-16T20:01:44.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21522024-10-16T20:01:44.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21532024-10-16T20:01:44.295ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 426.902692ms iteration = 13 status = null
21542024-10-16T20:01:44.296ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f5ecd35b-1a02-45db-b660-e194c5d2b026", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21552024-10-16T20:01:44.296ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21562024-10-16T20:01:44.296ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21572024-10-16T20:01:44.296ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21582024-10-16T20:01:44.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21592024-10-16T20:01:44.298ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "16559593-13e7-46fc-bd73-9d9c86ce7430", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21602024-10-16T20:01:44.298ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21612024-10-16T20:01:44.300ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
21622024-10-16T20:01:44.300ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 431.833535ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
21632024-10-16T20:01:44.302ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
21642024-10-16T20:01:44.302ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 295.543879ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
21652024-10-16T20:01:44.321ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 316.10007ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21662024-10-16T20:01:44.325ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21672024-10-16T20:01:44.325ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21682024-10-16T20:01:44.325ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21692024-10-16T20:01:44.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21702024-10-16T20:01:44.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21712024-10-16T20:01:44.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8219fdd9-0a75-42c9-91db-deb66a850e5b, lookup_type: ById(8219fdd9-0a75-42c9-91db-deb66a850e5b) } result = Ok(())
21722024-10-16T20:01:44.328ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21732024-10-16T20:01:44.328ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21742024-10-16T20:01:44.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21752024-10-16T20:01:44.330ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 323.763797ms iteration = 13 status = 0
21762024-10-16T20:01:44.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21772024-10-16T20:01:44.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21782024-10-16T20:01:44.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21792024-10-16T20:01:44.345ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21802024-10-16T20:01:44.345ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21812024-10-16T20:01:44.345ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3b0dab84-66c2-48ed-a920-d71c1d8c2f5a", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
21822024-10-16T20:01:44.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21832024-10-16T20:01:44.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21842024-10-16T20:01:44.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21852024-10-16T20:01:44.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21862024-10-16T20:01:44.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21872024-10-16T20:01:44.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21882024-10-16T20:01:44.354ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21892024-10-16T20:01:44.354ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21902024-10-16T20:01:44.354ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b30b1f76-29e0-461a-9a44-b37a206fda4e", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
21912024-10-16T20:01:44.354ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21922024-10-16T20:01:44.354ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21932024-10-16T20:01:44.354ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 348.047473ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21942024-10-16T20:01:44.356ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 349.873816ms iteration = 15 status = {}
21952024-10-16T20:01:44.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21962024-10-16T20:01:44.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21972024-10-16T20:01:44.441ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66211944-054d-446c-afc3-b1a33ad80dff, rack_id: dbc07659-6078-4fa6-9892-1d25efe44b81, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c33f3d0a-20b1-42d9-bb7b-a442a73c3582) } rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
21982024-10-16T20:01:44.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21992024-10-16T20:01:44.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22002024-10-16T20:01:44.446ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22012024-10-16T20:01:44.455ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22022024-10-16T20:01:44.455ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8ff3ff4-a24b-4af7-8ef4-fa0a9d69ab13", "content-length": "121", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
22032024-10-16T20:01:44.455ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
22042024-10-16T20:01:44.455ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c33f3d0a-20b1-42d9-bb7b-a442a73c3582
22052024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22062024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22072024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22082024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22092024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22102024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22112024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22122024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22132024-10-16T20:01:44.456ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
22142024-10-16T20:01:44.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22152024-10-16T20:01:44.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22162024-10-16T20:01:44.459ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22172024-10-16T20:01:44.459ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c45d2d80-8422-4b6d-8f0d-e07b11a81a74", "content-length": "2", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
22182024-10-16T20:01:44.459ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22192024-10-16T20:01:44.459ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "17db8a66-72ad-4993-878e-1d80db533793", "content-length": "52", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
22202024-10-16T20:01:44.459ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
22212024-10-16T20:01:44.459ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22222024-10-16T20:01:44.466ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe42afa9-ec02-4a12-adc8-79e08c06bae8", "content-length": "691", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
22232024-10-16T20:01:44.466ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22242024-10-16T20:01:44.466ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22252024-10-16T20:01:44.466ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22262024-10-16T20:01:44.468ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 461.941005ms iteration = 14 status = {}
22272024-10-16T20:01:44.550ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fef9b76e-ce76-49df-a920-72eb8f11e865", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
22282024-10-16T20:01:44.550ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch = Switch0
22292024-10-16T20:01:44.550ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22302024-10-16T20:01:44.551ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "105cc522-56e7-4f43-a092-2b063c0c361d", "content-length": "669", "date": "Wed, 16 Oct 2024 20:01:44 GMT"} })
22312024-10-16T20:01:44.551ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22322024-10-16T20:01:44.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22332024-10-16T20:01:44.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22342024-10-16T20:01:44.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22352024-10-16T20:01:44.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22362024-10-16T20:01:44.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22372024-10-16T20:01:44.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22382024-10-16T20:01:44.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22392024-10-16T20:01:44.567ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 561.811137ms iteration = 13 status = {}
22402024-10-16T20:01:44.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 57396232-4fef-4bd6-a2c9-b79f86a0789b roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22412024-10-16T20:01:44.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 57396232-4fef-4bd6-a2c9-b79f86a0789b resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22422024-10-16T20:01:44.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 57396232-4fef-4bd6-a2c9-b79f86a0789b response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22432024-10-16T20:01:45.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bacf7740-0a0c-446b-9c60-3f5ef9c5b2ff roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22442024-10-16T20:01:45.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bacf7740-0a0c-446b-9c60-3f5ef9c5b2ff resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22452024-10-16T20:01:45.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bacf7740-0a0c-446b-9c60-3f5ef9c5b2ff response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22462024-10-16T20:01:46.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1345 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 9e4861d3-4029-45a1-a4c1-f9f43e2a4e64 response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
22472024-10-16T20:01:46.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a5e6e693-189d-43d0-9b43-9513219b56d7 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22482024-10-16T20:01:46.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a5e6e693-189d-43d0-9b43-9513219b56d7 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22492024-10-16T20:01:46.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a5e6e693-189d-43d0-9b43-9513219b56d7 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22502024-10-16T20:01:47.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f43dcb84-9284-427a-9bde-95236908bcf7 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22512024-10-16T20:01:47.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f43dcb84-9284-427a-9bde-95236908bcf7 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22522024-10-16T20:01:47.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f43dcb84-9284-427a-9bde-95236908bcf7 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22532024-10-16T20:01:48.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d5d95c36-ae28-4e1b-948f-762472f9d403 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22542024-10-16T20:01:48.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d5d95c36-ae28-4e1b-948f-762472f9d403 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22552024-10-16T20:01:48.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2520 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d5d95c36-ae28-4e1b-948f-762472f9d403 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22562024-10-16T20:01:49.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 11efa44e-9f94-459e-b2de-c4260c3705d4 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22572024-10-16T20:01:49.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 11efa44e-9f94-459e-b2de-c4260c3705d4 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22582024-10-16T20:01:49.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 11efa44e-9f94-459e-b2de-c4260c3705d4 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22592024-10-16T20:01:50.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7dc16e3c-61e1-4cc7-bd9b-b5e3bc43d367 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22602024-10-16T20:01:50.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7dc16e3c-61e1-4cc7-bd9b-b5e3bc43d367 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22612024-10-16T20:01:50.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5785 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7dc16e3c-61e1-4cc7-bd9b-b5e3bc43d367 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22622024-10-16T20:01:51.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0f8c9089-869f-4c72-b3c9-266b0c5f6331 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22632024-10-16T20:01:51.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0f8c9089-869f-4c72-b3c9-266b0c5f6331 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22642024-10-16T20:01:51.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0f8c9089-869f-4c72-b3c9-266b0c5f6331 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22652024-10-16T20:01:52.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e74dbf10-9a30-4517-ac97-a17fcf19294a roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22662024-10-16T20:01:52.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e74dbf10-9a30-4517-ac97-a17fcf19294a resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22672024-10-16T20:01:52.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e74dbf10-9a30-4517-ac97-a17fcf19294a response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22682024-10-16T20:01:53.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7a509ee6-5fdb-445e-8f55-9f6e76eb1d8d roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22692024-10-16T20:01:53.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7a509ee6-5fdb-445e-8f55-9f6e76eb1d8d resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22702024-10-16T20:01:53.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7a509ee6-5fdb-445e-8f55-9f6e76eb1d8d response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22712024-10-16T20:01:54.006ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
22722024-10-16T20:01:54.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
22732024-10-16T20:01:54.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22742024-10-16T20:01:54.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22752024-10-16T20:01:54.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22762024-10-16T20:01:54.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22772024-10-16T20:01:54.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22782024-10-16T20:01:54.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22792024-10-16T20:01:54.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22802024-10-16T20:01:54.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22812024-10-16T20:01:54.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22822024-10-16T20:01:54.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22832024-10-16T20:01:54.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22842024-10-16T20:01:54.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22852024-10-16T20:01:54.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22862024-10-16T20:01:54.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
22872024-10-16T20:01:54.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22882024-10-16T20:01:54.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22892024-10-16T20:01:54.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
22902024-10-16T20:01:54.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.85446ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
22912024-10-16T20:01:54.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.509726ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22922024-10-16T20:01:54.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8baea2c5-e964-46b7-a468-447c243a8562 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22932024-10-16T20:01:54.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8baea2c5-e964-46b7-a468-447c243a8562 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22942024-10-16T20:01:54.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 8baea2c5-e964-46b7-a468-447c243a8562 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22952024-10-16T20:01:55.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6175148e-20a5-40dc-8e76-2075bd9a922f roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22962024-10-16T20:01:55.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6175148e-20a5-40dc-8e76-2075bd9a922f resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22972024-10-16T20:01:55.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 6175148e-20a5-40dc-8e76-2075bd9a922f response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
22982024-10-16T20:01:56.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1632 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = b203f97f-a511-4798-bc34-c587fa447c2e response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
22992024-10-16T20:01:56.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3edef18a-31bc-490c-94a6-3d979299ffd9 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23002024-10-16T20:01:56.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3edef18a-31bc-490c-94a6-3d979299ffd9 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23012024-10-16T20:01:56.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3edef18a-31bc-490c-94a6-3d979299ffd9 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23022024-10-16T20:01:57.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bc4aea47-2ef0-46eb-988b-bd7ca9ecf035 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23032024-10-16T20:01:57.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bc4aea47-2ef0-46eb-988b-bd7ca9ecf035 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23042024-10-16T20:01:57.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bc4aea47-2ef0-46eb-988b-bd7ca9ecf035 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23052024-10-16T20:01:58.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 739ccbef-a968-4af3-b6a2-c00adf7a7514 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23062024-10-16T20:01:58.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 739ccbef-a968-4af3-b6a2-c00adf7a7514 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23072024-10-16T20:01:58.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 739ccbef-a968-4af3-b6a2-c00adf7a7514 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23082024-10-16T20:02:00.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d3e1560c-a056-4863-b0f4-465b0ec63ffb roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23092024-10-16T20:02:00.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d3e1560c-a056-4863-b0f4-465b0ec63ffb resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23102024-10-16T20:02:00.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d3e1560c-a056-4863-b0f4-465b0ec63ffb response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23112024-10-16T20:02:01.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f85367af-d577-4ffb-b3e3-0b686162a008 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23122024-10-16T20:02:01.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f85367af-d577-4ffb-b3e3-0b686162a008 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23132024-10-16T20:02:01.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f85367af-d577-4ffb-b3e3-0b686162a008 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23142024-10-16T20:02:02.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d316e915-969c-42df-aeef-315e9f557bf8 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23152024-10-16T20:02:02.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d316e915-969c-42df-aeef-315e9f557bf8 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23162024-10-16T20:02:02.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = d316e915-969c-42df-aeef-315e9f557bf8 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23172024-10-16T20:02:03.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = da73956d-e79f-46a0-825c-552d97375611 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23182024-10-16T20:02:03.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = da73956d-e79f-46a0-825c-552d97375611 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23192024-10-16T20:02:03.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = da73956d-e79f-46a0-825c-552d97375611 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23202024-10-16T20:02:04.006ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
23212024-10-16T20:02:04.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
23222024-10-16T20:02:04.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23232024-10-16T20:02:04.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23242024-10-16T20:02:04.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23252024-10-16T20:02:04.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23262024-10-16T20:02:04.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23272024-10-16T20:02:04.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23282024-10-16T20:02:04.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23292024-10-16T20:02:04.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.51845ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23302024-10-16T20:02:04.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23312024-10-16T20:02:04.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23322024-10-16T20:02:04.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23332024-10-16T20:02:04.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23342024-10-16T20:02:04.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23352024-10-16T20:02:04.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23362024-10-16T20:02:04.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
23372024-10-16T20:02:04.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23382024-10-16T20:02:04.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23392024-10-16T20:02:04.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
23402024-10-16T20:02:04.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.195608ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
23412024-10-16T20:02:04.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c876926a-f20d-4748-af41-cbcc5c7a3cb0 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23422024-10-16T20:02:04.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c876926a-f20d-4748-af41-cbcc5c7a3cb0 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23432024-10-16T20:02:04.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c876926a-f20d-4748-af41-cbcc5c7a3cb0 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23442024-10-16T20:02:05.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3c4c2d66-fc3b-4d32-a93a-0af55279cc70 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23452024-10-16T20:02:05.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3c4c2d66-fc3b-4d32-a93a-0af55279cc70 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23462024-10-16T20:02:05.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3c4c2d66-fc3b-4d32-a93a-0af55279cc70 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23472024-10-16T20:02:05.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 8d38d12d-ec09-45ff-b05d-abd9ca36f686 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
23482024-10-16T20:02:05.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 8d38d12d-ec09-45ff-b05d-abd9ca36f686 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
23492024-10-16T20:02:05.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:38897 req_id = 8d38d12d-ec09-45ff-b05d-abd9ca36f686 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
23502024-10-16T20:02:06.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = db442fbd-042a-4596-b9d2-1ab508a49be1 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23512024-10-16T20:02:06.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = db442fbd-042a-4596-b9d2-1ab508a49be1 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23522024-10-16T20:02:06.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = db442fbd-042a-4596-b9d2-1ab508a49be1 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23532024-10-16T20:02:06.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1444 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 42b98681-c9ff-40b5-8f7a-e3f391ac64fd response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
23542024-10-16T20:02:07.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0cfe8ad0-b947-45b6-9702-2c2faa91abd3 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23552024-10-16T20:02:07.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0cfe8ad0-b947-45b6-9702-2c2faa91abd3 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23562024-10-16T20:02:07.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0cfe8ad0-b947-45b6-9702-2c2faa91abd3 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23572024-10-16T20:02:08.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = cee55117-8a9e-49af-867a-bdd65b5746d9 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23582024-10-16T20:02:08.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = cee55117-8a9e-49af-867a-bdd65b5746d9 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23592024-10-16T20:02:08.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = cee55117-8a9e-49af-867a-bdd65b5746d9 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23602024-10-16T20:02:09.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c4ab9128-0129-408a-bf29-8718d6dfdd77 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23612024-10-16T20:02:09.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c4ab9128-0129-408a-bf29-8718d6dfdd77 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23622024-10-16T20:02:09.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2420 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = c4ab9128-0129-408a-bf29-8718d6dfdd77 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23632024-10-16T20:02:10.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bec59a01-1a0d-47d7-bc90-1bedfcfb9d7b roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23642024-10-16T20:02:10.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bec59a01-1a0d-47d7-bc90-1bedfcfb9d7b resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23652024-10-16T20:02:10.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = bec59a01-1a0d-47d7-bc90-1bedfcfb9d7b response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23662024-10-16T20:02:11.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7d75003f-c75c-4d61-a6c8-49e6c54c62eb roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23672024-10-16T20:02:11.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7d75003f-c75c-4d61-a6c8-49e6c54c62eb resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23682024-10-16T20:02:11.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7d75003f-c75c-4d61-a6c8-49e6c54c62eb response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23692024-10-16T20:02:12.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 88ffd86c-1cc3-4b05-979e-7e978f2bace5 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23702024-10-16T20:02:12.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 88ffd86c-1cc3-4b05-979e-7e978f2bace5 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23712024-10-16T20:02:12.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 88ffd86c-1cc3-4b05-979e-7e978f2bace5 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23722024-10-16T20:02:13.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 95b348ad-e71b-42ce-9150-246ce32675d7 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23732024-10-16T20:02:13.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 95b348ad-e71b-42ce-9150-246ce32675d7 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23742024-10-16T20:02:13.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 95b348ad-e71b-42ce-9150-246ce32675d7 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
23752024-10-16T20:02:13.867ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
23762024-10-16T20:02:13.867ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23772024-10-16T20:02:13.867ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
23782024-10-16T20:02:13.867ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23792024-10-16T20:02:13.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23802024-10-16T20:02:13.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23812024-10-16T20:02:13.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4879, tv_nsec: 866274886 } })
23822024-10-16T20:02:13.870ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4879, tv_nsec: 866411459 } })
23832024-10-16T20:02:13.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1066
23842024-10-16T20:02:13.871ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1066
23852024-10-16T20:02:13.946ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
23862024-10-16T20:02:13.946ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23872024-10-16T20:02:13.946ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b6baf18-ed51-4c78-8df2-675fe4066e5b", "content-length": "26", "date": "Wed, 16 Oct 2024 20:02:13 GMT"} })
23882024-10-16T20:02:13.946ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23892024-10-16T20:02:13.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23902024-10-16T20:02:13.949ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1074 zone_address = fd00:1122:3344:101::2
23912024-10-16T20:02:13.949ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23922024-10-16T20:02:13.949ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdd7473c-1dc0-49bc-9720-7c311f29bf88", "content-length": "26", "date": "Wed, 16 Oct 2024 20:02:13 GMT"} })
23932024-10-16T20:02:13.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1079 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23942024-10-16T20:02:13.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23952024-10-16T20:02:14.004ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
23962024-10-16T20:02:14.004ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 22.701\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
23972024-10-16T20:02:14.005ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
23982024-10-16T20:02:14.005ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
23992024-10-16T20:02:14.005ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24002024-10-16T20:02:14.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24012024-10-16T20:02:14.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24022024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24032024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
24042024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24052024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24062024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
24072024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24082024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
24092024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24102024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
24112024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
24122024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24132024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24142024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
24152024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.741\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
24162024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
24172024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
24182024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.49\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
24192024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.55\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
24202024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
24212024-10-16T20:02:14.006ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24222024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
24232024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
24242024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24252024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24262024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
24272024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24282024-10-16T20:02:14.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24292024-10-16T20:02:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24302024-10-16T20:02:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24312024-10-16T20:02:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24322024-10-16T20:02:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24332024-10-16T20:02:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24342024-10-16T20:02:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24352024-10-16T20:02:14.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24362024-10-16T20:02:14.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24372024-10-16T20:02:14.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24382024-10-16T20:02:14.009ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24392024-10-16T20:02:14.009ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e1b589c-fe64-4454-b6a4-7552d31735d1", "content-length": "2", "date": "Wed, 16 Oct 2024 20:02:13 GMT"} })
24402024-10-16T20:02:14.009ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24412024-10-16T20:02:14.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24422024-10-16T20:02:14.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24432024-10-16T20:02:14.011ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24442024-10-16T20:02:14.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24452024-10-16T20:02:14.011ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.20568ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24462024-10-16T20:02:14.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24472024-10-16T20:02:14.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24482024-10-16T20:02:14.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24492024-10-16T20:02:14.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24502024-10-16T20:02:14.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24512024-10-16T20:02:14.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24522024-10-16T20:02:14.015ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 148.430905ms iteration = 14 status = null
24532024-10-16T20:02:14.017ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 149.55744ms iteration = 14 status = {}
24542024-10-16T20:02:14.017ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-8219fdd9-0a75-42c9-91db-deb66a850e5b.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4880, tv_nsec: 12454349 } })
24552024-10-16T20:02:14.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1066 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
24562024-10-16T20:02:14.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24572024-10-16T20:02:14.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24582024-10-16T20:02:14.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24592024-10-16T20:02:14.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24602024-10-16T20:02:14.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24612024-10-16T20:02:14.040ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24622024-10-16T20:02:14.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24632024-10-16T20:02:14.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 37.616502ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24642024-10-16T20:02:14.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24652024-10-16T20:02:14.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24662024-10-16T20:02:14.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24672024-10-16T20:02:14.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24682024-10-16T20:02:14.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24692024-10-16T20:02:14.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24702024-10-16T20:02:14.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24712024-10-16T20:02:14.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24722024-10-16T20:02:14.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24732024-10-16T20:02:14.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24742024-10-16T20:02:14.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24752024-10-16T20:02:14.048ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24762024-10-16T20:02:14.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24772024-10-16T20:02:14.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
24782024-10-16T20:02:14.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24792024-10-16T20:02:14.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24802024-10-16T20:02:14.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24812024-10-16T20:02:14.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24822024-10-16T20:02:14.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.798565ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24832024-10-16T20:02:14.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24842024-10-16T20:02:14.051ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24852024-10-16T20:02:14.051ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24862024-10-16T20:02:14.051ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24872024-10-16T20:02:14.051ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24882024-10-16T20:02:14.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24892024-10-16T20:02:14.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24902024-10-16T20:02:14.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24912024-10-16T20:02:14.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24922024-10-16T20:02:14.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24932024-10-16T20:02:14.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24942024-10-16T20:02:14.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24952024-10-16T20:02:14.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24962024-10-16T20:02:14.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24972024-10-16T20:02:14.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24982024-10-16T20:02:14.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24992024-10-16T20:02:14.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 8219fdd9-0a75-42c9-91db-deb66a850e5b, lookup_type: ById(8219fdd9-0a75-42c9-91db-deb66a850e5b) } result = Ok(())
25002024-10-16T20:02:14.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25012024-10-16T20:02:14.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25022024-10-16T20:02:14.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25032024-10-16T20:02:14.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25042024-10-16T20:02:14.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25052024-10-16T20:02:14.058ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.636315ms iteration = 14 status = 0
25062024-10-16T20:02:14.059ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
25072024-10-16T20:02:14.059ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.524694ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
25082024-10-16T20:02:14.063ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1074 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 zone_address = fd00:1122:3344:101::2
25092024-10-16T20:02:14.063ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25102024-10-16T20:02:14.064ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9113419-b3f2-47a4-a867-897e29f5cead", "content-length": "26", "date": "Wed, 16 Oct 2024 20:02:13 GMT"} })
25112024-10-16T20:02:14.064ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1079 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25122024-10-16T20:02:14.065ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
25132024-10-16T20:02:14.091ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25142024-10-16T20:02:14.091ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25152024-10-16T20:02:14.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25162024-10-16T20:02:14.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25172024-10-16T20:02:14.098ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25182024-10-16T20:02:14.098ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.244006ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25192024-10-16T20:02:14.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25202024-10-16T20:02:14.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25212024-10-16T20:02:14.118ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25222024-10-16T20:02:14.118ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25232024-10-16T20:02:14.118ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9abe50b-2ddf-42b9-8873-14bd0b1ee3b8", "content-length": "372", "date": "Wed, 16 Oct 2024 20:02:14 GMT"} })
25242024-10-16T20:02:14.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25252024-10-16T20:02:14.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25262024-10-16T20:02:14.120ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25272024-10-16T20:02:14.120ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25282024-10-16T20:02:14.120ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.681417ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25292024-10-16T20:02:14.136ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25302024-10-16T20:02:14.136ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25312024-10-16T20:02:14.136ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fb1e6355-a2f2-4fff-9535-4d72419ba0f8", "date": "Wed, 16 Oct 2024 20:02:14 GMT"} })
25322024-10-16T20:02:14.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25332024-10-16T20:02:14.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25342024-10-16T20:02:14.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25352024-10-16T20:02:14.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25362024-10-16T20:02:14.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25372024-10-16T20:02:14.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25382024-10-16T20:02:14.145ZINFOnexus (BackgroundTasks): VPC route manager sled 8219fdd9-0a75-42c9-91db-deb66a850e5b push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25392024-10-16T20:02:14.145ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25402024-10-16T20:02:14.146ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cbb1fa5f-2252-4b18-a7fd-bff07a78598f", "date": "Wed, 16 Oct 2024 20:02:14 GMT"} })
25412024-10-16T20:02:14.148ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 142.024808ms iteration = 16 status = {}
25422024-10-16T20:02:14.155ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.403953ms iteration = 17 status = {"physical_disks_added":0}
25432024-10-16T20:02:14.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25442024-10-16T20:02:14.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25452024-10-16T20:02:14.194ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 66211944-054d-446c-afc3-b1a33ad80dff, rack_id: dbc07659-6078-4fa6-9892-1d25efe44b81, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c33f3d0a-20b1-42d9-bb7b-a442a73c3582) } rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
25462024-10-16T20:02:14.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25472024-10-16T20:02:14.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25482024-10-16T20:02:14.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25492024-10-16T20:02:14.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25502024-10-16T20:02:14.202ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25512024-10-16T20:02:14.204ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25522024-10-16T20:02:14.204ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25532024-10-16T20:02:14.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25542024-10-16T20:02:14.206ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25552024-10-16T20:02:14.206ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "815bb22d-2cd4-40f3-b06c-c46cc78fe126", "content-length": "121", "date": "Wed, 16 Oct 2024 20:02:13 GMT"} })
25562024-10-16T20:02:14.206ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
25572024-10-16T20:02:14.206ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c33f3d0a-20b1-42d9-bb7b-a442a73c3582
25582024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25592024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25602024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25612024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25622024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25632024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25642024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25652024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25662024-10-16T20:02:14.207ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81
25672024-10-16T20:02:14.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25682024-10-16T20:02:14.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25692024-10-16T20:02:14.210ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25702024-10-16T20:02:14.210ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b7bca47-338f-45f1-ad4b-28ad734960c2", "content-length": "2", "date": "Wed, 16 Oct 2024 20:02:13 GMT"} })
25712024-10-16T20:02:14.210ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25722024-10-16T20:02:14.210ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a03be6aa-7819-40c3-a961-03763eb4e318", "content-length": "52", "date": "Wed, 16 Oct 2024 20:02:13 GMT"} })
25732024-10-16T20:02:14.210ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch_location = Switch0
25742024-10-16T20:02:14.210ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25752024-10-16T20:02:14.233ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25762024-10-16T20:02:14.235ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25772024-10-16T20:02:14.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25782024-10-16T20:02:14.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25792024-10-16T20:02:14.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25802024-10-16T20:02:14.307ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "37165264-5632-43c4-bcf6-ddc10c5274b5", "date": "Wed, 16 Oct 2024 20:02:14 GMT"} })
25812024-10-16T20:02:14.307ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 switch = Switch0
25822024-10-16T20:02:14.307ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25832024-10-16T20:02:14.311ZDEBGnexus (BackgroundTasks): client response SledAgent = 8219fdd9-0a75-42c9-91db-deb66a850e5b background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aec85f35-cb12-4c8c-afee-333285634707", "content-length": "691", "date": "Wed, 16 Oct 2024 20:02:14 GMT"} })
25842024-10-16T20:02:14.311ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25852024-10-16T20:02:14.311ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25862024-10-16T20:02:14.311ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25872024-10-16T20:02:14.311ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = dbc07659-6078-4fa6-9892-1d25efe44b81 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "90cbbf56-de0a-47cd-a8ed-90f3cac77b15", "content-length": "669", "date": "Wed, 16 Oct 2024 20:02:14 GMT"} })
25882024-10-16T20:02:14.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25892024-10-16T20:02:14.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25902024-10-16T20:02:14.313ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 306.761896ms iteration = 15 status = {}
25912024-10-16T20:02:14.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25922024-10-16T20:02:14.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25932024-10-16T20:02:14.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = acb72e59-661f-49e8-8204-0beef6eedc61 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
25942024-10-16T20:02:14.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = acb72e59-661f-49e8-8204-0beef6eedc61 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
25952024-10-16T20:02:14.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = acb72e59-661f-49e8-8204-0beef6eedc61 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
25962024-10-16T20:02:14.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25972024-10-16T20:02:14.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25982024-10-16T20:02:14.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25992024-10-16T20:02:14.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26002024-10-16T20:02:14.327ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 322.043957ms iteration = 14 status = {}
26012024-10-16T20:02:15.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 64862694-1f19-4050-a0ef-4abeab8cc533 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26022024-10-16T20:02:15.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 64862694-1f19-4050-a0ef-4abeab8cc533 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26032024-10-16T20:02:15.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 64862694-1f19-4050-a0ef-4abeab8cc533 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26042024-10-16T20:02:16.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 95de1b0c-290c-4449-b616-b3162078735c roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26052024-10-16T20:02:16.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 95de1b0c-290c-4449-b616-b3162078735c resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26062024-10-16T20:02:16.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 95de1b0c-290c-4449-b616-b3162078735c response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26072024-10-16T20:02:16.544ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1324 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 684adb9e-ebd1-4e6b-9408-95b597c4a98a response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
26082024-10-16T20:02:17.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3a337535-926c-4c60-9a09-6a59637f3438 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26092024-10-16T20:02:17.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3a337535-926c-4c60-9a09-6a59637f3438 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26102024-10-16T20:02:17.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 3a337535-926c-4c60-9a09-6a59637f3438 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26112024-10-16T20:02:18.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f6538edb-8cce-4cea-9246-583c939b6ad7 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26122024-10-16T20:02:18.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f6538edb-8cce-4cea-9246-583c939b6ad7 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26132024-10-16T20:02:18.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = f6538edb-8cce-4cea-9246-583c939b6ad7 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26142024-10-16T20:02:19.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1edf22e0-52d4-469d-aa37-7517e0db412f roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26152024-10-16T20:02:19.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1edf22e0-52d4-469d-aa37-7517e0db412f resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26162024-10-16T20:02:19.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 1edf22e0-52d4-469d-aa37-7517e0db412f response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26172024-10-16T20:02:20.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0deaface-00be-4a46-97e4-468b10723bdf roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26182024-10-16T20:02:20.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0deaface-00be-4a46-97e4-468b10723bdf resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26192024-10-16T20:02:20.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 0deaface-00be-4a46-97e4-468b10723bdf response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26202024-10-16T20:02:21.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7c09ba70-2291-4d27-9c4b-bcddc899d4aa roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26212024-10-16T20:02:21.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7c09ba70-2291-4d27-9c4b-bcddc899d4aa resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26222024-10-16T20:02:21.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2780 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 7c09ba70-2291-4d27-9c4b-bcddc899d4aa response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26232024-10-16T20:02:22.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = be4eaba0-8d4e-491a-ba35-b941d4002c78 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26242024-10-16T20:02:22.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = be4eaba0-8d4e-491a-ba35-b941d4002c78 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26252024-10-16T20:02:22.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = be4eaba0-8d4e-491a-ba35-b941d4002c78 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26262024-10-16T20:02:23.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b3454a63-bb90-42b8-8336-f6778a0975f3 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26272024-10-16T20:02:23.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b3454a63-bb90-42b8-8336-f6778a0975f3 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26282024-10-16T20:02:23.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = b3454a63-bb90-42b8-8336-f6778a0975f3 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26292024-10-16T20:02:24.006ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
26302024-10-16T20:02:24.006ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
26312024-10-16T20:02:24.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26322024-10-16T20:02:24.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26332024-10-16T20:02:24.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26342024-10-16T20:02:24.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26352024-10-16T20:02:24.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26362024-10-16T20:02:24.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26372024-10-16T20:02:24.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26382024-10-16T20:02:24.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.917043ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26392024-10-16T20:02:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26402024-10-16T20:02:24.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26412024-10-16T20:02:24.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26422024-10-16T20:02:24.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26432024-10-16T20:02:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26442024-10-16T20:02:24.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26452024-10-16T20:02:24.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 763e9ac0-1ebe-403e-b27b-bc76e8398b21, lookup_type: ById(763e9ac0-1ebe-403e-b27b-bc76e8398b21) } result = Ok(())
26462024-10-16T20:02:24.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26472024-10-16T20:02:24.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26482024-10-16T20:02:24.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 original_time_created = 2024-10-16 19:55:30.832122 UTC target_id = 763e9ac0-1ebe-403e-b27b-bc76e8398b21 time_created = 2024-10-16 19:55:30.832122 UTC
26492024-10-16T20:02:24.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.102565ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"763e9ac0-1ebe-403e-b27b-bc76e8398b21","time_created":"2024-10-16T19:55:30.832122Z"}
26502024-10-16T20:02:24.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 849cfeaa-4615-49a0-a980-37a96fe70847 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26512024-10-16T20:02:24.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 849cfeaa-4615-49a0-a980-37a96fe70847 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26522024-10-16T20:02:24.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 849cfeaa-4615-49a0-a980-37a96fe70847 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26532024-10-16T20:02:25.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 283015e9-225d-4e53-919b-93b024e99ad3 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26542024-10-16T20:02:25.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 283015e9-225d-4e53-919b-93b024e99ad3 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26552024-10-16T20:02:25.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 283015e9-225d-4e53-919b-93b024e99ad3 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26562024-10-16T20:02:26.545ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1403 local_addr = [fd00:1122:3344:101::b]:61769 method = GET remote_addr = [fd00:1122:3344:101::d]:47588 req_id = 7e9ad13a-7ea9-40b0-b02c-082077502d53 response_code = 200 uri = /bb888a52-e1f5-4893-bec6-0b8ff00c7df7
26572024-10-16T20:02:26.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 53cdc211-74cc-4312-b97d-c64d32d990fb roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26582024-10-16T20:02:26.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 53cdc211-74cc-4312-b97d-c64d32d990fb resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26592024-10-16T20:02:26.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 53cdc211-74cc-4312-b97d-c64d32d990fb response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26602024-10-16T20:02:27.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e60cd734-3416-45b5-bf87-41628e4306e5 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26612024-10-16T20:02:27.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e60cd734-3416-45b5-bf87-41628e4306e5 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26622024-10-16T20:02:27.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = e60cd734-3416-45b5-bf87-41628e4306e5 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26632024-10-16T20:02:28.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a2ebf62e-7b3f-4875-a580-a65746f4b3ec roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26642024-10-16T20:02:28.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a2ebf62e-7b3f-4875-a580-a65746f4b3ec resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26652024-10-16T20:02:28.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = a2ebf62e-7b3f-4875-a580-a65746f4b3ec response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26662024-10-16T20:02:29.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 65893ae2-8e6e-428d-83a8-066994cfa241 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26672024-10-16T20:02:29.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 65893ae2-8e6e-428d-83a8-066994cfa241 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26682024-10-16T20:02:29.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 65893ae2-8e6e-428d-83a8-066994cfa241 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26692024-10-16T20:02:30.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 08bbba0e-f16e-4764-89e5-0d37f336ed76 roles = RoleSet { roles: {} } uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26702024-10-16T20:02:30.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 08bbba0e-f16e-4764-89e5-0d37f336ed76 resource = Database result = Ok(()) uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b
26712024-10-16T20:02:30.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:35150 req_id = 08bbba0e-f16e-4764-89e5-0d37f336ed76 response_code = 200 uri = /probes/8219fdd9-0a75-42c9-91db-deb66a850e5b