Max level shown:
12024-11-13T05:15:01.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b9e78a97-22ee-4d00-9274-06572f8c4591 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22024-11-13T05:15:01.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b9e78a97-22ee-4d00-9274-06572f8c4591 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
32024-11-13T05:15:01.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b9e78a97-22ee-4d00-9274-06572f8c4591 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
42024-11-13T05:15:02.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1e508d32-d52d-459b-8693-31df25231641 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
52024-11-13T05:15:02.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1e508d32-d52d-459b-8693-31df25231641 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
62024-11-13T05:15:02.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1e508d32-d52d-459b-8693-31df25231641 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
72024-11-13T05:15:03.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3f4cfac8-2110-4780-8a71-f39c620f5f5b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
82024-11-13T05:15:03.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3f4cfac8-2110-4780-8a71-f39c620f5f5b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
92024-11-13T05:15:03.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3f4cfac8-2110-4780-8a71-f39c620f5f5b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
102024-11-13T05:15:04.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26bc69b3-7b17-4f43-8c0e-eaf6c6aa76ab roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
112024-11-13T05:15:04.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26bc69b3-7b17-4f43-8c0e-eaf6c6aa76ab resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
122024-11-13T05:15:04.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26bc69b3-7b17-4f43-8c0e-eaf6c6aa76ab response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
132024-11-13T05:15:05.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e48366dd-9881-4527-9506-f53a2cc86c24 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
142024-11-13T05:15:05.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e48366dd-9881-4527-9506-f53a2cc86c24 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
152024-11-13T05:15:05.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e48366dd-9881-4527-9506-f53a2cc86c24 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
162024-11-13T05:15:06.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b868fef3-20ce-48db-9af4-3e57123af35b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
172024-11-13T05:15:06.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b868fef3-20ce-48db-9af4-3e57123af35b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
182024-11-13T05:15:06.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b868fef3-20ce-48db-9af4-3e57123af35b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
192024-11-13T05:15:07.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9e9217c6-e7c7-4a0d-bea6-7eee2208c293 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
202024-11-13T05:15:07.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9e9217c6-e7c7-4a0d-bea6-7eee2208c293 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
212024-11-13T05:15:07.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9e9217c6-e7c7-4a0d-bea6-7eee2208c293 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
222024-11-13T05:15:08.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a9e2675-f099-4d88-91fc-0d7fdc6f78f5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
232024-11-13T05:15:08.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a9e2675-f099-4d88-91fc-0d7fdc6f78f5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
242024-11-13T05:15:08.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a9e2675-f099-4d88-91fc-0d7fdc6f78f5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
252024-11-13T05:15:09.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dcd93ea0-714f-42ec-9461-b11547e8cb2c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
262024-11-13T05:15:09.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dcd93ea0-714f-42ec-9461-b11547e8cb2c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
272024-11-13T05:15:09.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dcd93ea0-714f-42ec-9461-b11547e8cb2c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
282024-11-13T05:15:09.893ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
292024-11-13T05:15:09.893ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
302024-11-13T05:15:09.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
312024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
322024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
332024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
342024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
352024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
362024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
372024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
382024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
392024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
402024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
412024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
422024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
432024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
442024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
452024-11-13T05:15:09.894ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
462024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
472024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
482024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
492024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
502024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
512024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
522024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
532024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
542024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
552024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
562024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
572024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
582024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
592024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
602024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
612024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
622024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
632024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
642024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
652024-11-13T05:15:09.894ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-13 05:05:09.894688193 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
662024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
672024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
682024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
692024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
702024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
712024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
722024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
732024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
742024-11-13T05:15:09.894ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71
752024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
762024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.08\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71"}
772024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
782024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
792024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
802024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
812024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
822024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
832024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
842024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
852024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
862024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
872024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
882024-11-13T05:15:09.894ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
892024-11-13T05:15:09.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
902024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
912024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
922024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
932024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
942024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
952024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
962024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
972024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
982024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
992024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1002024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1012024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1022024-11-13T05:15:09.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("105858cb-d3d5-4677-95c0-079ffa1259be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b62b18b5-c7f6-48f0-ab56-4213f6de7d44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5291, tv_nsec: 406869825 } })
1032024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1042024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1052024-11-13T05:15:09.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("038e4c2b-2408-42f1-b025-c88f1167faaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5291, tv_nsec: 406898896 } })
1062024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1072024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1082024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1092024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1102024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1112024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1122024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1132024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1142024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1152024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1162024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1172024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1182024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1192024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.388442ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1202024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
1212024-11-13T05:15:09.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.053899ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
1222024-11-13T05:15:09.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.945055ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
1232024-11-13T05:15:09.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1242024-11-13T05:15:09.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.460169ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1252024-11-13T05:15:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1262024-11-13T05:15:09.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1272024-11-13T05:15:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1282024-11-13T05:15:09.900ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5291, tv_nsec: 412107491 } })
1292024-11-13T05:15:09.900ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
1302024-11-13T05:15:09.901ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1312024-11-13T05:15:09.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1322024-11-13T05:15:09.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1332024-11-13T05:15:09.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1342024-11-13T05:15:09.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1352024-11-13T05:15:09.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1362024-11-13T05:15:09.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1372024-11-13T05:15:09.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1382024-11-13T05:15:09.904ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.808456ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
1392024-11-13T05:15:09.906ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1402024-11-13T05:15:09.906ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
1412024-11-13T05:15:09.906ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
1422024-11-13T05:15:09.906ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.671272ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
1432024-11-13T05:15:09.906ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-13 05:05:09.894688193 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1442024-11-13T05:15:09.906ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.099576ms iteration = 8 status = {"expiration":"2024-11-13T05:05:09.894688193Z","pruned":[]}
1452024-11-13T05:15:09.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1462024-11-13T05:15:09.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1472024-11-13T05:15:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1482024-11-13T05:15:09.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1492024-11-13T05:15:09.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1502024-11-13T05:15:09.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1512024-11-13T05:15:09.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1522024-11-13T05:15:09.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1532024-11-13T05:15:09.911ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5291, tv_nsec: 422790454 } })
1542024-11-13T05:15:09.911ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
1552024-11-13T05:15:09.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 17.777695ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1562024-11-13T05:15:09.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1572024-11-13T05:15:09.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1582024-11-13T05:15:09.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1592024-11-13T05:15:09.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1602024-11-13T05:15:09.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1612024-11-13T05:15:09.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1622024-11-13T05:15:09.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1632024-11-13T05:15:09.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1642024-11-13T05:15:09.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1652024-11-13T05:15:09.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1662024-11-13T05:15:09.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1672024-11-13T05:15:09.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1682024-11-13T05:15:09.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1692024-11-13T05:15:09.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1702024-11-13T05:15:09.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1712024-11-13T05:15:09.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1722024-11-13T05:15:09.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
1732024-11-13T05:15:09.925ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1742024-11-13T05:15:09.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1752024-11-13T05:15:09.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1762024-11-13T05:15:09.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
1772024-11-13T05:15:09.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1782024-11-13T05:15:09.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1792024-11-13T05:15:09.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1802024-11-13T05:15:09.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1812024-11-13T05:15:09.938ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1822024-11-13T05:15:09.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1832024-11-13T05:15:09.940ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842024-11-13T05:15:09.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1852024-11-13T05:15:09.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1862024-11-13T05:15:09.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1872024-11-13T05:15:09.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1882024-11-13T05:15:09.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1892024-11-13T05:15:09.947ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
1902024-11-13T05:15:09.947ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.143614ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
1912024-11-13T05:15:09.949ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1922024-11-13T05:15:09.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1932024-11-13T05:15:09.949ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5291, tv_nsec: 461289691 } })
1942024-11-13T05:15:09.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1952024-11-13T05:15:09.950ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
1962024-11-13T05:15:09.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1972024-11-13T05:15:09.950ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.642517ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
1982024-11-13T05:15:09.951ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1992024-11-13T05:15:09.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.480284ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2002024-11-13T05:15:09.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2012024-11-13T05:15:09.952ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.335779ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2022024-11-13T05:15:09.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2032024-11-13T05:15:09.953ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2042024-11-13T05:15:09.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2052024-11-13T05:15:09.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
2062024-11-13T05:15:09.954ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2072024-11-13T05:15:09.954ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2082024-11-13T05:15:09.955ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2092024-11-13T05:15:09.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2102024-11-13T05:15:09.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2112024-11-13T05:15:09.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2122024-11-13T05:15:09.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2132024-11-13T05:15:09.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2142024-11-13T05:15:09.958ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.326982ms iteration = 15 status = 0
2152024-11-13T05:15:09.961ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2162024-11-13T05:15:09.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2172024-11-13T05:15:09.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2182024-11-13T05:15:09.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2192024-11-13T05:15:09.962ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2202024-11-13T05:15:09.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2212024-11-13T05:15:09.964ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2222024-11-13T05:15:09.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2232024-11-13T05:15:09.966ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2242024-11-13T05:15:09.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2252024-11-13T05:15:09.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2262024-11-13T05:15:09.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2272024-11-13T05:15:09.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2282024-11-13T05:15:09.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2292024-11-13T05:15:09.977ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 82.582712ms iteration = 18 status = {"physical_disks_added":0}
2302024-11-13T05:15:09.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2312024-11-13T05:15:09.977ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2322024-11-13T05:15:09.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2332024-11-13T05:15:09.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2342024-11-13T05:15:09.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2352024-11-13T05:15:09.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2362024-11-13T05:15:09.995ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2372024-11-13T05:15:09.995ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2382024-11-13T05:15:09.995ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2392024-11-13T05:15:09.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2402024-11-13T05:15:09.998ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2412024-11-13T05:15:09.998ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2422024-11-13T05:15:09.998ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.16065ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2432024-11-13T05:15:10.005ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2442024-11-13T05:15:10.005ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2452024-11-13T05:15:10.005ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2462024-11-13T05:15:10.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2472024-11-13T05:15:10.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2482024-11-13T05:15:10.007ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2492024-11-13T05:15:10.007ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2502024-11-13T05:15:10.007ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2512024-11-13T05:15:10.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2522024-11-13T05:15:10.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2532024-11-13T05:15:10.008ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2542024-11-13T05:15:10.008ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.996207ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2552024-11-13T05:15:10.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.823309ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2562024-11-13T05:15:10.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2572024-11-13T05:15:10.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2582024-11-13T05:15:10.026ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-13T05:08:08.157062Z, time_modified: 2024-11-13T05:08:08.157062Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }) }
2592024-11-13T05:15:10.026ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 131.416959ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]}},"default_endpoint":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
2602024-11-13T05:15:10.027ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2612024-11-13T05:15:10.027ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2622024-11-13T05:15:10.027ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.68555ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2632024-11-13T05:15:10.028ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2642024-11-13T05:15:10.031ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
2652024-11-13T05:15:10.031ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 136.388162ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
2662024-11-13T05:15:10.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
2672024-11-13T05:15:10.034ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2682024-11-13T05:15:10.035ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fced060e-6289-45e8-b66e-20a2081a1a8e", "content-length": "26", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
2692024-11-13T05:15:10.035ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2702024-11-13T05:15:10.035ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2712024-11-13T05:15:10.038ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2722024-11-13T05:15:10.108ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
2732024-11-13T05:15:10.108ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2742024-11-13T05:15:10.108ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2096daa7-c191-4659-805e-559a9d5269e1", "content-length": "26", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
2752024-11-13T05:15:10.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2762024-11-13T05:15:10.110ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2772024-11-13T05:15:10.125ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2782024-11-13T05:15:10.125ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2792024-11-13T05:15:10.125ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd189f19-0ccf-4f15-851e-6f7b9e9dbced", "content-length": "372", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
2802024-11-13T05:15:10.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2812024-11-13T05:15:10.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2822024-11-13T05:15:10.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2832024-11-13T05:15:10.129ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
2842024-11-13T05:15:10.129ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2852024-11-13T05:15:10.129ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41da45e8-b6bf-4737-bd9b-9e12a0b4d1c9", "content-length": "26", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
2862024-11-13T05:15:10.129ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2872024-11-13T05:15:10.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2882024-11-13T05:15:10.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2892024-11-13T05:15:10.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2902024-11-13T05:15:10.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
2912024-11-13T05:15:10.133ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2922024-11-13T05:15:10.133ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2932024-11-13T05:15:10.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2942024-11-13T05:15:10.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2952024-11-13T05:15:10.135ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2962024-11-13T05:15:10.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2972024-11-13T05:15:10.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2982024-11-13T05:15:10.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2992024-11-13T05:15:10.140ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3002024-11-13T05:15:10.140ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3012024-11-13T05:15:10.140ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-13 05:08:54.008257 UTC dns_group = internal generation = 1
3022024-11-13T05:15:10.140ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 246.813948ms iteration = 9 status = {"generation":1}
3032024-11-13T05:15:10.160ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3042024-11-13T05:15:10.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3052024-11-13T05:15:10.163ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3062024-11-13T05:15:10.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3072024-11-13T05:15:10.170ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3082024-11-13T05:15:10.170ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3092024-11-13T05:15:10.170ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c69fbe94-4a38-4cb9-8be4-dff46354a04e", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
3102024-11-13T05:15:10.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3112024-11-13T05:15:10.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3122024-11-13T05:15:10.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3132024-11-13T05:15:10.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3142024-11-13T05:15:10.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3152024-11-13T05:15:10.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3162024-11-13T05:15:10.178ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3172024-11-13T05:15:10.178ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3182024-11-13T05:15:10.178ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3615847e-8201-4dba-8357-1b928d3abf2c", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
3192024-11-13T05:15:10.180ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.545895ms iteration = 16 status = {}
3202024-11-13T05:15:10.191ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3212024-11-13T05:15:10.191ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 0 version = 2
3222024-11-13T05:15:10.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3232024-11-13T05:15:10.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3242024-11-13T05:15:10.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3252024-11-13T05:15:10.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3262024-11-13T05:15:10.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3272024-11-13T05:15:10.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3282024-11-13T05:15:10.198ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 1 version = 2
3292024-11-13T05:15:10.198ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3302024-11-13T05:15:10.198ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-13 05:08:54.834359 UTC dns_group = external generation = 2
3312024-11-13T05:15:10.198ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 303.732185ms iteration = 9 status = {"generation":2}
3322024-11-13T05:15:10.217ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3332024-11-13T05:15:10.217ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ff410b6f-2b16-4ad3-ba41-16cc8820b14c", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3342024-11-13T05:15:10.217ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3352024-11-13T05:15:10.219ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9b83f378-3471-4bc7-9c23-20565605737f", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3362024-11-13T05:15:10.219ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3372024-11-13T05:15:10.220ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3382024-11-13T05:15:10.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3392024-11-13T05:15:10.221ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3402024-11-13T05:15:10.221ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 326.692765ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3412024-11-13T05:15:10.246ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3422024-11-13T05:15:10.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3432024-11-13T05:15:10.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3442024-11-13T05:15:10.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3452024-11-13T05:15:10.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3462024-11-13T05:15:10.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3472024-11-13T05:15:10.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3482024-11-13T05:15:10.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3492024-11-13T05:15:10.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3502024-11-13T05:15:10.298ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 403.583607ms iteration = 15 status = {}
3512024-11-13T05:15:10.374ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3522024-11-13T05:15:10.374ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e1b405d-b7a5-423e-a655-1f0aeca056c9", "content-length": "1", "date": "Wed, 13 Nov 2024 05:15:09 GMT"} })
3532024-11-13T05:15:10.376ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3542024-11-13T05:15:10.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3552024-11-13T05:15:10.378ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 483.95613ms iteration = 15 status = null
3562024-11-13T05:15:10.412ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3572024-11-13T05:15:10.412ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c847925-69b7-4c0e-a874-01d35b18791c", "content-length": "691", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
3582024-11-13T05:15:10.412ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3592024-11-13T05:15:10.412ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3602024-11-13T05:15:10.412ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3612024-11-13T05:15:10.413ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 518.648613ms iteration = 15 status = {}
3622024-11-13T05:15:10.413ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3632024-11-13T05:15:10.413ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5007321a-d975-4f35-b369-e9412b70efae", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3642024-11-13T05:15:10.413ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3652024-11-13T05:15:10.416ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "da6b3640-6590-43a2-9da4-0c244db0dedc", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3662024-11-13T05:15:10.416ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3672024-11-13T05:15:10.417ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ab797285-11d3-4efb-b10a-438ba2d2a657", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3682024-11-13T05:15:10.417ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3692024-11-13T05:15:10.419ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
3702024-11-13T05:15:10.419ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 525.460503ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3712024-11-13T05:15:10.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3722024-11-13T05:15:10.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3732024-11-13T05:15:10.452ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
3742024-11-13T05:15:10.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3752024-11-13T05:15:10.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3762024-11-13T05:15:10.462ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3772024-11-13T05:15:10.462ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "55d697e3-4ae0-4495-aac5-af0b4a613941", "content-length": "134", "date": "Wed, 13 Nov 2024 05:15:09 GMT"} })
3782024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3792024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
3802024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3812024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3822024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3832024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3842024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3852024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3862024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3872024-11-13T05:15:10.462ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3882024-11-13T05:15:10.463ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
3892024-11-13T05:15:10.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3902024-11-13T05:15:10.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3912024-11-13T05:15:10.465ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3922024-11-13T05:15:10.465ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "93675a58-f48a-4c57-bc3e-3bc44901014b", "content-length": "2", "date": "Wed, 13 Nov 2024 05:15:09 GMT"} })
3932024-11-13T05:15:10.465ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3942024-11-13T05:15:10.465ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6854810d-4dc9-4780-9e9e-9245a9bb305a", "content-length": "52", "date": "Wed, 13 Nov 2024 05:15:09 GMT"} })
3952024-11-13T05:15:10.465ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
3962024-11-13T05:15:10.465ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3972024-11-13T05:15:10.577ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ad0ae4f2-3706-4cb0-acdc-a6059791fb2a", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
3982024-11-13T05:15:10.577ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
3992024-11-13T05:15:10.577ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4002024-11-13T05:15:10.577ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ccab279-e991-4e4b-adee-836cebdea939", "content-length": "682", "date": "Wed, 13 Nov 2024 05:15:10 GMT"} })
4012024-11-13T05:15:10.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4022024-11-13T05:15:10.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4032024-11-13T05:15:10.580ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1260 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 2e94c078-56b4-4923-b82d-e1891446a44e response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
4042024-11-13T05:15:10.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4052024-11-13T05:15:10.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4062024-11-13T05:15:10.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4072024-11-13T05:15:10.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4082024-11-13T05:15:10.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4092024-11-13T05:15:10.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4102024-11-13T05:15:10.594ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 700.040009ms iteration = 15 status = {}
4112024-11-13T05:15:10.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 254693a0-7908-45b0-982f-d2c7697fcd4b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4122024-11-13T05:15:10.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 254693a0-7908-45b0-982f-d2c7697fcd4b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4132024-11-13T05:15:10.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 254693a0-7908-45b0-982f-d2c7697fcd4b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4142024-11-13T05:15:11.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 28e66308-9d95-449a-8270-be81005023b6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4152024-11-13T05:15:11.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 28e66308-9d95-449a-8270-be81005023b6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4162024-11-13T05:15:11.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 28e66308-9d95-449a-8270-be81005023b6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4172024-11-13T05:15:12.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9edf8f8f-ec65-497e-9fef-a0a8dc8f7473 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4182024-11-13T05:15:12.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9edf8f8f-ec65-497e-9fef-a0a8dc8f7473 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4192024-11-13T05:15:12.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9edf8f8f-ec65-497e-9fef-a0a8dc8f7473 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4202024-11-13T05:15:13.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6658811-e26b-49c6-9ab6-6cd865496f9d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4212024-11-13T05:15:13.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6658811-e26b-49c6-9ab6-6cd865496f9d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4222024-11-13T05:15:13.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6658811-e26b-49c6-9ab6-6cd865496f9d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4232024-11-13T05:15:14.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 041aa691-b878-417d-b4e4-f4f26b489de8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4242024-11-13T05:15:14.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 041aa691-b878-417d-b4e4-f4f26b489de8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4252024-11-13T05:15:14.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 041aa691-b878-417d-b4e4-f4f26b489de8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4262024-11-13T05:15:15.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 86d59c1c-9fa6-4f2e-ab91-d3e313dd8498 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4272024-11-13T05:15:15.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 86d59c1c-9fa6-4f2e-ab91-d3e313dd8498 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4282024-11-13T05:15:15.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 86d59c1c-9fa6-4f2e-ab91-d3e313dd8498 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4292024-11-13T05:15:16.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4955924b-43fa-4cbb-a128-077c10891abd roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4302024-11-13T05:15:16.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4955924b-43fa-4cbb-a128-077c10891abd resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4312024-11-13T05:15:16.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4955924b-43fa-4cbb-a128-077c10891abd response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4322024-11-13T05:15:17.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eaf6a2c1-95d1-47d9-8c9a-713841482be6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4332024-11-13T05:15:17.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eaf6a2c1-95d1-47d9-8c9a-713841482be6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4342024-11-13T05:15:17.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eaf6a2c1-95d1-47d9-8c9a-713841482be6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4352024-11-13T05:15:18.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 95cd6d76-aa9f-4420-8b78-296b63631582 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4362024-11-13T05:15:18.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 95cd6d76-aa9f-4420-8b78-296b63631582 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4372024-11-13T05:15:18.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 95cd6d76-aa9f-4420-8b78-296b63631582 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4382024-11-13T05:15:19.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2a18a201-ff7f-4313-a509-f30ae16d6959 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4392024-11-13T05:15:19.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2a18a201-ff7f-4313-a509-f30ae16d6959 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4402024-11-13T05:15:19.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2a18a201-ff7f-4313-a509-f30ae16d6959 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4412024-11-13T05:15:19.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
4422024-11-13T05:15:19.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
4432024-11-13T05:15:19.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4442024-11-13T05:15:19.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4452024-11-13T05:15:19.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4462024-11-13T05:15:19.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4472024-11-13T05:15:19.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4482024-11-13T05:15:19.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4492024-11-13T05:15:19.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4502024-11-13T05:15:19.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4512024-11-13T05:15:19.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4522024-11-13T05:15:19.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4532024-11-13T05:15:19.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4542024-11-13T05:15:19.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
4552024-11-13T05:15:19.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4562024-11-13T05:15:19.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4572024-11-13T05:15:19.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
4582024-11-13T05:15:19.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.364923ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
4592024-11-13T05:15:19.928ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4602024-11-13T05:15:19.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4612024-11-13T05:15:19.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.698729ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4622024-11-13T05:15:20.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dc967592-52a6-4c5d-b0a1-47c824680c6f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4632024-11-13T05:15:20.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dc967592-52a6-4c5d-b0a1-47c824680c6f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4642024-11-13T05:15:20.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dc967592-52a6-4c5d-b0a1-47c824680c6f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4652024-11-13T05:15:21.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5e7c2602-ecd9-4474-8ac6-6304baaf1613 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4662024-11-13T05:15:21.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5e7c2602-ecd9-4474-8ac6-6304baaf1613 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4672024-11-13T05:15:21.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5e7c2602-ecd9-4474-8ac6-6304baaf1613 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4682024-11-13T05:15:22.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c986167b-4ac0-4f6f-b795-4f93283b4b50 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4692024-11-13T05:15:22.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c986167b-4ac0-4f6f-b795-4f93283b4b50 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4702024-11-13T05:15:22.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c986167b-4ac0-4f6f-b795-4f93283b4b50 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4712024-11-13T05:15:23.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 953897ea-1bff-43e2-b43d-0e923a0c8c0a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4722024-11-13T05:15:23.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 953897ea-1bff-43e2-b43d-0e923a0c8c0a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4732024-11-13T05:15:23.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 953897ea-1bff-43e2-b43d-0e923a0c8c0a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4742024-11-13T05:15:25.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eeafa35a-a735-4f50-9010-2c91740bb215 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4752024-11-13T05:15:25.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eeafa35a-a735-4f50-9010-2c91740bb215 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4762024-11-13T05:15:25.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eeafa35a-a735-4f50-9010-2c91740bb215 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4772024-11-13T05:15:25.578ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 3bd13f0e-dfa7-4dc0-8b57-44dbd5195d7f response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
4782024-11-13T05:15:26.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 80a486b1-a35c-4b26-a20c-8c0fba8762c2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4792024-11-13T05:15:26.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 80a486b1-a35c-4b26-a20c-8c0fba8762c2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4802024-11-13T05:15:26.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 80a486b1-a35c-4b26-a20c-8c0fba8762c2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4812024-11-13T05:15:27.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9fee74bd-2373-4078-9bfe-cec16a0f03cc roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4822024-11-13T05:15:27.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9fee74bd-2373-4078-9bfe-cec16a0f03cc resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4832024-11-13T05:15:27.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9fee74bd-2373-4078-9bfe-cec16a0f03cc response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4842024-11-13T05:15:28.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a97bc594-5fd3-42c0-968a-465dd2376e0f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4852024-11-13T05:15:28.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a97bc594-5fd3-42c0-968a-465dd2376e0f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4862024-11-13T05:15:28.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a97bc594-5fd3-42c0-968a-465dd2376e0f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4872024-11-13T05:15:29.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b55bb650-accd-48b5-98e2-c3d6e8f40322 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4882024-11-13T05:15:29.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b55bb650-accd-48b5-98e2-c3d6e8f40322 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4892024-11-13T05:15:29.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b55bb650-accd-48b5-98e2-c3d6e8f40322 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
4902024-11-13T05:15:29.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
4912024-11-13T05:15:29.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
4922024-11-13T05:15:29.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4932024-11-13T05:15:29.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4942024-11-13T05:15:29.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4952024-11-13T05:15:29.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4962024-11-13T05:15:29.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4972024-11-13T05:15:29.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982024-11-13T05:15:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4992024-11-13T05:15:29.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.161816ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5002024-11-13T05:15:29.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5012024-11-13T05:15:29.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5022024-11-13T05:15:29.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5032024-11-13T05:15:29.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5042024-11-13T05:15:29.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5052024-11-13T05:15:29.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5062024-11-13T05:15:29.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
5072024-11-13T05:15:29.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5082024-11-13T05:15:29.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5092024-11-13T05:15:29.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
5102024-11-13T05:15:29.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.610788ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
5112024-11-13T05:15:30.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3c2ccc9d-9ea4-4b0b-8dbc-2bd7f7ddb116 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5122024-11-13T05:15:30.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3c2ccc9d-9ea4-4b0b-8dbc-2bd7f7ddb116 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5132024-11-13T05:15:30.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3c2ccc9d-9ea4-4b0b-8dbc-2bd7f7ddb116 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5142024-11-13T05:15:31.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2e69935-ead8-4494-b630-2706122dc0e5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5152024-11-13T05:15:31.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2e69935-ead8-4494-b630-2706122dc0e5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5162024-11-13T05:15:31.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2e69935-ead8-4494-b630-2706122dc0e5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5172024-11-13T05:15:32.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 074b954a-7dfc-426a-ab7c-c16a0df7e198 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5182024-11-13T05:15:32.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 074b954a-7dfc-426a-ab7c-c16a0df7e198 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5192024-11-13T05:15:32.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 074b954a-7dfc-426a-ab7c-c16a0df7e198 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5202024-11-13T05:15:33.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c1250789-ae79-49da-aecc-3f898da49667 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5212024-11-13T05:15:33.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c1250789-ae79-49da-aecc-3f898da49667 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5222024-11-13T05:15:33.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c1250789-ae79-49da-aecc-3f898da49667 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5232024-11-13T05:15:34.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f9fb1085-9a24-4b58-a9af-67713e8e119f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5242024-11-13T05:15:34.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f9fb1085-9a24-4b58-a9af-67713e8e119f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5252024-11-13T05:15:34.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f9fb1085-9a24-4b58-a9af-67713e8e119f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5262024-11-13T05:15:35.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4c8cf03-038e-448e-8ef9-4d1647e16d57 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5272024-11-13T05:15:35.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4c8cf03-038e-448e-8ef9-4d1647e16d57 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5282024-11-13T05:15:35.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4c8cf03-038e-448e-8ef9-4d1647e16d57 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5292024-11-13T05:15:36.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 262f7339-4dac-4e29-b3b6-96c2ca02a66a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5302024-11-13T05:15:36.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 262f7339-4dac-4e29-b3b6-96c2ca02a66a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5312024-11-13T05:15:36.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 262f7339-4dac-4e29-b3b6-96c2ca02a66a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5322024-11-13T05:15:37.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14f98a03-017c-4ac3-b550-1b28c584cde7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5332024-11-13T05:15:37.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14f98a03-017c-4ac3-b550-1b28c584cde7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5342024-11-13T05:15:37.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14f98a03-017c-4ac3-b550-1b28c584cde7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5352024-11-13T05:15:38.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c081e8fa-47bb-49fb-9e06-926664fb8f6a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5362024-11-13T05:15:38.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c081e8fa-47bb-49fb-9e06-926664fb8f6a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5372024-11-13T05:15:38.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c081e8fa-47bb-49fb-9e06-926664fb8f6a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5382024-11-13T05:15:39.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f7c7c716-d538-49e1-8a89-36420e4c8763 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5392024-11-13T05:15:39.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f7c7c716-d538-49e1-8a89-36420e4c8763 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5402024-11-13T05:15:39.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f7c7c716-d538-49e1-8a89-36420e4c8763 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
5412024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
5422024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
5432024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5442024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5452024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
5462024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
5472024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5482024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5492024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
5502024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
5512024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5522024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5532024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
5542024-11-13T05:15:39.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
5552024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5562024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5572024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
5582024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5592024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
5602024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5612024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
5622024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
5632024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5642024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5652024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
5662024-11-13T05:15:39.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5672024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
5682024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5692024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5702024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
5712024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5722024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
5732024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5742024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
5752024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5762024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5772024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5782024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5792024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5802024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5812024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5822024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5832024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5842024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5852024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5862024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5872024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5882024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5892024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5902024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5912024-11-13T05:15:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5922024-11-13T05:15:39.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.891205ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
5932024-11-13T05:15:39.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942024-11-13T05:15:39.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5952024-11-13T05:15:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5962024-11-13T05:15:39.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.59689ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5972024-11-13T05:15:39.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-11-13T05:15:39.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5992024-11-13T05:15:39.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6002024-11-13T05:15:39.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6012024-11-13T05:15:39.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6022024-11-13T05:15:39.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6032024-11-13T05:15:39.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6042024-11-13T05:15:39.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5321, tv_nsec: 415591051 } })
6052024-11-13T05:15:39.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062024-11-13T05:15:39.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5321, tv_nsec: 415840774 } })
6072024-11-13T05:15:39.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
6082024-11-13T05:15:39.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
6092024-11-13T05:15:39.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6102024-11-13T05:15:39.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6112024-11-13T05:15:39.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6122024-11-13T05:15:39.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6132024-11-13T05:15:39.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6142024-11-13T05:15:39.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6152024-11-13T05:15:39.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6162024-11-13T05:15:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6172024-11-13T05:15:39.910ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6182024-11-13T05:15:39.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6192024-11-13T05:15:39.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6202024-11-13T05:15:39.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6212024-11-13T05:15:39.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6222024-11-13T05:15:39.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5321, tv_nsec: 425123515 } })
6232024-11-13T05:15:39.914ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
6242024-11-13T05:15:39.914ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6252024-11-13T05:15:39.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6262024-11-13T05:15:39.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6272024-11-13T05:15:39.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6282024-11-13T05:15:39.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6292024-11-13T05:15:39.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6302024-11-13T05:15:39.929ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6312024-11-13T05:15:39.929ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6322024-11-13T05:15:39.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6332024-11-13T05:15:39.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6342024-11-13T05:15:39.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6352024-11-13T05:15:39.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6362024-11-13T05:15:39.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.920622ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
6372024-11-13T05:15:39.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6382024-11-13T05:15:39.937ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6392024-11-13T05:15:39.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6402024-11-13T05:15:39.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6412024-11-13T05:15:39.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6422024-11-13T05:15:39.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6432024-11-13T05:15:39.938ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6442024-11-13T05:15:39.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6452024-11-13T05:15:39.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6462024-11-13T05:15:39.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6472024-11-13T05:15:39.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6482024-11-13T05:15:39.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6492024-11-13T05:15:39.948ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502024-11-13T05:15:39.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6512024-11-13T05:15:39.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.096553ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6522024-11-13T05:15:39.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6532024-11-13T05:15:39.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6542024-11-13T05:15:39.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6552024-11-13T05:15:39.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6562024-11-13T05:15:39.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
6572024-11-13T05:15:39.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6582024-11-13T05:15:39.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6592024-11-13T05:15:39.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
6602024-11-13T05:15:39.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6612024-11-13T05:15:39.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6622024-11-13T05:15:39.954ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.182447ms iteration = 16 status = 0
6632024-11-13T05:15:39.961ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
6642024-11-13T05:15:39.961ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.093997ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
6652024-11-13T05:15:39.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.806074ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6662024-11-13T05:15:39.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6672024-11-13T05:15:39.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6682024-11-13T05:15:39.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6692024-11-13T05:15:39.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6702024-11-13T05:15:39.972ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6712024-11-13T05:15:39.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6722024-11-13T05:15:39.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.212323ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6732024-11-13T05:15:39.974ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6742024-11-13T05:15:39.974ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6752024-11-13T05:15:39.974ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6762024-11-13T05:15:39.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6772024-11-13T05:15:39.992ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6782024-11-13T05:15:39.992ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.478752ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6792024-11-13T05:15:40.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6802024-11-13T05:15:40.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6812024-11-13T05:15:40.000ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6822024-11-13T05:15:40.000ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6832024-11-13T05:15:40.000ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "284ea2bf-76b5-442a-bcd5-31a7ce064169", "content-length": "26", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
6842024-11-13T05:15:40.000ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6852024-11-13T05:15:40.000ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1915bc83-6bb0-4416-a1e9-9ac6535f0c22", "content-length": "26", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
6862024-11-13T05:15:40.000ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6872024-11-13T05:15:40.002ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6882024-11-13T05:15:40.002ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6892024-11-13T05:15:40.008ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6902024-11-13T05:15:40.009ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6912024-11-13T05:15:40.009ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.177288ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6922024-11-13T05:15:40.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6932024-11-13T05:15:40.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.868456ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6942024-11-13T05:15:40.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6952024-11-13T05:15:40.026ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.50364ms iteration = 19 status = {"physical_disks_added":0}
6962024-11-13T05:15:40.029ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
6972024-11-13T05:15:40.029ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6982024-11-13T05:15:40.029ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c277033a-ed0b-4a36-ba15-3a634530be4b", "content-length": "26", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
6992024-11-13T05:15:40.029ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7002024-11-13T05:15:40.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
7012024-11-13T05:15:40.051ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022024-11-13T05:15:40.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7032024-11-13T05:15:40.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7042024-11-13T05:15:40.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7052024-11-13T05:15:40.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7062024-11-13T05:15:40.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7072024-11-13T05:15:40.082ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7082024-11-13T05:15:40.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7092024-11-13T05:15:40.089ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7102024-11-13T05:15:40.089ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "46cf2c9a-34d4-4911-b288-9312f0db1a17", "content-length": "1", "date": "Wed, 13 Nov 2024 05:15:39 GMT"} })
7112024-11-13T05:15:40.091ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7122024-11-13T05:15:40.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7132024-11-13T05:15:40.099ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 204.273415ms iteration = 16 status = {}
7142024-11-13T05:15:40.112ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7152024-11-13T05:15:40.112ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7162024-11-13T05:15:40.112ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dc6bfa5-0eab-4340-9cfe-9cf9afea619d", "content-length": "372", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7172024-11-13T05:15:40.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7182024-11-13T05:15:40.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7192024-11-13T05:15:40.114ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.563089ms iteration = 16 status = null
7202024-11-13T05:15:40.156ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7212024-11-13T05:15:40.156ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7222024-11-13T05:15:40.156ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "58e53b93-8982-42d6-81eb-eca65a8fbb74", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7232024-11-13T05:15:40.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7242024-11-13T05:15:40.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7252024-11-13T05:15:40.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7262024-11-13T05:15:40.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7272024-11-13T05:15:40.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7282024-11-13T05:15:40.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7292024-11-13T05:15:40.164ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7302024-11-13T05:15:40.164ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7312024-11-13T05:15:40.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "63dd1306-195d-47ec-a45c-141b1cdab8b0", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7322024-11-13T05:15:40.166ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 271.514934ms iteration = 17 status = {}
7332024-11-13T05:15:40.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7342024-11-13T05:15:40.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7352024-11-13T05:15:40.199ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7362024-11-13T05:15:40.199ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "274529b0-d3f9-4055-a288-fe2f1b4c223d", "content-length": "691", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7372024-11-13T05:15:40.199ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7382024-11-13T05:15:40.199ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7392024-11-13T05:15:40.199ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7402024-11-13T05:15:40.201ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 306.765801ms iteration = 16 status = {}
7412024-11-13T05:15:40.201ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
7422024-11-13T05:15:40.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7432024-11-13T05:15:40.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7442024-11-13T05:15:40.210ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7452024-11-13T05:15:40.211ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ede3ec15-65e4-425b-b286-42bf463ad5bb", "content-length": "134", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7462024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7472024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
7482024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7492024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7502024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7512024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7522024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7532024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7542024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7552024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7562024-11-13T05:15:40.211ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
7572024-11-13T05:15:40.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7582024-11-13T05:15:40.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7592024-11-13T05:15:40.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7602024-11-13T05:15:40.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "da214ecc-169b-414c-aa6d-75fbe29af385", "content-length": "2", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7612024-11-13T05:15:40.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7622024-11-13T05:15:40.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f709cde-e5f5-4c2d-a494-c1491be82c4d", "content-length": "52", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7632024-11-13T05:15:40.214ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
7642024-11-13T05:15:40.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7652024-11-13T05:15:40.314ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "87d1cc30-b7dd-4152-898f-f10493e23f6b", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7662024-11-13T05:15:40.314ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
7672024-11-13T05:15:40.314ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7682024-11-13T05:15:40.314ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6af38d79-38f5-4dac-958a-196604022a35", "content-length": "682", "date": "Wed, 13 Nov 2024 05:15:40 GMT"} })
7692024-11-13T05:15:40.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7702024-11-13T05:15:40.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7712024-11-13T05:15:40.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7722024-11-13T05:15:40.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7732024-11-13T05:15:40.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7742024-11-13T05:15:40.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7752024-11-13T05:15:40.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7762024-11-13T05:15:40.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7772024-11-13T05:15:40.331ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 436.730557ms iteration = 16 status = {}
7782024-11-13T05:15:40.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = afb9b214-92e6-4668-b27d-e1c6b4cdc1af roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7792024-11-13T05:15:40.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = afb9b214-92e6-4668-b27d-e1c6b4cdc1af resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7802024-11-13T05:15:40.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = afb9b214-92e6-4668-b27d-e1c6b4cdc1af response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7812024-11-13T05:15:40.578ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1240 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 87df42ed-b7a3-4680-806a-91891440672f response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
7822024-11-13T05:15:41.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26813a7d-5ead-4ccf-b06c-d3ee602f3bcf roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7832024-11-13T05:15:41.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26813a7d-5ead-4ccf-b06c-d3ee602f3bcf resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7842024-11-13T05:15:41.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26813a7d-5ead-4ccf-b06c-d3ee602f3bcf response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7852024-11-13T05:15:42.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1d38d914-ebb1-4f63-ae61-e92d474e92d8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7862024-11-13T05:15:42.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1d38d914-ebb1-4f63-ae61-e92d474e92d8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7872024-11-13T05:15:42.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1d38d914-ebb1-4f63-ae61-e92d474e92d8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7882024-11-13T05:15:43.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dd427a5a-f14d-4b9e-8af0-6dae138e6a9a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7892024-11-13T05:15:43.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dd427a5a-f14d-4b9e-8af0-6dae138e6a9a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7902024-11-13T05:15:43.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dd427a5a-f14d-4b9e-8af0-6dae138e6a9a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7912024-11-13T05:15:44.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 56e3a4e7-05a5-430e-a140-d1de1c1b1671 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7922024-11-13T05:15:44.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 56e3a4e7-05a5-430e-a140-d1de1c1b1671 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7932024-11-13T05:15:44.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 56e3a4e7-05a5-430e-a140-d1de1c1b1671 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7942024-11-13T05:15:45.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 94dedde9-460c-40e8-9ee4-eb42165a9d2c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7952024-11-13T05:15:45.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 94dedde9-460c-40e8-9ee4-eb42165a9d2c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7962024-11-13T05:15:45.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 94dedde9-460c-40e8-9ee4-eb42165a9d2c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
7972024-11-13T05:15:45.570ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:40807
7982024-11-13T05:15:45.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = b799dbc2-4eda-466a-b8ed-94b97a697bca roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
7992024-11-13T05:15:45.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = b799dbc2-4eda-466a-b8ed-94b97a697bca resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
8002024-11-13T05:15:45.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = b799dbc2-4eda-466a-b8ed-94b97a697bca response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
8012024-11-13T05:15:45.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ffce3a49-fd5a-4331-bfda-4e6a9bf2ff55 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
8022024-11-13T05:15:45.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ffce3a49-fd5a-4331-bfda-4e6a9bf2ff55 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
8032024-11-13T05:15:45.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ffce3a49-fd5a-4331-bfda-4e6a9bf2ff55 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
8042024-11-13T05:15:46.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3ce137c7-c55e-4bca-b176-210e09a385c0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8052024-11-13T05:15:46.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3ce137c7-c55e-4bca-b176-210e09a385c0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8062024-11-13T05:15:46.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3ce137c7-c55e-4bca-b176-210e09a385c0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8072024-11-13T05:15:46.579ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:61825
8082024-11-13T05:15:46.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61825 req_id = f25239d0-5d98-4d17-bd42-8480bdf55776 roles = RoleSet { roles: {} } uri = /metrics/producers
8092024-11-13T05:15:46.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61825 req_id = f25239d0-5d98-4d17-bd42-8480bdf55776 resource = Database result = Ok(()) uri = /metrics/producers
8102024-11-13T05:15:46.616ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 4d997277-f640-48d7-af56-6df261d5afe1
8112024-11-13T05:15:46.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37286 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61825 req_id = f25239d0-5d98-4d17-bd42-8480bdf55776 response_code = 201 uri = /metrics/producers
8122024-11-13T05:15:46.867ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:57600
8132024-11-13T05:15:46.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57600 req_id = 2f5fe885-900e-4ee6-a5ff-05e40de2fe3e roles = RoleSet { roles: {} } uri = /metrics/producers
8142024-11-13T05:15:46.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57600 req_id = 2f5fe885-900e-4ee6-a5ff-05e40de2fe3e resource = Database result = Ok(()) uri = /metrics/producers
8152024-11-13T05:15:46.905ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 10a586d4-9652-4a30-9058-49973290a890
8162024-11-13T05:15:46.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37775 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57600 req_id = 2f5fe885-900e-4ee6-a5ff-05e40de2fe3e response_code = 201 uri = /metrics/producers
8172024-11-13T05:15:47.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 15955451-bfce-4dd9-bfd8-be88a88fa34e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8182024-11-13T05:15:47.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 15955451-bfce-4dd9-bfd8-be88a88fa34e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8192024-11-13T05:15:47.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 15955451-bfce-4dd9-bfd8-be88a88fa34e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8202024-11-13T05:15:47.543ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:52211
8212024-11-13T05:15:47.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52211 req_id = ebca17e6-0b1a-4efc-9640-9c677f4b35e4 roles = RoleSet { roles: {} } uri = /metrics/producers
8222024-11-13T05:15:47.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52211 req_id = ebca17e6-0b1a-4efc-9640-9c677f4b35e4 resource = Database result = Ok(()) uri = /metrics/producers
8232024-11-13T05:15:47.580ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = eb1311f8-6807-471a-a8f7-8fe643dea75d
8242024-11-13T05:15:47.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37309 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52211 req_id = ebca17e6-0b1a-4efc-9640-9c677f4b35e4 response_code = 201 uri = /metrics/producers
8252024-11-13T05:15:48.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 589aac3f-6d8d-4dd9-90ee-d6dcab16769d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8262024-11-13T05:15:48.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 589aac3f-6d8d-4dd9-90ee-d6dcab16769d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8272024-11-13T05:15:48.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 589aac3f-6d8d-4dd9-90ee-d6dcab16769d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8282024-11-13T05:15:49.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dc0943d2-5813-4c1b-adbf-ee7a9462598f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8292024-11-13T05:15:49.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dc0943d2-5813-4c1b-adbf-ee7a9462598f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8302024-11-13T05:15:49.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dc0943d2-5813-4c1b-adbf-ee7a9462598f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8312024-11-13T05:15:49.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
8322024-11-13T05:15:49.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
8332024-11-13T05:15:49.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8342024-11-13T05:15:49.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8352024-11-13T05:15:49.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8362024-11-13T05:15:49.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8372024-11-13T05:15:49.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8382024-11-13T05:15:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8392024-11-13T05:15:49.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8402024-11-13T05:15:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8412024-11-13T05:15:49.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8422024-11-13T05:15:49.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8432024-11-13T05:15:49.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8442024-11-13T05:15:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
8452024-11-13T05:15:49.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8462024-11-13T05:15:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8472024-11-13T05:15:49.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
8482024-11-13T05:15:49.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.081122ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
8492024-11-13T05:15:49.924ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8502024-11-13T05:15:49.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8512024-11-13T05:15:49.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.057731ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8522024-11-13T05:15:50.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 317b05ad-b697-494f-8e48-97fd81a970d1 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8532024-11-13T05:15:50.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 317b05ad-b697-494f-8e48-97fd81a970d1 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8542024-11-13T05:15:50.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 317b05ad-b697-494f-8e48-97fd81a970d1 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8552024-11-13T05:15:51.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8b619a8f-d38c-496a-bd14-f89e0f495ea7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8562024-11-13T05:15:51.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8b619a8f-d38c-496a-bd14-f89e0f495ea7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8572024-11-13T05:15:51.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8b619a8f-d38c-496a-bd14-f89e0f495ea7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8582024-11-13T05:15:52.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d9793104-5b5b-4595-a5ae-399c5ada35a2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8592024-11-13T05:15:52.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d9793104-5b5b-4595-a5ae-399c5ada35a2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8602024-11-13T05:15:52.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d9793104-5b5b-4595-a5ae-399c5ada35a2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8612024-11-13T05:15:53.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 34bb1570-f387-4842-b26e-dd3949382e0c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8622024-11-13T05:15:53.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 34bb1570-f387-4842-b26e-dd3949382e0c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8632024-11-13T05:15:53.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 34bb1570-f387-4842-b26e-dd3949382e0c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8642024-11-13T05:15:54.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bc6b61d8-3817-4249-8f4b-b054002edb5e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8652024-11-13T05:15:54.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bc6b61d8-3817-4249-8f4b-b054002edb5e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8662024-11-13T05:15:54.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bc6b61d8-3817-4249-8f4b-b054002edb5e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8672024-11-13T05:15:55.578ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1589 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 0216e5b3-6d49-4b53-b84c-0aeb161b54aa response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
8682024-11-13T05:15:55.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 59aee691-80bd-4541-b14f-9ce730ac119c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8692024-11-13T05:15:55.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 59aee691-80bd-4541-b14f-9ce730ac119c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8702024-11-13T05:15:55.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1577 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 59aee691-80bd-4541-b14f-9ce730ac119c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8712024-11-13T05:15:56.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a7f6dfdd-a02e-4a6a-8b7d-b124ddf008c7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8722024-11-13T05:15:56.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a7f6dfdd-a02e-4a6a-8b7d-b124ddf008c7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8732024-11-13T05:15:56.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a7f6dfdd-a02e-4a6a-8b7d-b124ddf008c7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8742024-11-13T05:15:57.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1df1669d-63e2-4bdb-ab18-a6bd10a0c529 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8752024-11-13T05:15:57.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1df1669d-63e2-4bdb-ab18-a6bd10a0c529 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8762024-11-13T05:15:57.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1df1669d-63e2-4bdb-ab18-a6bd10a0c529 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8772024-11-13T05:15:58.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 16f6df64-f74d-4bca-9930-cd5b1a00ab25 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8782024-11-13T05:15:58.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 16f6df64-f74d-4bca-9930-cd5b1a00ab25 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8792024-11-13T05:15:58.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 16f6df64-f74d-4bca-9930-cd5b1a00ab25 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8802024-11-13T05:15:59.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 964e4dab-79ed-45cd-90c2-d98eeda66010 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8812024-11-13T05:15:59.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 964e4dab-79ed-45cd-90c2-d98eeda66010 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8822024-11-13T05:15:59.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 964e4dab-79ed-45cd-90c2-d98eeda66010 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
8832024-11-13T05:15:59.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
8842024-11-13T05:15:59.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
8852024-11-13T05:15:59.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8862024-11-13T05:15:59.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8872024-11-13T05:15:59.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8882024-11-13T05:15:59.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8892024-11-13T05:15:59.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8902024-11-13T05:15:59.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8912024-11-13T05:15:59.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8922024-11-13T05:15:59.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8932024-11-13T05:15:59.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8942024-11-13T05:15:59.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8952024-11-13T05:15:59.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8962024-11-13T05:15:59.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
8972024-11-13T05:15:59.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8982024-11-13T05:15:59.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8992024-11-13T05:15:59.916ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
9002024-11-13T05:15:59.916ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.608259ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
9012024-11-13T05:15:59.923ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9022024-11-13T05:15:59.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9032024-11-13T05:15:59.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.891432ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9042024-11-13T05:16:00.758ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:65433
9052024-11-13T05:16:00.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65433 req_id = 97b0b202-eb8d-49c0-ad88-df6c7b9f0f29 roles = RoleSet { roles: {} } uri = /metrics/producers
9062024-11-13T05:16:00.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65433 req_id = 97b0b202-eb8d-49c0-ad88-df6c7b9f0f29 resource = Database result = Ok(()) uri = /metrics/producers
9072024-11-13T05:16:00.787ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 31913a62-fea3-4aea-8cf3-f0c6569df8d6
9082024-11-13T05:16:00.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28723 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65433 req_id = 97b0b202-eb8d-49c0-ad88-df6c7b9f0f29 response_code = 201 uri = /metrics/producers
9092024-11-13T05:16:00.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bc298e5a-3f9c-422d-99b6-bfbecafc10e9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9102024-11-13T05:16:00.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bc298e5a-3f9c-422d-99b6-bfbecafc10e9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9112024-11-13T05:16:00.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bc298e5a-3f9c-422d-99b6-bfbecafc10e9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9122024-11-13T05:16:01.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9a666e37-7037-420a-ac2e-f54c45802782 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9132024-11-13T05:16:01.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9a666e37-7037-420a-ac2e-f54c45802782 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9142024-11-13T05:16:01.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9a666e37-7037-420a-ac2e-f54c45802782 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9152024-11-13T05:16:02.025ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43223
9162024-11-13T05:16:02.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43223 req_id = de5ab6b4-a95d-4ab6-8c4f-45b50a5be127 roles = RoleSet { roles: {} } uri = /metrics/producers
9172024-11-13T05:16:02.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43223 req_id = de5ab6b4-a95d-4ab6-8c4f-45b50a5be127 resource = Database result = Ok(()) uri = /metrics/producers
9182024-11-13T05:16:02.038ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 059eb401-7fec-4da1-95e5-eea11ccf6ab1
9192024-11-13T05:16:02.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12594 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43223 req_id = de5ab6b4-a95d-4ab6-8c4f-45b50a5be127 response_code = 201 uri = /metrics/producers
9202024-11-13T05:16:02.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 927d9552-e6b9-425c-b045-5bc58b094780 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9212024-11-13T05:16:02.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 927d9552-e6b9-425c-b045-5bc58b094780 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9222024-11-13T05:16:02.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 927d9552-e6b9-425c-b045-5bc58b094780 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9232024-11-13T05:16:03.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 504e2397-746a-41af-856e-078bc7ab9f68 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9242024-11-13T05:16:03.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 504e2397-746a-41af-856e-078bc7ab9f68 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9252024-11-13T05:16:03.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 504e2397-746a-41af-856e-078bc7ab9f68 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9262024-11-13T05:16:04.826ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64297
9272024-11-13T05:16:04.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64297 req_id = d3c9699a-705f-4982-be6c-89d9050b0fb5 roles = RoleSet { roles: {} } uri = /metrics/producers
9282024-11-13T05:16:04.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64297 req_id = d3c9699a-705f-4982-be6c-89d9050b0fb5 resource = Database result = Ok(()) uri = /metrics/producers
9292024-11-13T05:16:04.865ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 05102f67-14d0-4743-98e7-bdad704b43e5
9302024-11-13T05:16:04.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38453 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64297 req_id = d3c9699a-705f-4982-be6c-89d9050b0fb5 response_code = 201 uri = /metrics/producers
9312024-11-13T05:16:04.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b5c372e6-420d-4b00-aabd-5ab7af113b34 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9322024-11-13T05:16:04.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b5c372e6-420d-4b00-aabd-5ab7af113b34 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9332024-11-13T05:16:04.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b5c372e6-420d-4b00-aabd-5ab7af113b34 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9342024-11-13T05:16:05.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7fe1b382-5ab2-4c8d-9656-7ea71995a83a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9352024-11-13T05:16:05.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7fe1b382-5ab2-4c8d-9656-7ea71995a83a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9362024-11-13T05:16:05.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7fe1b382-5ab2-4c8d-9656-7ea71995a83a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9372024-11-13T05:16:06.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a961c9b6-b7cc-48dc-b7b7-49fd97b46756 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9382024-11-13T05:16:06.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a961c9b6-b7cc-48dc-b7b7-49fd97b46756 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9392024-11-13T05:16:06.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a961c9b6-b7cc-48dc-b7b7-49fd97b46756 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9402024-11-13T05:16:07.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fe291b87-36b1-4b74-bb6a-7650923a9296 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9412024-11-13T05:16:07.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fe291b87-36b1-4b74-bb6a-7650923a9296 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9422024-11-13T05:16:07.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fe291b87-36b1-4b74-bb6a-7650923a9296 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9432024-11-13T05:16:08.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 55011bde-d6e0-4058-9479-00e35e35dfa9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9442024-11-13T05:16:08.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 55011bde-d6e0-4058-9479-00e35e35dfa9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9452024-11-13T05:16:08.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 55011bde-d6e0-4058-9479-00e35e35dfa9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
9462024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
9472024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
9482024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9492024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9502024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
9512024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9522024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
9532024-11-13T05:16:09.894ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71
9542024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
9552024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9562024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 26.451\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71"}
9572024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9582024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
9592024-11-13T05:16:09.894ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
9602024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
9612024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9622024-11-13T05:16:09.894ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
9632024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
9642024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
9652024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9662024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
9672024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
9682024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
9692024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
9702024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
9712024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
9722024-11-13T05:16:09.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9732024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9742024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9752024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
9762024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9772024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9782024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
9792024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
9802024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9812024-11-13T05:16:09.895ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-13 05:06:09.895121660 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
9822024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
9832024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
9842024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
9852024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
9862024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
9872024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9882024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
9892024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
9902024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9912024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
9922024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
9932024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9942024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
9952024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9962024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
9972024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
9982024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
9992024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10002024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10012024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
10022024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10032024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
10042024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
10052024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10062024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
10072024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10082024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10092024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
10102024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10112024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10122024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10132024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10142024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10152024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10162024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10172024-11-13T05:16:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10182024-11-13T05:16:09.895ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("038e4c2b-2408-42f1-b025-c88f1167faaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5351, tv_nsec: 406823385 } })
10192024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10202024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10212024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10222024-11-13T05:16:09.896ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("105858cb-d3d5-4677-95c0-079ffa1259be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b62b18b5-c7f6-48f0-ab56-4213f6de7d44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5351, tv_nsec: 406864155 } })
10232024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10242024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10252024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10262024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10272024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10282024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10292024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10302024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10312024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10322024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10332024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10342024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10352024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10362024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
10372024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.543693ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
10382024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
10392024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.456322ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
10402024-11-13T05:16:09.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.023148ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
10412024-11-13T05:16:09.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422024-11-13T05:16:09.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432024-11-13T05:16:09.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.695011ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10442024-11-13T05:16:09.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10452024-11-13T05:16:09.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10462024-11-13T05:16:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10472024-11-13T05:16:09.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10482024-11-13T05:16:09.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10492024-11-13T05:16:09.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10502024-11-13T05:16:09.902ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 7.353594ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
10512024-11-13T05:16:09.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5351, tv_nsec: 415250428 } })
10522024-11-13T05:16:09.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
10532024-11-13T05:16:09.905ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10542024-11-13T05:16:09.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10552024-11-13T05:16:09.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562024-11-13T05:16:09.906ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-13 05:06:09.895121660 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
10572024-11-13T05:16:09.906ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.846384ms iteration = 9 status = {"expiration":"2024-11-13T05:06:09.895121660Z","pruned":[]}
10582024-11-13T05:16:09.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
10592024-11-13T05:16:09.907ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10602024-11-13T05:16:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10612024-11-13T05:16:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10622024-11-13T05:16:09.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10632024-11-13T05:16:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10642024-11-13T05:16:09.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10652024-11-13T05:16:09.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10662024-11-13T05:16:09.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10672024-11-13T05:16:09.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10682024-11-13T05:16:09.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10692024-11-13T05:16:09.911ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
10702024-11-13T05:16:09.911ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
10712024-11-13T05:16:09.911ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.163331ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
10722024-11-13T05:16:09.912ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5351, tv_nsec: 422943405 } })
10732024-11-13T05:16:09.912ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
10742024-11-13T05:16:09.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10752024-11-13T05:16:09.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10762024-11-13T05:16:09.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10772024-11-13T05:16:09.916ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10782024-11-13T05:16:09.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10792024-11-13T05:16:09.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10802024-11-13T05:16:09.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10812024-11-13T05:16:09.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10822024-11-13T05:16:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10832024-11-13T05:16:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10842024-11-13T05:16:09.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 37.024334ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
10852024-11-13T05:16:09.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10862024-11-13T05:16:09.936ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10872024-11-13T05:16:09.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10882024-11-13T05:16:09.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
10892024-11-13T05:16:09.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10902024-11-13T05:16:09.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10912024-11-13T05:16:09.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922024-11-13T05:16:09.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10932024-11-13T05:16:09.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10942024-11-13T05:16:09.940ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10952024-11-13T05:16:09.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10962024-11-13T05:16:09.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10972024-11-13T05:16:09.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10982024-11-13T05:16:09.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10992024-11-13T05:16:09.943ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11002024-11-13T05:16:09.943ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11012024-11-13T05:16:09.943ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11022024-11-13T05:16:09.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11032024-11-13T05:16:09.943ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11042024-11-13T05:16:09.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11052024-11-13T05:16:09.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11062024-11-13T05:16:09.944ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11072024-11-13T05:16:09.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.982975ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11082024-11-13T05:16:09.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11092024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11102024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11112024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11122024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11132024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11142024-11-13T05:16:09.948ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11152024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 53.569148ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11162024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11172024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
11182024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
11192024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
11202024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11212024-11-13T05:16:09.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11222024-11-13T05:16:09.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11232024-11-13T05:16:09.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242024-11-13T05:16:09.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11252024-11-13T05:16:09.950ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11262024-11-13T05:16:09.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11272024-11-13T05:16:09.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11282024-11-13T05:16:09.951ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11292024-11-13T05:16:09.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11302024-11-13T05:16:09.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11312024-11-13T05:16:09.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11322024-11-13T05:16:09.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11332024-11-13T05:16:09.954ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5351, tv_nsec: 465103244 } })
11342024-11-13T05:16:09.954ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
11352024-11-13T05:16:09.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11362024-11-13T05:16:09.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11372024-11-13T05:16:09.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11382024-11-13T05:16:09.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11392024-11-13T05:16:09.956ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
11402024-11-13T05:16:09.956ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
11412024-11-13T05:16:09.956ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
11422024-11-13T05:16:09.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11432024-11-13T05:16:09.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11442024-11-13T05:16:09.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11452024-11-13T05:16:09.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11462024-11-13T05:16:09.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11472024-11-13T05:16:09.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11482024-11-13T05:16:09.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11492024-11-13T05:16:09.959ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
11502024-11-13T05:16:09.959ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.428483ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
11512024-11-13T05:16:09.964ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11522024-11-13T05:16:09.964ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11532024-11-13T05:16:09.964ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.871883ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11542024-11-13T05:16:09.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11552024-11-13T05:16:09.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11562024-11-13T05:16:09.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11572024-11-13T05:16:09.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11582024-11-13T05:16:09.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11592024-11-13T05:16:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11602024-11-13T05:16:09.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11612024-11-13T05:16:09.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11622024-11-13T05:16:09.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
11632024-11-13T05:16:09.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11642024-11-13T05:16:09.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11652024-11-13T05:16:09.974ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.131751ms iteration = 17 status = 0
11662024-11-13T05:16:09.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.417209ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11672024-11-13T05:16:09.998ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11682024-11-13T05:16:09.998ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11692024-11-13T05:16:09.998ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11702024-11-13T05:16:09.998ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11712024-11-13T05:16:09.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.96243ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11722024-11-13T05:16:09.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11732024-11-13T05:16:09.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11742024-11-13T05:16:10.000ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
11752024-11-13T05:16:10.000ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
11762024-11-13T05:16:10.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11772024-11-13T05:16:10.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11782024-11-13T05:16:10.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11792024-11-13T05:16:10.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11802024-11-13T05:16:10.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 77cafe43-216a-46e4-9568-866f309a7b3c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
11812024-11-13T05:16:10.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 77cafe43-216a-46e4-9568-866f309a7b3c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
11822024-11-13T05:16:10.007ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11832024-11-13T05:16:10.008ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
11842024-11-13T05:16:10.008ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 0 version = 2
11852024-11-13T05:16:10.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11862024-11-13T05:16:10.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11872024-11-13T05:16:10.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11882024-11-13T05:16:10.028ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.204785ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11892024-11-13T05:16:10.049ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
11902024-11-13T05:16:10.049ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11912024-11-13T05:16:10.049ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
11922024-11-13T05:16:10.050ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "968bb11c-8467-488b-8581-21443cc755b7", "content-length": "26", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
11932024-11-13T05:16:10.050ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11942024-11-13T05:16:10.052ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11952024-11-13T05:16:10.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11962024-11-13T05:16:10.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11972024-11-13T05:16:10.063ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.940248ms iteration = 20 status = {"physical_disks_added":0}
11982024-11-13T05:16:10.065ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
11992024-11-13T05:16:10.065ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12002024-11-13T05:16:10.065ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10bd33f9-2aa7-4e69-8dc2-538cc277ca44", "content-length": "26", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
12012024-11-13T05:16:10.065ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12022024-11-13T05:16:10.067ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12032024-11-13T05:16:10.109ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
12042024-11-13T05:16:10.181ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12052024-11-13T05:16:10.181ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12062024-11-13T05:16:10.181ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b37f999-9268-4903-a016-a4d8ead81cd7", "content-length": "372", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
12072024-11-13T05:16:10.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12082024-11-13T05:16:10.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12092024-11-13T05:16:10.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12102024-11-13T05:16:10.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12112024-11-13T05:16:10.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 77cafe43-216a-46e4-9568-866f309a7b3c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
12122024-11-13T05:16:10.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-11-13T05:16:10.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12142024-11-13T05:16:10.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12152024-11-13T05:16:10.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12162024-11-13T05:16:10.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12172024-11-13T05:16:10.189ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12182024-11-13T05:16:10.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12192024-11-13T05:16:10.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12202024-11-13T05:16:10.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12212024-11-13T05:16:10.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12222024-11-13T05:16:10.191ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12232024-11-13T05:16:10.192ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 1 version = 2
12242024-11-13T05:16:10.192ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12252024-11-13T05:16:10.192ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-13 05:08:54.834359 UTC dns_group = external generation = 2
12262024-11-13T05:16:10.192ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 297.52879ms iteration = 10 status = {"generation":2}
12272024-11-13T05:16:10.192ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
12282024-11-13T05:16:10.192ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
12292024-11-13T05:16:10.192ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-13 05:08:54.008257 UTC dns_group = internal generation = 1
12302024-11-13T05:16:10.193ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 298.66686ms iteration = 10 status = {"generation":1}
12312024-11-13T05:16:10.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12322024-11-13T05:16:10.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12332024-11-13T05:16:10.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12342024-11-13T05:16:10.207ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.727463ms iteration = 17 status = {}
12352024-11-13T05:16:10.216ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12362024-11-13T05:16:10.216ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12372024-11-13T05:16:10.216ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 321.108536ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12382024-11-13T05:16:10.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12392024-11-13T05:16:10.219ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12402024-11-13T05:16:10.219ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12412024-11-13T05:16:10.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12422024-11-13T05:16:10.222ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12432024-11-13T05:16:10.222ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "291dc752-c39b-463b-8a82-2064b32ad525", "content-length": "1", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
12442024-11-13T05:16:10.224ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12452024-11-13T05:16:10.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12462024-11-13T05:16:10.225ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
12472024-11-13T05:16:10.226ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 331.526208ms iteration = 17 status = null
12482024-11-13T05:16:10.243ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
12492024-11-13T05:16:10.243ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12502024-11-13T05:16:10.243ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3ba20a47-560d-4947-b652-0c6acf3e2c71", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
12512024-11-13T05:16:10.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12522024-11-13T05:16:10.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12532024-11-13T05:16:10.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12542024-11-13T05:16:10.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12552024-11-13T05:16:10.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12562024-11-13T05:16:10.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12572024-11-13T05:16:10.251ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
12582024-11-13T05:16:10.251ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12592024-11-13T05:16:10.251ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91e6d22a-a666-4d0d-a747-c28f5675bb09", "content-length": "26", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
12602024-11-13T05:16:10.251ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12612024-11-13T05:16:10.252ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12622024-11-13T05:16:10.252ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12632024-11-13T05:16:10.252ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8fcfa72c-5665-4330-989b-b38827930228", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
12642024-11-13T05:16:10.254ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
12652024-11-13T05:16:10.254ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-13T05:08:08.157062Z, time_modified: 2024-11-13T05:08:08.157062Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }) }
12662024-11-13T05:16:10.254ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 359.380951ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]}},"default_endpoint":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
12672024-11-13T05:16:10.254ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.628233ms iteration = 18 status = {}
12682024-11-13T05:16:10.289ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
12692024-11-13T05:16:10.289ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 393.852242ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
12702024-11-13T05:16:10.326ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12712024-11-13T05:16:10.326ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "636734b2-31b1-4168-8e53-e14805d7aaf9", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12722024-11-13T05:16:10.326ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12732024-11-13T05:16:10.327ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5b0af2a3-288e-41d6-9db9-198a1afbd61b", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12742024-11-13T05:16:10.327ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12752024-11-13T05:16:10.329ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "fded540e-4cde-4153-9fd9-a09f7b1f1d92", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12762024-11-13T05:16:10.329ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12772024-11-13T05:16:10.331ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
12782024-11-13T05:16:10.331ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.448875ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
12792024-11-13T05:16:10.355ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12802024-11-13T05:16:10.356ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "61ddd1e9-bfc3-48f9-a5e6-e71bf63df661", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12812024-11-13T05:16:10.356ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12822024-11-13T05:16:10.358ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "11cac21c-6112-4e30-b9a8-b99003d28ce0", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12832024-11-13T05:16:10.358ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12842024-11-13T05:16:10.360ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12852024-11-13T05:16:10.360ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 465.052334ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
12862024-11-13T05:16:10.375ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12872024-11-13T05:16:10.375ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "07249c61-19ac-4f89-b00f-97e95f95fb7f", "content-length": "691", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
12882024-11-13T05:16:10.375ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12892024-11-13T05:16:10.375ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12902024-11-13T05:16:10.375ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12912024-11-13T05:16:10.376ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 481.108645ms iteration = 17 status = {}
12922024-11-13T05:16:10.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12932024-11-13T05:16:10.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12942024-11-13T05:16:10.420ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
12952024-11-13T05:16:10.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12962024-11-13T05:16:10.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12972024-11-13T05:16:10.429ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12982024-11-13T05:16:10.429ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "604bb1cc-b3de-47bb-8daa-dceed92ea708", "content-length": "134", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
12992024-11-13T05:16:10.429ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13002024-11-13T05:16:10.429ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
13012024-11-13T05:16:10.429ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13022024-11-13T05:16:10.430ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13032024-11-13T05:16:10.430ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13042024-11-13T05:16:10.430ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13052024-11-13T05:16:10.430ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13062024-11-13T05:16:10.430ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13072024-11-13T05:16:10.430ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13082024-11-13T05:16:10.430ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13092024-11-13T05:16:10.430ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
13102024-11-13T05:16:10.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13112024-11-13T05:16:10.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13122024-11-13T05:16:10.432ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13132024-11-13T05:16:10.432ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "99cc056c-9fc1-4fb2-871c-233e84bdecd6", "content-length": "2", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
13142024-11-13T05:16:10.432ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13152024-11-13T05:16:10.432ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "57800ffa-e37c-4911-b2b1-fffd56419350", "content-length": "52", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
13162024-11-13T05:16:10.432ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
13172024-11-13T05:16:10.432ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13182024-11-13T05:16:10.533ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "91998812-a5e6-4ff9-ac6b-7732a67a8385", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
13192024-11-13T05:16:10.533ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
13202024-11-13T05:16:10.533ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13212024-11-13T05:16:10.534ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3301e94f-3b33-4496-af28-60f757c30fa8", "content-length": "682", "date": "Wed, 13 Nov 2024 05:16:10 GMT"} })
13222024-11-13T05:16:10.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13232024-11-13T05:16:10.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13242024-11-13T05:16:10.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13252024-11-13T05:16:10.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13262024-11-13T05:16:10.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13272024-11-13T05:16:10.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13282024-11-13T05:16:10.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13292024-11-13T05:16:10.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13302024-11-13T05:16:10.550ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 655.60514ms iteration = 17 status = {}
13312024-11-13T05:16:10.578ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1552 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 50ed75ce-4178-4398-886e-10a8c7179432 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
13322024-11-13T05:16:11.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 021e7440-0d6e-41b7-8b87-45526ac8a654 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13332024-11-13T05:16:11.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 021e7440-0d6e-41b7-8b87-45526ac8a654 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13342024-11-13T05:16:11.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 021e7440-0d6e-41b7-8b87-45526ac8a654 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13352024-11-13T05:16:12.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26bdd472-57a3-410a-926b-ad3994f9e29d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13362024-11-13T05:16:12.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26bdd472-57a3-410a-926b-ad3994f9e29d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13372024-11-13T05:16:12.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26bdd472-57a3-410a-926b-ad3994f9e29d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13382024-11-13T05:16:13.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1699beed-af92-43da-a042-8442dc7a512a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13392024-11-13T05:16:13.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1699beed-af92-43da-a042-8442dc7a512a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13402024-11-13T05:16:13.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1699beed-af92-43da-a042-8442dc7a512a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13412024-11-13T05:16:14.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a387e7d-031c-4664-94cf-07bf5d274b88 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13422024-11-13T05:16:14.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a387e7d-031c-4664-94cf-07bf5d274b88 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13432024-11-13T05:16:14.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a387e7d-031c-4664-94cf-07bf5d274b88 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13442024-11-13T05:16:15.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d269e12b-7cd1-4ad5-a8cf-825950cc94fa roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13452024-11-13T05:16:15.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d269e12b-7cd1-4ad5-a8cf-825950cc94fa resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13462024-11-13T05:16:15.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d269e12b-7cd1-4ad5-a8cf-825950cc94fa response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13472024-11-13T05:16:15.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = eef19842-e579-45b2-a473-a8315bc0421a roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
13482024-11-13T05:16:15.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = eef19842-e579-45b2-a473-a8315bc0421a resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
13492024-11-13T05:16:15.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = eef19842-e579-45b2-a473-a8315bc0421a response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
13502024-11-13T05:16:15.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ecc3d96d-98cf-43b3-bc4e-616d9ad7655c roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
13512024-11-13T05:16:15.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ecc3d96d-98cf-43b3-bc4e-616d9ad7655c resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
13522024-11-13T05:16:15.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ecc3d96d-98cf-43b3-bc4e-616d9ad7655c response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
13532024-11-13T05:16:16.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5f83a1b2-3d0e-492b-b589-0deb377021e7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13542024-11-13T05:16:16.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5f83a1b2-3d0e-492b-b589-0deb377021e7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13552024-11-13T05:16:16.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5f83a1b2-3d0e-492b-b589-0deb377021e7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13562024-11-13T05:16:17.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6e3c378-a981-40c7-a21a-c9239f4f8c63 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13572024-11-13T05:16:17.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6e3c378-a981-40c7-a21a-c9239f4f8c63 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13582024-11-13T05:16:17.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6e3c378-a981-40c7-a21a-c9239f4f8c63 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13592024-11-13T05:16:18.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f00525b5-e16a-4c40-b91c-b74fc8f3ec5e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13602024-11-13T05:16:18.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f00525b5-e16a-4c40-b91c-b74fc8f3ec5e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13612024-11-13T05:16:18.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f00525b5-e16a-4c40-b91c-b74fc8f3ec5e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13622024-11-13T05:16:19.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4caa4824-58ec-46ef-b2b1-bc4f213de7c0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13632024-11-13T05:16:19.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4caa4824-58ec-46ef-b2b1-bc4f213de7c0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13642024-11-13T05:16:19.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4caa4824-58ec-46ef-b2b1-bc4f213de7c0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13652024-11-13T05:16:19.894ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
13662024-11-13T05:16:19.894ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13672024-11-13T05:16:19.894ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
13682024-11-13T05:16:19.894ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13692024-11-13T05:16:19.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13702024-11-13T05:16:19.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13712024-11-13T05:16:19.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13722024-11-13T05:16:19.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13732024-11-13T05:16:19.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13742024-11-13T05:16:19.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.664873ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13752024-11-13T05:16:19.899ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13762024-11-13T05:16:19.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13772024-11-13T05:16:19.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13782024-11-13T05:16:19.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13792024-11-13T05:16:19.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13802024-11-13T05:16:19.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13812024-11-13T05:16:19.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
13822024-11-13T05:16:19.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13832024-11-13T05:16:19.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13842024-11-13T05:16:19.916ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
13852024-11-13T05:16:19.916ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.582859ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
13862024-11-13T05:16:20.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ce8ec8a5-d2dd-4497-84ba-c94e57e333db roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13872024-11-13T05:16:20.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ce8ec8a5-d2dd-4497-84ba-c94e57e333db resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13882024-11-13T05:16:20.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ce8ec8a5-d2dd-4497-84ba-c94e57e333db response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13892024-11-13T05:16:21.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 96e4e1b3-00ea-4f9a-aa07-86d712fb0c5a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13902024-11-13T05:16:21.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 96e4e1b3-00ea-4f9a-aa07-86d712fb0c5a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13912024-11-13T05:16:21.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 96e4e1b3-00ea-4f9a-aa07-86d712fb0c5a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13922024-11-13T05:16:22.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bbc3d85a-cc28-43e1-9b09-a0d12fc48c60 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13932024-11-13T05:16:22.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bbc3d85a-cc28-43e1-9b09-a0d12fc48c60 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13942024-11-13T05:16:22.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bbc3d85a-cc28-43e1-9b09-a0d12fc48c60 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13952024-11-13T05:16:23.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89a644b6-e14b-4cd2-9685-f376b4d1a44e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13962024-11-13T05:16:23.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89a644b6-e14b-4cd2-9685-f376b4d1a44e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13972024-11-13T05:16:23.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89a644b6-e14b-4cd2-9685-f376b4d1a44e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13982024-11-13T05:16:24.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8c0beff-1feb-4c53-8fdf-1e3f2ad2bef0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
13992024-11-13T05:16:24.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8c0beff-1feb-4c53-8fdf-1e3f2ad2bef0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14002024-11-13T05:16:24.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8c0beff-1feb-4c53-8fdf-1e3f2ad2bef0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14012024-11-13T05:16:25.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 70e25e3d-8477-4a13-aa0a-79e640278d25 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14022024-11-13T05:16:25.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 70e25e3d-8477-4a13-aa0a-79e640278d25 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14032024-11-13T05:16:25.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 70e25e3d-8477-4a13-aa0a-79e640278d25 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14042024-11-13T05:16:25.579ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1242 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = f130e009-84c1-4adf-ac66-d1f66aa07ee6 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
14052024-11-13T05:16:25.695ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
14062024-11-13T05:16:25.695ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
14072024-11-13T05:16:25.725ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
14082024-11-13T05:16:25.725ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:60154
14092024-11-13T05:16:25.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60154 req_id = 202da1ed-cefe-4c76-8325-767e5f3f0d45 roles = RoleSet { roles: {} } uri = /metrics/producers
14102024-11-13T05:16:25.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60154 req_id = 202da1ed-cefe-4c76-8325-767e5f3f0d45 resource = Database result = Ok(()) uri = /metrics/producers
14112024-11-13T05:16:25.773ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
14122024-11-13T05:16:25.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47530 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60154 req_id = 202da1ed-cefe-4c76-8325-767e5f3f0d45 response_code = 201 uri = /metrics/producers
14132024-11-13T05:16:25.773ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "202da1ed-cefe-4c76-8325-767e5f3f0d45", "content-length": "41", "date": "Wed, 13 Nov 2024 05:16:25 GMT"} })
14142024-11-13T05:16:25.775ZDEBGnexus (producer-registration-task): registered with nexus successfully
14152024-11-13T05:16:25.775ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
14162024-11-13T05:16:26.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 22ff56a6-1e79-4248-baf6-91845b18666f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14172024-11-13T05:16:26.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 22ff56a6-1e79-4248-baf6-91845b18666f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14182024-11-13T05:16:26.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 22ff56a6-1e79-4248-baf6-91845b18666f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14192024-11-13T05:16:27.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d1702988-7cbc-4c24-9a6f-dd25fb13d118 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14202024-11-13T05:16:27.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d1702988-7cbc-4c24-9a6f-dd25fb13d118 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14212024-11-13T05:16:27.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d1702988-7cbc-4c24-9a6f-dd25fb13d118 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14222024-11-13T05:16:28.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ecd1e6cb-cc88-455b-bc64-bf005868f9d0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14232024-11-13T05:16:28.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ecd1e6cb-cc88-455b-bc64-bf005868f9d0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14242024-11-13T05:16:28.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ecd1e6cb-cc88-455b-bc64-bf005868f9d0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14252024-11-13T05:16:29.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1d95c14d-583e-4e2b-a47e-189f416bae24 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14262024-11-13T05:16:29.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1d95c14d-583e-4e2b-a47e-189f416bae24 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14272024-11-13T05:16:29.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1d95c14d-583e-4e2b-a47e-189f416bae24 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14282024-11-13T05:16:29.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
14292024-11-13T05:16:29.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
14302024-11-13T05:16:29.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14312024-11-13T05:16:29.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14322024-11-13T05:16:29.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14332024-11-13T05:16:29.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14342024-11-13T05:16:29.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14352024-11-13T05:16:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14362024-11-13T05:16:29.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.665312ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14372024-11-13T05:16:29.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14382024-11-13T05:16:29.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14392024-11-13T05:16:29.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14402024-11-13T05:16:29.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14412024-11-13T05:16:29.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14422024-11-13T05:16:29.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14432024-11-13T05:16:29.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14442024-11-13T05:16:29.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
14452024-11-13T05:16:29.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14462024-11-13T05:16:29.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14472024-11-13T05:16:29.945ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
14482024-11-13T05:16:29.945ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.601583ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
14492024-11-13T05:16:30.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 1a43e6ca-a0bc-4ab1-88bb-1dd46df1949c roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
14502024-11-13T05:16:30.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 1a43e6ca-a0bc-4ab1-88bb-1dd46df1949c resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
14512024-11-13T05:16:30.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 1a43e6ca-a0bc-4ab1-88bb-1dd46df1949c response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
14522024-11-13T05:16:30.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 7faadfad-eb11-4f79-a501-026a22455d66 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
14532024-11-13T05:16:30.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 7faadfad-eb11-4f79-a501-026a22455d66 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
14542024-11-13T05:16:30.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 7faadfad-eb11-4f79-a501-026a22455d66 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
14552024-11-13T05:16:30.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d74cb066-228d-4c8a-a848-e5cc9e972fdf roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14562024-11-13T05:16:30.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d74cb066-228d-4c8a-a848-e5cc9e972fdf resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14572024-11-13T05:16:30.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d74cb066-228d-4c8a-a848-e5cc9e972fdf response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14582024-11-13T05:16:31.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9ffc3a3-5351-4770-b175-6cb2747889b6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14592024-11-13T05:16:31.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9ffc3a3-5351-4770-b175-6cb2747889b6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14602024-11-13T05:16:31.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9ffc3a3-5351-4770-b175-6cb2747889b6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14612024-11-13T05:16:32.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 884be61a-0d00-4846-9923-53d94878872b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14622024-11-13T05:16:32.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 884be61a-0d00-4846-9923-53d94878872b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14632024-11-13T05:16:32.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 884be61a-0d00-4846-9923-53d94878872b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14642024-11-13T05:16:33.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad558112-fa8d-431a-a265-0f78baafa157 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14652024-11-13T05:16:33.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad558112-fa8d-431a-a265-0f78baafa157 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14662024-11-13T05:16:33.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad558112-fa8d-431a-a265-0f78baafa157 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14672024-11-13T05:16:34.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 789666d3-785b-4a93-bc24-deb993c92cfd roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14682024-11-13T05:16:34.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 789666d3-785b-4a93-bc24-deb993c92cfd resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14692024-11-13T05:16:34.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2175 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 789666d3-785b-4a93-bc24-deb993c92cfd response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14702024-11-13T05:16:35.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 27a065e6-f105-4e5d-ac67-f17aac419a89 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14712024-11-13T05:16:35.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 27a065e6-f105-4e5d-ac67-f17aac419a89 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14722024-11-13T05:16:35.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 27a065e6-f105-4e5d-ac67-f17aac419a89 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14732024-11-13T05:16:36.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 56cebc7d-c094-409f-94b9-e487b151675b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14742024-11-13T05:16:36.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 56cebc7d-c094-409f-94b9-e487b151675b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14752024-11-13T05:16:36.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 56cebc7d-c094-409f-94b9-e487b151675b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14762024-11-13T05:16:37.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 76bd111e-8d87-42d1-b40f-786f5bfbd528 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14772024-11-13T05:16:37.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 76bd111e-8d87-42d1-b40f-786f5bfbd528 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14782024-11-13T05:16:37.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 76bd111e-8d87-42d1-b40f-786f5bfbd528 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14792024-11-13T05:16:38.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78afd307-97b2-494f-91dc-03ebb0e0ca86 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14802024-11-13T05:16:38.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78afd307-97b2-494f-91dc-03ebb0e0ca86 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14812024-11-13T05:16:38.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78afd307-97b2-494f-91dc-03ebb0e0ca86 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14822024-11-13T05:16:39.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e0c08afb-4b5d-4daa-b935-ca26e3ed0075 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14832024-11-13T05:16:39.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e0c08afb-4b5d-4daa-b935-ca26e3ed0075 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14842024-11-13T05:16:39.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e0c08afb-4b5d-4daa-b935-ca26e3ed0075 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
14852024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
14862024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
14872024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14882024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
14892024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14902024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
14912024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
14922024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14932024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14942024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
14952024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14962024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
14972024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14982024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
14992024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15002024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15012024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
15022024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15032024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
15042024-11-13T05:16:39.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15052024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
15062024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15072024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15082024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
15092024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
15102024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15112024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
15122024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15132024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15142024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
15152024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15162024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
15172024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15182024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
15192024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15202024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15212024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15222024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15232024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15242024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15252024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15262024-11-13T05:16:39.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15272024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15282024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15292024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15302024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15312024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15322024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15332024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15342024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15352024-11-13T05:16:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15362024-11-13T05:16:39.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15372024-11-13T05:16:39.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15382024-11-13T05:16:39.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.631151ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15392024-11-13T05:16:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15402024-11-13T05:16:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15412024-11-13T05:16:39.900ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15422024-11-13T05:16:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15432024-11-13T05:16:39.901ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5381, tv_nsec: 411970860 } })
15442024-11-13T05:16:39.901ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
15452024-11-13T05:16:39.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15462024-11-13T05:16:39.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5381, tv_nsec: 414190309 } })
15472024-11-13T05:16:39.903ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
15482024-11-13T05:16:39.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15492024-11-13T05:16:39.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15502024-11-13T05:16:39.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15512024-11-13T05:16:39.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15522024-11-13T05:16:39.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15532024-11-13T05:16:39.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15542024-11-13T05:16:39.910ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15552024-11-13T05:16:39.910ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15562024-11-13T05:16:39.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15572024-11-13T05:16:39.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15582024-11-13T05:16:39.911ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15592024-11-13T05:16:39.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15602024-11-13T05:16:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15612024-11-13T05:16:39.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15622024-11-13T05:16:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15632024-11-13T05:16:39.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15642024-11-13T05:16:39.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15652024-11-13T05:16:39.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.339445ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
15662024-11-13T05:16:39.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672024-11-13T05:16:39.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15682024-11-13T05:16:39.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15692024-11-13T05:16:39.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15702024-11-13T05:16:39.947ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15712024-11-13T05:16:39.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15722024-11-13T05:16:39.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15732024-11-13T05:16:39.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.601609ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15742024-11-13T05:16:39.949ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5381, tv_nsec: 460204992 } })
15752024-11-13T05:16:39.949ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
15762024-11-13T05:16:39.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15772024-11-13T05:16:39.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15782024-11-13T05:16:39.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15792024-11-13T05:16:39.951ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15802024-11-13T05:16:39.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.855949ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
15812024-11-13T05:16:39.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15822024-11-13T05:16:39.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15832024-11-13T05:16:39.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15842024-11-13T05:16:39.952ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15852024-11-13T05:16:39.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15862024-11-13T05:16:39.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15872024-11-13T05:16:39.954ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15882024-11-13T05:16:39.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15892024-11-13T05:16:39.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15902024-11-13T05:16:39.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15912024-11-13T05:16:39.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15922024-11-13T05:16:39.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15932024-11-13T05:16:39.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.747127ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15942024-11-13T05:16:39.959ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15952024-11-13T05:16:39.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15962024-11-13T05:16:39.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15972024-11-13T05:16:39.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15982024-11-13T05:16:39.961ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15992024-11-13T05:16:39.962ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16002024-11-13T05:16:39.962ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.642333ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16012024-11-13T05:16:39.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
16022024-11-13T05:16:39.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16032024-11-13T05:16:39.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16042024-11-13T05:16:39.963ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16052024-11-13T05:16:39.963ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16062024-11-13T05:16:39.963ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16072024-11-13T05:16:39.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16082024-11-13T05:16:39.963ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16092024-11-13T05:16:39.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16102024-11-13T05:16:39.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16112024-11-13T05:16:39.966ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16122024-11-13T05:16:39.966ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16132024-11-13T05:16:39.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 71.533425ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16142024-11-13T05:16:39.974ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
16152024-11-13T05:16:39.974ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.413614ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
16162024-11-13T05:16:39.974ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16172024-11-13T05:16:39.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16182024-11-13T05:16:39.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16192024-11-13T05:16:39.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16202024-11-13T05:16:39.978ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16212024-11-13T05:16:39.981ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16222024-11-13T05:16:39.981ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16232024-11-13T05:16:39.981ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d533f866-6755-4f77-ac2f-ec28b9d0aad5", "content-length": "26", "date": "Wed, 13 Nov 2024 05:16:39 GMT"} })
16242024-11-13T05:16:39.981ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16252024-11-13T05:16:39.982ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16262024-11-13T05:16:39.982ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16272024-11-13T05:16:39.982ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9476b395-4fe9-4bcc-8bce-8caa0d569cd1", "content-length": "26", "date": "Wed, 13 Nov 2024 05:16:39 GMT"} })
16282024-11-13T05:16:39.982ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.95246ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16292024-11-13T05:16:39.982ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16302024-11-13T05:16:39.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
16312024-11-13T05:16:39.982ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16322024-11-13T05:16:39.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16332024-11-13T05:16:39.983ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16342024-11-13T05:16:39.984ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.628625ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16352024-11-13T05:16:39.984ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16362024-11-13T05:16:39.984ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.063159ms iteration = 18 status = 0
16372024-11-13T05:16:40.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16382024-11-13T05:16:40.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16392024-11-13T05:16:40.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16402024-11-13T05:16:40.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16412024-11-13T05:16:40.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16422024-11-13T05:16:40.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16432024-11-13T05:16:40.025ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
16442024-11-13T05:16:40.025ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16452024-11-13T05:16:40.025ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eabbb3d5-fea5-4200-9e13-8386069c04b9", "content-length": "26", "date": "Wed, 13 Nov 2024 05:16:39 GMT"} })
16462024-11-13T05:16:40.025ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16472024-11-13T05:16:40.027ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
16482024-11-13T05:16:40.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-11-13T05:16:40.060ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 165.634268ms iteration = 21 status = {"physical_disks_added":0}
16502024-11-13T05:16:40.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16512024-11-13T05:16:40.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16522024-11-13T05:16:40.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16532024-11-13T05:16:40.073ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16542024-11-13T05:16:40.074ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c358331f-384f-434f-9bba-9b2c51de0236", "content-length": "1", "date": "Wed, 13 Nov 2024 05:16:39 GMT"} })
16552024-11-13T05:16:40.075ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 179.783651ms iteration = 18 status = {}
16562024-11-13T05:16:40.077ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16572024-11-13T05:16:40.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16582024-11-13T05:16:40.090ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16592024-11-13T05:16:40.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16602024-11-13T05:16:40.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b48366e-3ef4-442d-879a-459010a47ff1", "content-length": "372", "date": "Wed, 13 Nov 2024 05:16:40 GMT"} })
16612024-11-13T05:16:40.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16622024-11-13T05:16:40.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16632024-11-13T05:16:40.092ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 197.488966ms iteration = 18 status = null
16642024-11-13T05:16:40.105ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16652024-11-13T05:16:40.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16662024-11-13T05:16:40.105ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "20009cb4-8936-4cc1-aa99-80c07f80f863", "date": "Wed, 13 Nov 2024 05:16:40 GMT"} })
16672024-11-13T05:16:40.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16682024-11-13T05:16:40.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16692024-11-13T05:16:40.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16702024-11-13T05:16:40.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16712024-11-13T05:16:40.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16722024-11-13T05:16:40.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16732024-11-13T05:16:40.116ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16742024-11-13T05:16:40.116ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16752024-11-13T05:16:40.116ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4be07612-275d-4a45-be4d-b5a17ba5851e", "date": "Wed, 13 Nov 2024 05:16:40 GMT"} })
16762024-11-13T05:16:40.118ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 223.385513ms iteration = 19 status = {}
16772024-11-13T05:16:40.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16782024-11-13T05:16:40.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16792024-11-13T05:16:40.161ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
16802024-11-13T05:16:40.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16812024-11-13T05:16:40.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16822024-11-13T05:16:40.171ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16832024-11-13T05:16:40.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0b3b0e2-bfde-4ee2-9c30-b67e9d392e66", "content-length": "134", "date": "Wed, 13 Nov 2024 05:16:39 GMT"} })
16842024-11-13T05:16:40.171ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16852024-11-13T05:16:40.171ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
16862024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16872024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16882024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16892024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16902024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16912024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16922024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16932024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16942024-11-13T05:16:40.172ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
16952024-11-13T05:16:40.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16962024-11-13T05:16:40.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16972024-11-13T05:16:40.186ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16982024-11-13T05:16:40.186ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "44a6798a-f565-44c1-87dc-034fc90f45c5", "content-length": "691", "date": "Wed, 13 Nov 2024 05:16:40 GMT"} })
16992024-11-13T05:16:40.186ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
17002024-11-13T05:16:40.186ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17012024-11-13T05:16:40.186ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17022024-11-13T05:16:40.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17032024-11-13T05:16:40.188ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 292.743428ms iteration = 18 status = {}
17042024-11-13T05:16:40.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "93681430-dd15-4c06-ab2e-3ae262df3a3c", "content-length": "2", "date": "Wed, 13 Nov 2024 05:16:39 GMT"} })
17052024-11-13T05:16:40.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17062024-11-13T05:16:40.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff6e01a3-a27b-4a8c-b161-fa89cbaae67b", "content-length": "52", "date": "Wed, 13 Nov 2024 05:16:39 GMT"} })
17072024-11-13T05:16:40.188ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
17082024-11-13T05:16:40.188ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17092024-11-13T05:16:40.285ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2f594135-2d29-4155-a9dc-090a848dd556", "date": "Wed, 13 Nov 2024 05:16:40 GMT"} })
17102024-11-13T05:16:40.285ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
17112024-11-13T05:16:40.285ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17122024-11-13T05:16:40.286ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dca7e5b-bfe3-46d9-b70f-c6a8db90bc27", "content-length": "682", "date": "Wed, 13 Nov 2024 05:16:40 GMT"} })
17132024-11-13T05:16:40.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17142024-11-13T05:16:40.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17152024-11-13T05:16:40.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17162024-11-13T05:16:40.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17172024-11-13T05:16:40.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17182024-11-13T05:16:40.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17192024-11-13T05:16:40.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17202024-11-13T05:16:40.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17212024-11-13T05:16:40.302ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 407.035637ms iteration = 18 status = {}
17222024-11-13T05:16:40.579ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1458 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = f331bf41-3214-494a-8b45-bbaeff36ed7a response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
17232024-11-13T05:16:40.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ee60e700-56ab-48e9-8ac1-04f305d3553a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17242024-11-13T05:16:40.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ee60e700-56ab-48e9-8ac1-04f305d3553a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17252024-11-13T05:16:40.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ee60e700-56ab-48e9-8ac1-04f305d3553a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17262024-11-13T05:16:41.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2db7010-243f-4559-b34c-5bef5daf5bed roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17272024-11-13T05:16:41.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2db7010-243f-4559-b34c-5bef5daf5bed resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17282024-11-13T05:16:41.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2db7010-243f-4559-b34c-5bef5daf5bed response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17292024-11-13T05:16:42.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1a2a98df-9c93-41f8-8ace-44428f8270dd roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17302024-11-13T05:16:42.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1a2a98df-9c93-41f8-8ace-44428f8270dd resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17312024-11-13T05:16:42.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1a2a98df-9c93-41f8-8ace-44428f8270dd response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17322024-11-13T05:16:43.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2974cb4-ea49-437b-83b7-b6818fec09d0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17332024-11-13T05:16:43.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2974cb4-ea49-437b-83b7-b6818fec09d0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17342024-11-13T05:16:43.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2974cb4-ea49-437b-83b7-b6818fec09d0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17352024-11-13T05:16:44.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 17287ca0-3fa9-4c5d-9216-b29d9506b941 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17362024-11-13T05:16:44.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 17287ca0-3fa9-4c5d-9216-b29d9506b941 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17372024-11-13T05:16:44.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 17287ca0-3fa9-4c5d-9216-b29d9506b941 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17382024-11-13T05:16:46.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e0456b0-83cf-4992-966d-72425a7a6521 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17392024-11-13T05:16:46.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e0456b0-83cf-4992-966d-72425a7a6521 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17402024-11-13T05:16:46.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e0456b0-83cf-4992-966d-72425a7a6521 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17412024-11-13T05:16:47.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7cd89d85-ff0f-48d6-b1fe-79714d5ab220 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17422024-11-13T05:16:47.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7cd89d85-ff0f-48d6-b1fe-79714d5ab220 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17432024-11-13T05:16:47.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7cd89d85-ff0f-48d6-b1fe-79714d5ab220 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17442024-11-13T05:16:48.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad11a8d9-cc1b-4cb7-a6ac-7add282f76e5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17452024-11-13T05:16:48.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad11a8d9-cc1b-4cb7-a6ac-7add282f76e5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17462024-11-13T05:16:48.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad11a8d9-cc1b-4cb7-a6ac-7add282f76e5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17472024-11-13T05:16:49.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 69040a63-d123-4622-936b-6c262fa08f55 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17482024-11-13T05:16:49.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 69040a63-d123-4622-936b-6c262fa08f55 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17492024-11-13T05:16:49.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 69040a63-d123-4622-936b-6c262fa08f55 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17502024-11-13T05:16:49.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
17512024-11-13T05:16:49.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
17522024-11-13T05:16:49.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17532024-11-13T05:16:49.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17542024-11-13T05:16:49.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17552024-11-13T05:16:49.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17562024-11-13T05:16:49.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17572024-11-13T05:16:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17582024-11-13T05:16:49.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17592024-11-13T05:16:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17602024-11-13T05:16:49.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17612024-11-13T05:16:49.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17622024-11-13T05:16:49.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17632024-11-13T05:16:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
17642024-11-13T05:16:49.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17652024-11-13T05:16:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17662024-11-13T05:16:49.914ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
17672024-11-13T05:16:49.914ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.45979ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
17682024-11-13T05:16:49.924ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17692024-11-13T05:16:49.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17702024-11-13T05:16:49.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.813589ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17712024-11-13T05:16:50.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 75a8dc1c-d17f-499d-bc11-793cdbfa929f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17722024-11-13T05:16:50.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 75a8dc1c-d17f-499d-bc11-793cdbfa929f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17732024-11-13T05:16:50.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 75a8dc1c-d17f-499d-bc11-793cdbfa929f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17742024-11-13T05:16:51.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26b06ddf-cb34-41ea-882a-ed165aa91c6d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17752024-11-13T05:16:51.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26b06ddf-cb34-41ea-882a-ed165aa91c6d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17762024-11-13T05:16:51.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 26b06ddf-cb34-41ea-882a-ed165aa91c6d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17772024-11-13T05:16:52.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2132be55-9821-4860-a669-9067b72da7d6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17782024-11-13T05:16:52.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2132be55-9821-4860-a669-9067b72da7d6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17792024-11-13T05:16:52.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2132be55-9821-4860-a669-9067b72da7d6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17802024-11-13T05:16:53.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d9ed1c95-facc-4b17-8631-1d8cb571ae72 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17812024-11-13T05:16:53.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d9ed1c95-facc-4b17-8631-1d8cb571ae72 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17822024-11-13T05:16:53.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d9ed1c95-facc-4b17-8631-1d8cb571ae72 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17832024-11-13T05:16:54.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7c5b72af-06d8-4f93-bf72-d0ad1beac434 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17842024-11-13T05:16:54.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7c5b72af-06d8-4f93-bf72-d0ad1beac434 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17852024-11-13T05:16:54.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7c5b72af-06d8-4f93-bf72-d0ad1beac434 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17862024-11-13T05:16:55.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d3438110-532d-481b-87ae-43f9cdc32f59 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17872024-11-13T05:16:55.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d3438110-532d-481b-87ae-43f9cdc32f59 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17882024-11-13T05:16:55.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d3438110-532d-481b-87ae-43f9cdc32f59 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17892024-11-13T05:16:55.578ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1738 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 1ab31cd2-bbe4-4623-a817-5b0ee247bad8 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
17902024-11-13T05:16:56.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2af4c04-efff-40df-b05d-b3f1d0b4ddcf roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17912024-11-13T05:16:56.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2af4c04-efff-40df-b05d-b3f1d0b4ddcf resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17922024-11-13T05:16:56.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2af4c04-efff-40df-b05d-b3f1d0b4ddcf response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17932024-11-13T05:16:57.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 99f2ed67-bc6c-47bb-a271-9e033a31581b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17942024-11-13T05:16:57.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 99f2ed67-bc6c-47bb-a271-9e033a31581b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17952024-11-13T05:16:57.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 99f2ed67-bc6c-47bb-a271-9e033a31581b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17962024-11-13T05:16:58.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1415f1f1-5d23-42ae-b865-c2d60b3d91f7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17972024-11-13T05:16:58.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1415f1f1-5d23-42ae-b865-c2d60b3d91f7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17982024-11-13T05:16:58.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1415f1f1-5d23-42ae-b865-c2d60b3d91f7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
17992024-11-13T05:16:59.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f88ef9c0-3e8d-4b20-b30a-2d7dc874d8d5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18002024-11-13T05:16:59.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f88ef9c0-3e8d-4b20-b30a-2d7dc874d8d5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18012024-11-13T05:16:59.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f88ef9c0-3e8d-4b20-b30a-2d7dc874d8d5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18022024-11-13T05:16:59.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
18032024-11-13T05:16:59.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18042024-11-13T05:16:59.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
18052024-11-13T05:16:59.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18062024-11-13T05:16:59.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18072024-11-13T05:16:59.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18082024-11-13T05:16:59.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18092024-11-13T05:16:59.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18102024-11-13T05:16:59.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18112024-11-13T05:16:59.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.289719ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18122024-11-13T05:16:59.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18132024-11-13T05:16:59.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18142024-11-13T05:16:59.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18152024-11-13T05:16:59.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18162024-11-13T05:16:59.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18172024-11-13T05:16:59.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18182024-11-13T05:16:59.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
18192024-11-13T05:16:59.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18202024-11-13T05:16:59.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18212024-11-13T05:16:59.915ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
18222024-11-13T05:16:59.915ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.919284ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
18232024-11-13T05:17:00.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 503d5e4b-9914-4d79-921e-74ec28bdb465 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18242024-11-13T05:17:00.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 503d5e4b-9914-4d79-921e-74ec28bdb465 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18252024-11-13T05:17:00.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 503d5e4b-9914-4d79-921e-74ec28bdb465 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18262024-11-13T05:17:00.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = b0b7c90c-c3ac-45c6-8f3b-e9df65f8a7dd roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
18272024-11-13T05:17:00.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = b0b7c90c-c3ac-45c6-8f3b-e9df65f8a7dd resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
18282024-11-13T05:17:00.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = b0b7c90c-c3ac-45c6-8f3b-e9df65f8a7dd response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
18292024-11-13T05:17:00.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 75fed20b-1fdd-4595-abe2-89fb0dcdaf3d roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
18302024-11-13T05:17:00.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 75fed20b-1fdd-4595-abe2-89fb0dcdaf3d resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
18312024-11-13T05:17:00.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 75fed20b-1fdd-4595-abe2-89fb0dcdaf3d response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
18322024-11-13T05:17:01.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fc4c2831-6430-47b8-a62f-398b73949434 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18332024-11-13T05:17:01.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fc4c2831-6430-47b8-a62f-398b73949434 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18342024-11-13T05:17:01.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fc4c2831-6430-47b8-a62f-398b73949434 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18352024-11-13T05:17:02.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51017b18-ebfe-4522-abef-8cab5d953a11 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18362024-11-13T05:17:02.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51017b18-ebfe-4522-abef-8cab5d953a11 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18372024-11-13T05:17:02.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51017b18-ebfe-4522-abef-8cab5d953a11 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18382024-11-13T05:17:03.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cdf5fcd1-6f75-4425-a3de-cc6443173262 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18392024-11-13T05:17:03.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cdf5fcd1-6f75-4425-a3de-cc6443173262 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18402024-11-13T05:17:03.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cdf5fcd1-6f75-4425-a3de-cc6443173262 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18412024-11-13T05:17:04.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 27b14b7e-26c9-433e-bf73-fe2d04480b2d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18422024-11-13T05:17:04.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 27b14b7e-26c9-433e-bf73-fe2d04480b2d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18432024-11-13T05:17:04.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 27b14b7e-26c9-433e-bf73-fe2d04480b2d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18442024-11-13T05:17:05.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7f1a6298-780d-4296-b86d-0ae2b4a690ed roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18452024-11-13T05:17:05.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7f1a6298-780d-4296-b86d-0ae2b4a690ed resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18462024-11-13T05:17:05.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7f1a6298-780d-4296-b86d-0ae2b4a690ed response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18472024-11-13T05:17:06.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 965e29fa-9acf-4498-924b-90ca24ec81c3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18482024-11-13T05:17:06.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 965e29fa-9acf-4498-924b-90ca24ec81c3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18492024-11-13T05:17:06.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 965e29fa-9acf-4498-924b-90ca24ec81c3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18502024-11-13T05:17:07.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fff1ba67-d3c2-4753-a740-c8b783d4743b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18512024-11-13T05:17:07.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fff1ba67-d3c2-4753-a740-c8b783d4743b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18522024-11-13T05:17:07.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fff1ba67-d3c2-4753-a740-c8b783d4743b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18532024-11-13T05:17:08.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4ccdf4b8-d690-49cd-8c65-3ec3486a75f4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18542024-11-13T05:17:08.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4ccdf4b8-d690-49cd-8c65-3ec3486a75f4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18552024-11-13T05:17:08.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4ccdf4b8-d690-49cd-8c65-3ec3486a75f4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18562024-11-13T05:17:09.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bf86a4cd-15d4-4c5a-a5f3-4d644df6fac1 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18572024-11-13T05:17:09.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bf86a4cd-15d4-4c5a-a5f3-4d644df6fac1 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18582024-11-13T05:17:09.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2409 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bf86a4cd-15d4-4c5a-a5f3-4d644df6fac1 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
18592024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
18602024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18612024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18622024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18632024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
18642024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18652024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
18662024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
18672024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18682024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18692024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18702024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
18712024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18722024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
18732024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18742024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
18752024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
18762024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18772024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18782024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
18792024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
18802024-11-13T05:17:09.895ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71
18812024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18822024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.031\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71"}
18832024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
18842024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18852024-11-13T05:17:09.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
18862024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18872024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
18882024-11-13T05:17:09.896ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18892024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
18902024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18912024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18922024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
18932024-11-13T05:17:09.896ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-13 05:07:09.895941012 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18942024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
18952024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18962024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
18972024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18982024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
18992024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19002024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
19012024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19022024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
19032024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19042024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
19052024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
19062024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
19072024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19082024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
19092024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19102024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19112024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
19122024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
19132024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19142024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
19152024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19162024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
19172024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19182024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
19192024-11-13T05:17:09.896ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19202024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19212024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
19222024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19232024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19242024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
19252024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
19262024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19272024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19282024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19292024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19302024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19312024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19322024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19332024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19342024-11-13T05:17:09.896ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("105858cb-d3d5-4677-95c0-079ffa1259be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b62b18b5-c7f6-48f0-ab56-4213f6de7d44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5411, tv_nsec: 406898996 } })
19352024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19362024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19372024-11-13T05:17:09.896ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("038e4c2b-2408-42f1-b025-c88f1167faaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5411, tv_nsec: 406963756 } })
19382024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19392024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19402024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19412024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19422024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19432024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19442024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19452024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19462024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19472024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19482024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19492024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19502024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19512024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19522024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19532024-11-13T05:17:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19542024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19552024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19562024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19572024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
19582024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.315121ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
19592024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
19602024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.012559ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
19612024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19622024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19632024-11-13T05:17:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19642024-11-13T05:17:09.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19652024-11-13T05:17:09.898ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5411, tv_nsec: 408863603 } })
19662024-11-13T05:17:09.898ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
19672024-11-13T05:17:09.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19682024-11-13T05:17:09.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19692024-11-13T05:17:09.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702024-11-13T05:17:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19712024-11-13T05:17:09.901ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.860983ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19722024-11-13T05:17:09.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19732024-11-13T05:17:09.902ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19742024-11-13T05:17:09.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19752024-11-13T05:17:09.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19762024-11-13T05:17:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19772024-11-13T05:17:09.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19782024-11-13T05:17:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19792024-11-13T05:17:09.906ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19802024-11-13T05:17:09.907ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-13 05:07:09.895941012 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19812024-11-13T05:17:09.907ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.547751ms iteration = 10 status = {"expiration":"2024-11-13T05:07:09.895941012Z","pruned":[]}
19822024-11-13T05:17:09.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19832024-11-13T05:17:09.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19842024-11-13T05:17:09.909ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19852024-11-13T05:17:09.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19862024-11-13T05:17:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19872024-11-13T05:17:09.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19882024-11-13T05:17:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19892024-11-13T05:17:09.913ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19902024-11-13T05:17:09.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
19912024-11-13T05:17:09.917ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19922024-11-13T05:17:09.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19932024-11-13T05:17:09.918ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5411, tv_nsec: 428921518 } })
19942024-11-13T05:17:09.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19952024-11-13T05:17:09.919ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
19962024-11-13T05:17:09.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19972024-11-13T05:17:09.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19982024-11-13T05:17:09.920ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992024-11-13T05:17:09.921ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.637873ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
20002024-11-13T05:17:09.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20012024-11-13T05:17:09.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20022024-11-13T05:17:09.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20032024-11-13T05:17:09.924ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20042024-11-13T05:17:09.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20052024-11-13T05:17:09.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20062024-11-13T05:17:09.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20072024-11-13T05:17:09.927ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20082024-11-13T05:17:09.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20092024-11-13T05:17:09.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20102024-11-13T05:17:09.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20112024-11-13T05:17:09.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20122024-11-13T05:17:09.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20132024-11-13T05:17:09.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20142024-11-13T05:17:09.930ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20152024-11-13T05:17:09.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20162024-11-13T05:17:09.934ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20172024-11-13T05:17:09.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20182024-11-13T05:17:09.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20192024-11-13T05:17:09.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20202024-11-13T05:17:09.946ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5411, tv_nsec: 456349188 } })
20212024-11-13T05:17:09.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.542852ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
20222024-11-13T05:17:09.946ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
20232024-11-13T05:17:09.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20242024-11-13T05:17:09.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20252024-11-13T05:17:09.947ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20262024-11-13T05:17:09.947ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20272024-11-13T05:17:09.947ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 51.956245ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20282024-11-13T05:17:09.949ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20292024-11-13T05:17:09.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20302024-11-13T05:17:09.949ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20312024-11-13T05:17:09.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20322024-11-13T05:17:09.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.810777ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
20332024-11-13T05:17:09.951ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20342024-11-13T05:17:09.951ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20352024-11-13T05:17:09.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20362024-11-13T05:17:09.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20372024-11-13T05:17:09.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20382024-11-13T05:17:09.952ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20392024-11-13T05:17:09.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20402024-11-13T05:17:09.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20412024-11-13T05:17:09.954ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20422024-11-13T05:17:09.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20432024-11-13T05:17:09.954ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20442024-11-13T05:17:09.954ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20452024-11-13T05:17:09.954ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20462024-11-13T05:17:09.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20472024-11-13T05:17:09.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20482024-11-13T05:17:09.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20492024-11-13T05:17:09.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20502024-11-13T05:17:09.955ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20512024-11-13T05:17:09.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20522024-11-13T05:17:09.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20532024-11-13T05:17:09.956ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20542024-11-13T05:17:09.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20552024-11-13T05:17:09.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20562024-11-13T05:17:09.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20572024-11-13T05:17:09.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20582024-11-13T05:17:09.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20592024-11-13T05:17:09.960ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20602024-11-13T05:17:09.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20612024-11-13T05:17:09.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
20622024-11-13T05:17:09.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20632024-11-13T05:17:09.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20642024-11-13T05:17:09.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20652024-11-13T05:17:09.965ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20662024-11-13T05:17:09.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672024-11-13T05:17:09.965ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20682024-11-13T05:17:09.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20692024-11-13T05:17:09.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20702024-11-13T05:17:09.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20712024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20722024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20732024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20742024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20752024-11-13T05:17:09.969ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20762024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 73.617033ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20772024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20782024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20792024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20802024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20812024-11-13T05:17:09.969ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20822024-11-13T05:17:09.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20832024-11-13T05:17:09.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20842024-11-13T05:17:09.973ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20852024-11-13T05:17:09.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20862024-11-13T05:17:09.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.420624ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20872024-11-13T05:17:09.977ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.496022ms iteration = 5 status = {"nsuccess":5}
20882024-11-13T05:17:09.981ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20892024-11-13T05:17:09.981ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20902024-11-13T05:17:09.981ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 85.334766ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20912024-11-13T05:17:09.982ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
20922024-11-13T05:17:09.982ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.368875ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
20932024-11-13T05:17:10.004ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20942024-11-13T05:17:10.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20952024-11-13T05:17:10.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20962024-11-13T05:17:10.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20972024-11-13T05:17:10.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20982024-11-13T05:17:10.006ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20992024-11-13T05:17:10.006ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21002024-11-13T05:17:10.006ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21012024-11-13T05:17:10.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21022024-11-13T05:17:10.007ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
21032024-11-13T05:17:10.007ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
21042024-11-13T05:17:10.007ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
21052024-11-13T05:17:10.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21062024-11-13T05:17:10.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21072024-11-13T05:17:10.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.958888ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21082024-11-13T05:17:10.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21092024-11-13T05:17:10.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21102024-11-13T05:17:10.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21112024-11-13T05:17:10.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21122024-11-13T05:17:10.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21132024-11-13T05:17:10.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21142024-11-13T05:17:10.010ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
21152024-11-13T05:17:10.010ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 114.625422ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
21162024-11-13T05:17:10.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21172024-11-13T05:17:10.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21182024-11-13T05:17:10.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21192024-11-13T05:17:10.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21202024-11-13T05:17:10.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21212024-11-13T05:17:10.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.067052ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21222024-11-13T05:17:10.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21232024-11-13T05:17:10.015ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21242024-11-13T05:17:10.015ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21252024-11-13T05:17:10.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21262024-11-13T05:17:10.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21272024-11-13T05:17:10.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21282024-11-13T05:17:10.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
21292024-11-13T05:17:10.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21302024-11-13T05:17:10.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21312024-11-13T05:17:10.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21322024-11-13T05:17:10.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21332024-11-13T05:17:10.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21342024-11-13T05:17:10.020ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.566779ms iteration = 19 status = 0
21352024-11-13T05:17:10.022ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
21362024-11-13T05:17:10.023ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21372024-11-13T05:17:10.023ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-13 05:08:54.008257 UTC dns_group = internal generation = 1
21382024-11-13T05:17:10.023ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 127.801157ms iteration = 11 status = {"generation":1}
21392024-11-13T05:17:10.024ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.290161ms iteration = 22 status = {"physical_disks_added":0}
21402024-11-13T05:17:10.025ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21412024-11-13T05:17:10.025ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 0 version = 2
21422024-11-13T05:17:10.025ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21432024-11-13T05:17:10.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21442024-11-13T05:17:10.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21452024-11-13T05:17:10.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21462024-11-13T05:17:10.029ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21472024-11-13T05:17:10.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21482024-11-13T05:17:10.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 139.796132ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21492024-11-13T05:17:10.036ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21502024-11-13T05:17:10.036ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21512024-11-13T05:17:10.037ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.244235ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21522024-11-13T05:17:10.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21532024-11-13T05:17:10.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21542024-11-13T05:17:10.053ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-13T05:08:08.157062Z, time_modified: 2024-11-13T05:08:08.157062Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }) }
21552024-11-13T05:17:10.053ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.422777ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]}},"default_endpoint":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21562024-11-13T05:17:10.053ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21572024-11-13T05:17:10.053ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
21582024-11-13T05:17:10.053ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21592024-11-13T05:17:10.053ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ffb6c34-78e4-4b44-a1f0-e081313a2958", "content-length": "26", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
21602024-11-13T05:17:10.053ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21612024-11-13T05:17:10.055ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21622024-11-13T05:17:10.060ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
21632024-11-13T05:17:10.060ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21642024-11-13T05:17:10.060ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bbfbe93-39cf-43b8-bab3-653993080786", "content-length": "26", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
21652024-11-13T05:17:10.060ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21662024-11-13T05:17:10.062ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21672024-11-13T05:17:10.132ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
21682024-11-13T05:17:10.241ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 345.558299ms iteration = 19 status = {}
21692024-11-13T05:17:10.337ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
21702024-11-13T05:17:10.337ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21712024-11-13T05:17:10.338ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3db4856-720e-4bef-9036-b3d72d872e3e", "content-length": "26", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
21722024-11-13T05:17:10.338ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21732024-11-13T05:17:10.339ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
21742024-11-13T05:17:10.341ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21752024-11-13T05:17:10.341ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21762024-11-13T05:17:10.341ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbe1e7e4-0b7b-4389-ad41-06948be96e75", "content-length": "372", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
21772024-11-13T05:17:10.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21782024-11-13T05:17:10.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21792024-11-13T05:17:10.343ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 1 version = 2
21802024-11-13T05:17:10.343ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21812024-11-13T05:17:10.343ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-13 05:08:54.834359 UTC dns_group = external generation = 2
21822024-11-13T05:17:10.343ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 447.588302ms iteration = 11 status = {"generation":2}
21832024-11-13T05:17:10.360ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21842024-11-13T05:17:10.360ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c32ed79e-faab-427d-993a-a7b55a103d55", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21852024-11-13T05:17:10.360ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21862024-11-13T05:17:10.362ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0ca9b50c-98d7-402b-9651-58164785a74e", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21872024-11-13T05:17:10.362ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21882024-11-13T05:17:10.364ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21892024-11-13T05:17:10.364ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 468.113901ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21902024-11-13T05:17:10.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21912024-11-13T05:17:10.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21922024-11-13T05:17:10.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21932024-11-13T05:17:10.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21942024-11-13T05:17:10.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21952024-11-13T05:17:10.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21962024-11-13T05:17:10.387ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21972024-11-13T05:17:10.387ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21982024-11-13T05:17:10.387ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3ccc2aa0-b998-499e-ba63-6fb1785394e1", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
21992024-11-13T05:17:10.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22002024-11-13T05:17:10.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22012024-11-13T05:17:10.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22022024-11-13T05:17:10.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22032024-11-13T05:17:10.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22042024-11-13T05:17:10.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22052024-11-13T05:17:10.390ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22062024-11-13T05:17:10.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22072024-11-13T05:17:10.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22082024-11-13T05:17:10.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22092024-11-13T05:17:10.395ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22102024-11-13T05:17:10.395ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22112024-11-13T05:17:10.395ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d08ee24b-f4c6-49f8-a728-bde2fa99b700", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
22122024-11-13T05:17:10.397ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 501.819546ms iteration = 20 status = {}
22132024-11-13T05:17:10.409ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22142024-11-13T05:17:10.409ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "364158a6-beca-4bb7-b2ce-042eaf470bd0", "content-length": "1", "date": "Wed, 13 Nov 2024 05:17:09 GMT"} })
22152024-11-13T05:17:10.411ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22162024-11-13T05:17:10.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22172024-11-13T05:17:10.412ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 517.17471ms iteration = 19 status = null
22182024-11-13T05:17:10.421ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22192024-11-13T05:17:10.491ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22202024-11-13T05:17:10.492ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "28a495b6-b9f3-4047-aa35-11eb7d624bd1", "content-length": "691", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
22212024-11-13T05:17:10.492ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22222024-11-13T05:17:10.492ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22232024-11-13T05:17:10.492ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22242024-11-13T05:17:10.494ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 598.007137ms iteration = 19 status = {}
22252024-11-13T05:17:10.507ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
22262024-11-13T05:17:10.507ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2ddffece-b7c2-4abe-9a08-f1860a6a71fd", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
22272024-11-13T05:17:10.507ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
22282024-11-13T05:17:10.509ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ea20935e-52b3-41d9-a362-2b05757bd69e", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
22292024-11-13T05:17:10.509ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
22302024-11-13T05:17:10.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7fc05237-9164-4754-b01d-118fefbb0e73", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
22312024-11-13T05:17:10.511ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
22322024-11-13T05:17:10.513ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
22332024-11-13T05:17:10.513ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 617.677509ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22342024-11-13T05:17:10.545ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22352024-11-13T05:17:10.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22362024-11-13T05:17:10.547ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
22372024-11-13T05:17:10.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22382024-11-13T05:17:10.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22392024-11-13T05:17:10.557ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22402024-11-13T05:17:10.558ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c4f0e8a-9b49-47df-9b6a-3dd530172cce", "content-length": "134", "date": "Wed, 13 Nov 2024 05:17:09 GMT"} })
22412024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22422024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
22432024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22442024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22452024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22462024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22472024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22482024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22492024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22502024-11-13T05:17:10.558ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22512024-11-13T05:17:10.559ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
22522024-11-13T05:17:10.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22532024-11-13T05:17:10.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22542024-11-13T05:17:10.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b651142b-536d-43f6-8c15-b0aa5ddcedb4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22552024-11-13T05:17:10.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b651142b-536d-43f6-8c15-b0aa5ddcedb4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22562024-11-13T05:17:10.561ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22572024-11-13T05:17:10.561ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c176914-27b8-47ef-88a2-14819d935ad1", "content-length": "2", "date": "Wed, 13 Nov 2024 05:17:09 GMT"} })
22582024-11-13T05:17:10.561ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22592024-11-13T05:17:10.562ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "781d0bb7-f96f-4c40-8653-1be706daaa03", "content-length": "52", "date": "Wed, 13 Nov 2024 05:17:09 GMT"} })
22602024-11-13T05:17:10.562ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
22612024-11-13T05:17:10.562ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22622024-11-13T05:17:10.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b651142b-536d-43f6-8c15-b0aa5ddcedb4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22632024-11-13T05:17:10.578ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1341 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 832ba6c5-7d4b-4ff8-9f6d-26c6096c6446 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
22642024-11-13T05:17:10.666ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "64e18949-1b83-435c-b917-66d27fe1688f", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
22652024-11-13T05:17:10.666ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
22662024-11-13T05:17:10.666ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22672024-11-13T05:17:10.672ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e6759d3-b3c1-4be6-8138-bec14422de5b", "content-length": "682", "date": "Wed, 13 Nov 2024 05:17:10 GMT"} })
22682024-11-13T05:17:10.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22692024-11-13T05:17:10.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22702024-11-13T05:17:10.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22712024-11-13T05:17:10.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22722024-11-13T05:17:10.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22732024-11-13T05:17:10.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22742024-11-13T05:17:10.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22752024-11-13T05:17:10.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22762024-11-13T05:17:10.689ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 794.02128ms iteration = 19 status = {}
22772024-11-13T05:17:11.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ee62b2b3-42bf-40de-a798-d907cd3f5798 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22782024-11-13T05:17:11.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ee62b2b3-42bf-40de-a798-d907cd3f5798 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22792024-11-13T05:17:11.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ee62b2b3-42bf-40de-a798-d907cd3f5798 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22802024-11-13T05:17:12.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9972c991-ceb9-4e26-ae2b-4ea9f585254a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22812024-11-13T05:17:12.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9972c991-ceb9-4e26-ae2b-4ea9f585254a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22822024-11-13T05:17:12.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9972c991-ceb9-4e26-ae2b-4ea9f585254a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22832024-11-13T05:17:13.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 58af2e53-935b-44f9-aef6-6f222b27ff06 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22842024-11-13T05:17:13.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 58af2e53-935b-44f9-aef6-6f222b27ff06 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22852024-11-13T05:17:13.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 58af2e53-935b-44f9-aef6-6f222b27ff06 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22862024-11-13T05:17:14.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c52a5338-ff2b-4696-8258-8a3b68d00133 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22872024-11-13T05:17:14.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c52a5338-ff2b-4696-8258-8a3b68d00133 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22882024-11-13T05:17:14.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c52a5338-ff2b-4696-8258-8a3b68d00133 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22892024-11-13T05:17:15.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5ae0c5ab-0c2e-4197-be0e-8c8e9e4a2099 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22902024-11-13T05:17:15.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5ae0c5ab-0c2e-4197-be0e-8c8e9e4a2099 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22912024-11-13T05:17:15.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5ae0c5ab-0c2e-4197-be0e-8c8e9e4a2099 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22922024-11-13T05:17:16.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b16ea65b-0e92-4082-8636-b4cc2409cf0f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22932024-11-13T05:17:16.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b16ea65b-0e92-4082-8636-b4cc2409cf0f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22942024-11-13T05:17:16.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b16ea65b-0e92-4082-8636-b4cc2409cf0f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22952024-11-13T05:17:17.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fc45a32-c25f-4ace-85f4-13db2a568de8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22962024-11-13T05:17:17.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fc45a32-c25f-4ace-85f4-13db2a568de8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22972024-11-13T05:17:17.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fc45a32-c25f-4ace-85f4-13db2a568de8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22982024-11-13T05:17:18.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d89a1b1b-83fe-4ac6-b74f-897a6e934551 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
22992024-11-13T05:17:18.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d89a1b1b-83fe-4ac6-b74f-897a6e934551 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23002024-11-13T05:17:18.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d89a1b1b-83fe-4ac6-b74f-897a6e934551 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23012024-11-13T05:17:19.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f6af53e6-4a61-4ed8-9c2e-d7d290b2d04b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23022024-11-13T05:17:19.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f6af53e6-4a61-4ed8-9c2e-d7d290b2d04b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23032024-11-13T05:17:19.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f6af53e6-4a61-4ed8-9c2e-d7d290b2d04b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23042024-11-13T05:17:19.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
23052024-11-13T05:17:19.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
23062024-11-13T05:17:19.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23072024-11-13T05:17:19.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23082024-11-13T05:17:19.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23092024-11-13T05:17:19.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23102024-11-13T05:17:19.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23112024-11-13T05:17:19.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23122024-11-13T05:17:19.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23132024-11-13T05:17:19.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.476489ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23142024-11-13T05:17:19.900ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23152024-11-13T05:17:19.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23162024-11-13T05:17:19.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23172024-11-13T05:17:19.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23182024-11-13T05:17:19.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23192024-11-13T05:17:19.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23202024-11-13T05:17:19.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
23212024-11-13T05:17:19.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23222024-11-13T05:17:19.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23232024-11-13T05:17:19.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
23242024-11-13T05:17:19.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.561959ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
23252024-11-13T05:17:20.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 87260d0f-59dc-4e38-ba8b-d11da955cbc7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23262024-11-13T05:17:20.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 87260d0f-59dc-4e38-ba8b-d11da955cbc7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23272024-11-13T05:17:20.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 87260d0f-59dc-4e38-ba8b-d11da955cbc7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23282024-11-13T05:17:21.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cf84d19e-d237-4c56-b039-46bc4a6aaae8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23292024-11-13T05:17:21.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cf84d19e-d237-4c56-b039-46bc4a6aaae8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23302024-11-13T05:17:21.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cf84d19e-d237-4c56-b039-46bc4a6aaae8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23312024-11-13T05:17:22.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ed86b209-5f87-4d4d-b840-e6b00c4bc24e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23322024-11-13T05:17:22.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ed86b209-5f87-4d4d-b840-e6b00c4bc24e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23332024-11-13T05:17:22.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ed86b209-5f87-4d4d-b840-e6b00c4bc24e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23342024-11-13T05:17:23.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 848cd6bf-3fdd-4339-bf39-70bb6465fc0c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23352024-11-13T05:17:23.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 848cd6bf-3fdd-4339-bf39-70bb6465fc0c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23362024-11-13T05:17:23.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 848cd6bf-3fdd-4339-bf39-70bb6465fc0c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23372024-11-13T05:17:24.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 175daee3-2a73-43e1-b6c6-46d138f8cb44 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23382024-11-13T05:17:24.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 175daee3-2a73-43e1-b6c6-46d138f8cb44 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23392024-11-13T05:17:24.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 175daee3-2a73-43e1-b6c6-46d138f8cb44 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23402024-11-13T05:17:25.580ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1506 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 2344fd9b-b43a-4b5c-8ce7-b1c1772d00ec response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
23412024-11-13T05:17:26.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6d04ee71-fd63-4619-9ee5-b3ed59c3690d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23422024-11-13T05:17:26.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6d04ee71-fd63-4619-9ee5-b3ed59c3690d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23432024-11-13T05:17:26.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6d04ee71-fd63-4619-9ee5-b3ed59c3690d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23442024-11-13T05:17:27.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 225ce724-3cec-4ac5-8429-6f75059ac0e3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23452024-11-13T05:17:27.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 225ce724-3cec-4ac5-8429-6f75059ac0e3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23462024-11-13T05:17:27.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 225ce724-3cec-4ac5-8429-6f75059ac0e3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23472024-11-13T05:17:28.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d3906b4c-f60a-478a-bf0e-75c769a7f1ad roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23482024-11-13T05:17:28.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d3906b4c-f60a-478a-bf0e-75c769a7f1ad resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23492024-11-13T05:17:28.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d3906b4c-f60a-478a-bf0e-75c769a7f1ad response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23502024-11-13T05:17:29.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 34295a7f-9c27-4723-a4e1-c4a97b39bf80 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23512024-11-13T05:17:29.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 34295a7f-9c27-4723-a4e1-c4a97b39bf80 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23522024-11-13T05:17:29.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 34295a7f-9c27-4723-a4e1-c4a97b39bf80 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23532024-11-13T05:17:29.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
23542024-11-13T05:17:29.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
23552024-11-13T05:17:29.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23562024-11-13T05:17:29.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23572024-11-13T05:17:29.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23582024-11-13T05:17:29.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23592024-11-13T05:17:29.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23602024-11-13T05:17:29.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23612024-11-13T05:17:29.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23622024-11-13T05:17:29.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.914343ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23632024-11-13T05:17:29.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23642024-11-13T05:17:29.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23652024-11-13T05:17:29.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23662024-11-13T05:17:29.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23672024-11-13T05:17:29.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23682024-11-13T05:17:29.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23692024-11-13T05:17:29.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
23702024-11-13T05:17:29.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23712024-11-13T05:17:29.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23722024-11-13T05:17:29.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
23732024-11-13T05:17:29.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.146975ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
23742024-11-13T05:17:30.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8763a06f-d7a5-49d7-914e-b33e61962b54 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23752024-11-13T05:17:30.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8763a06f-d7a5-49d7-914e-b33e61962b54 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23762024-11-13T05:17:30.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8763a06f-d7a5-49d7-914e-b33e61962b54 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23772024-11-13T05:17:31.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 90e32e3a-8685-468d-8caa-4c98070009f7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23782024-11-13T05:17:31.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 90e32e3a-8685-468d-8caa-4c98070009f7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23792024-11-13T05:17:31.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 90e32e3a-8685-468d-8caa-4c98070009f7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23802024-11-13T05:17:32.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c161d2e2-9c51-4a4f-9bb6-041165afa89f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23812024-11-13T05:17:32.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c161d2e2-9c51-4a4f-9bb6-041165afa89f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23822024-11-13T05:17:32.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c161d2e2-9c51-4a4f-9bb6-041165afa89f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23832024-11-13T05:17:33.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b784c364-cc63-4aed-9bbf-1f036aae5594 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23842024-11-13T05:17:33.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b784c364-cc63-4aed-9bbf-1f036aae5594 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23852024-11-13T05:17:33.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b784c364-cc63-4aed-9bbf-1f036aae5594 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23862024-11-13T05:17:34.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fb821a9-8c4d-4a07-859c-b8f8d662fc4c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23872024-11-13T05:17:34.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fb821a9-8c4d-4a07-859c-b8f8d662fc4c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23882024-11-13T05:17:34.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fb821a9-8c4d-4a07-859c-b8f8d662fc4c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23892024-11-13T05:17:35.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = df66a228-10d9-4c25-ac0c-9f5e1d501cfb roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23902024-11-13T05:17:35.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = df66a228-10d9-4c25-ac0c-9f5e1d501cfb resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23912024-11-13T05:17:35.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = df66a228-10d9-4c25-ac0c-9f5e1d501cfb response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23922024-11-13T05:17:36.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 32ea3a00-a302-4cf4-8c61-01a3cb88bfe4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23932024-11-13T05:17:36.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 32ea3a00-a302-4cf4-8c61-01a3cb88bfe4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23942024-11-13T05:17:36.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 32ea3a00-a302-4cf4-8c61-01a3cb88bfe4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23952024-11-13T05:17:37.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a81618b8-5ce7-4a4a-85c9-a16da01c928d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23962024-11-13T05:17:37.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a81618b8-5ce7-4a4a-85c9-a16da01c928d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23972024-11-13T05:17:37.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a81618b8-5ce7-4a4a-85c9-a16da01c928d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23982024-11-13T05:17:38.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 64ea6047-7177-472b-9195-cb92082e1183 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
23992024-11-13T05:17:38.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 64ea6047-7177-472b-9195-cb92082e1183 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
24002024-11-13T05:17:38.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 64ea6047-7177-472b-9195-cb92082e1183 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
24012024-11-13T05:17:39.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec93d2d1-45ab-4b70-8ee1-d6911ffef5c1 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
24022024-11-13T05:17:39.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec93d2d1-45ab-4b70-8ee1-d6911ffef5c1 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
24032024-11-13T05:17:39.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec93d2d1-45ab-4b70-8ee1-d6911ffef5c1 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
24042024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
24052024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24062024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
24072024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
24082024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24092024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24102024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24112024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
24122024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
24132024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24142024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
24152024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24162024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24172024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
24182024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
24192024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24202024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
24212024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24222024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
24232024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
24242024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24252024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
24262024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24272024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24282024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
24292024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
24302024-11-13T05:17:39.895ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24312024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24322024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24332024-11-13T05:17:39.895ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
24342024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24352024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
24362024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24372024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
24382024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24392024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24402024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24412024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24422024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24432024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24442024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24452024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24462024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24472024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24482024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24492024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24502024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24512024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24522024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24532024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24542024-11-13T05:17:39.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24552024-11-13T05:17:39.898ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24562024-11-13T05:17:39.898ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24572024-11-13T05:17:39.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24582024-11-13T05:17:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24592024-11-13T05:17:39.898ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.941736ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24602024-11-13T05:17:39.899ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5441, tv_nsec: 409695350 } })
24612024-11-13T05:17:39.900ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
24622024-11-13T05:17:39.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24632024-11-13T05:17:39.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.57381ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
24642024-11-13T05:17:39.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24652024-11-13T05:17:39.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24662024-11-13T05:17:39.902ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24672024-11-13T05:17:39.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24682024-11-13T05:17:39.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24692024-11-13T05:17:39.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24702024-11-13T05:17:39.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24712024-11-13T05:17:39.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24722024-11-13T05:17:39.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24732024-11-13T05:17:39.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24742024-11-13T05:17:39.907ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24752024-11-13T05:17:39.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5441, tv_nsec: 416894793 } })
24762024-11-13T05:17:39.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
24772024-11-13T05:17:39.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24782024-11-13T05:17:39.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24792024-11-13T05:17:39.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24802024-11-13T05:17:39.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24812024-11-13T05:17:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24822024-11-13T05:17:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24832024-11-13T05:17:39.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24842024-11-13T05:17:39.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24852024-11-13T05:17:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24862024-11-13T05:17:39.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.472685ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24872024-11-13T05:17:39.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24882024-11-13T05:17:39.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24892024-11-13T05:17:39.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24902024-11-13T05:17:39.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24912024-11-13T05:17:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24922024-11-13T05:17:39.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24932024-11-13T05:17:39.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24942024-11-13T05:17:39.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24952024-11-13T05:17:39.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24962024-11-13T05:17:39.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24972024-11-13T05:17:39.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24982024-11-13T05:17:39.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24992024-11-13T05:17:39.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25002024-11-13T05:17:39.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25012024-11-13T05:17:39.921ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25022024-11-13T05:17:39.922ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25032024-11-13T05:17:39.922ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.359201ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25042024-11-13T05:17:39.922ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5441, tv_nsec: 432738471 } })
25052024-11-13T05:17:39.923ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
25062024-11-13T05:17:39.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25072024-11-13T05:17:39.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25082024-11-13T05:17:39.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25092024-11-13T05:17:39.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25102024-11-13T05:17:39.923ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25112024-11-13T05:17:39.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25122024-11-13T05:17:39.932ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25132024-11-13T05:17:39.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25142024-11-13T05:17:39.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.944769ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
25152024-11-13T05:17:39.937ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25162024-11-13T05:17:39.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25172024-11-13T05:17:39.941ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25182024-11-13T05:17:39.941ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25192024-11-13T05:17:39.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25202024-11-13T05:17:39.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25212024-11-13T05:17:39.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25222024-11-13T05:17:39.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25232024-11-13T05:17:39.946ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25242024-11-13T05:17:39.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25252024-11-13T05:17:39.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25262024-11-13T05:17:39.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
25272024-11-13T05:17:39.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25282024-11-13T05:17:39.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25292024-11-13T05:17:39.978ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25302024-11-13T05:17:39.978ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25312024-11-13T05:17:39.978ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2df6995e-a8cf-450f-aa85-19f14c985816", "content-length": "26", "date": "Wed, 13 Nov 2024 05:17:39 GMT"} })
25322024-11-13T05:17:39.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25332024-11-13T05:17:39.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25342024-11-13T05:17:40.009ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
25352024-11-13T05:17:40.009ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25362024-11-13T05:17:40.009ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da4e577c-aa12-450c-8af4-f83cb2884d43", "content-length": "26", "date": "Wed, 13 Nov 2024 05:17:39 GMT"} })
25372024-11-13T05:17:40.009ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25382024-11-13T05:17:40.012ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25392024-11-13T05:17:40.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25402024-11-13T05:17:40.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25412024-11-13T05:17:40.024ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.191221ms iteration = 23 status = {"physical_disks_added":0}
25422024-11-13T05:17:40.034ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
25432024-11-13T05:17:40.034ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25442024-11-13T05:17:40.034ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1759348-1926-441b-a213-5e933f1bb325", "content-length": "26", "date": "Wed, 13 Nov 2024 05:17:39 GMT"} })
25452024-11-13T05:17:40.034ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25462024-11-13T05:17:40.036ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
25472024-11-13T05:17:40.050ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25482024-11-13T05:17:40.050ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25492024-11-13T05:17:40.050ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e139e5b-815c-458e-b29a-144622e6d610", "content-length": "372", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
25502024-11-13T05:17:40.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25512024-11-13T05:17:40.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25522024-11-13T05:17:40.053ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 157.169714ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25532024-11-13T05:17:40.053ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25542024-11-13T05:17:40.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25552024-11-13T05:17:40.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25562024-11-13T05:17:40.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25572024-11-13T05:17:40.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25582024-11-13T05:17:40.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.779397ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
25592024-11-13T05:17:40.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25602024-11-13T05:17:40.056ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25612024-11-13T05:17:40.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25622024-11-13T05:17:40.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25632024-11-13T05:17:40.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25642024-11-13T05:17:40.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
25652024-11-13T05:17:40.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25662024-11-13T05:17:40.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25672024-11-13T05:17:40.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25682024-11-13T05:17:40.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25692024-11-13T05:17:40.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25702024-11-13T05:17:40.061ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 165.84156ms iteration = 20 status = 0
25712024-11-13T05:17:40.071ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
25722024-11-13T05:17:40.071ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 175.651215ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
25732024-11-13T05:17:40.078ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25742024-11-13T05:17:40.078ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25752024-11-13T05:17:40.078ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "edca7060-49de-4675-8d89-c52dd1f87fff", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
25762024-11-13T05:17:40.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25772024-11-13T05:17:40.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25782024-11-13T05:17:40.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25792024-11-13T05:17:40.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25802024-11-13T05:17:40.092ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 196.80216ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25812024-11-13T05:17:40.094ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25822024-11-13T05:17:40.094ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25832024-11-13T05:17:40.094ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.766248ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25842024-11-13T05:17:40.174ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25852024-11-13T05:17:40.175ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5131a440-d89f-44e1-b2b4-f4c91f25e193", "content-length": "1", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
25862024-11-13T05:17:40.176ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25872024-11-13T05:17:40.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25882024-11-13T05:17:40.181ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25892024-11-13T05:17:40.182ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bcb0229-7867-4488-b200-fc6fcfa787e3", "content-length": "691", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
25902024-11-13T05:17:40.182ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25912024-11-13T05:17:40.182ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25922024-11-13T05:17:40.182ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25932024-11-13T05:17:40.183ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 288.073107ms iteration = 20 status = null
25942024-11-13T05:17:40.184ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 288.434151ms iteration = 20 status = {}
25952024-11-13T05:17:40.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25962024-11-13T05:17:40.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25972024-11-13T05:17:40.187ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25982024-11-13T05:17:40.187ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25992024-11-13T05:17:40.187ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e4193c00-405d-4e1c-9743-50f1cc79dff5", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
26002024-11-13T05:17:40.190ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 294.429163ms iteration = 21 status = {}
26012024-11-13T05:17:40.204ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.544336ms iteration = 20 status = {}
26022024-11-13T05:17:40.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26032024-11-13T05:17:40.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26042024-11-13T05:17:40.250ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
26052024-11-13T05:17:40.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26062024-11-13T05:17:40.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26072024-11-13T05:17:40.260ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26082024-11-13T05:17:40.261ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "170b4bf8-a23d-4feb-a6e8-161f69efa59e", "content-length": "134", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
26092024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26102024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
26112024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26122024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26132024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26142024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26152024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26162024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26172024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26182024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26192024-11-13T05:17:40.261ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
26202024-11-13T05:17:40.261ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26212024-11-13T05:17:40.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26222024-11-13T05:17:40.263ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26232024-11-13T05:17:40.264ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "480209b7-3c67-4256-9233-e4ab9db3bef3", "content-length": "2", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
26242024-11-13T05:17:40.264ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26252024-11-13T05:17:40.264ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "043c98f3-d34c-4270-8f73-fa7adecad5d7", "content-length": "52", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
26262024-11-13T05:17:40.264ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
26272024-11-13T05:17:40.264ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26282024-11-13T05:17:40.366ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "12d12e2c-3f82-41db-8c39-abcc4ab15c32", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
26292024-11-13T05:17:40.366ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
26302024-11-13T05:17:40.366ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26312024-11-13T05:17:40.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e56e1e6-947c-4be5-b9bf-b4ee1134b74c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26322024-11-13T05:17:40.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e56e1e6-947c-4be5-b9bf-b4ee1134b74c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26332024-11-13T05:17:40.367ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e413ed1-0615-443b-9683-8e7ff37ba1df", "content-length": "682", "date": "Wed, 13 Nov 2024 05:17:40 GMT"} })
26342024-11-13T05:17:40.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26352024-11-13T05:17:40.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26362024-11-13T05:17:40.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e56e1e6-947c-4be5-b9bf-b4ee1134b74c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26372024-11-13T05:17:40.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26382024-11-13T05:17:40.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26392024-11-13T05:17:40.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26402024-11-13T05:17:40.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26412024-11-13T05:17:40.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26422024-11-13T05:17:40.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26432024-11-13T05:17:40.384ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 488.265097ms iteration = 20 status = {}
26442024-11-13T05:17:40.579ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1231 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 8e2dd600-bb4e-4da6-8331-ef5036477151 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
26452024-11-13T05:17:41.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 464e1736-085a-48d2-aa3f-96f1984306d7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26462024-11-13T05:17:41.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 464e1736-085a-48d2-aa3f-96f1984306d7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26472024-11-13T05:17:41.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 464e1736-085a-48d2-aa3f-96f1984306d7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26482024-11-13T05:17:42.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 703a841e-0cbd-4aaa-9025-a2b4a56752dc roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26492024-11-13T05:17:42.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 703a841e-0cbd-4aaa-9025-a2b4a56752dc resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26502024-11-13T05:17:42.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 703a841e-0cbd-4aaa-9025-a2b4a56752dc response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26512024-11-13T05:17:43.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 941c048f-4d0e-4496-a603-01cf4710c48b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26522024-11-13T05:17:43.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 941c048f-4d0e-4496-a603-01cf4710c48b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26532024-11-13T05:17:43.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 941c048f-4d0e-4496-a603-01cf4710c48b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26542024-11-13T05:17:44.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dfa6c3a1-f805-4da8-a3ae-0c70b6e3e08d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26552024-11-13T05:17:44.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dfa6c3a1-f805-4da8-a3ae-0c70b6e3e08d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26562024-11-13T05:17:44.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dfa6c3a1-f805-4da8-a3ae-0c70b6e3e08d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26572024-11-13T05:17:45.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4258a5ab-feb3-471e-8ed2-e156fddf379a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26582024-11-13T05:17:45.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4258a5ab-feb3-471e-8ed2-e156fddf379a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26592024-11-13T05:17:45.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4258a5ab-feb3-471e-8ed2-e156fddf379a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26602024-11-13T05:17:45.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c2ac854a-e328-435c-8947-6e81266f2e2a roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
26612024-11-13T05:17:45.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c2ac854a-e328-435c-8947-6e81266f2e2a resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
26622024-11-13T05:17:45.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c2ac854a-e328-435c-8947-6e81266f2e2a response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
26632024-11-13T05:17:45.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c346cbb0-2949-4225-b0e5-700e5bc4ac1a roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
26642024-11-13T05:17:45.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c346cbb0-2949-4225-b0e5-700e5bc4ac1a resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
26652024-11-13T05:17:45.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c346cbb0-2949-4225-b0e5-700e5bc4ac1a response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
26662024-11-13T05:17:46.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 798898af-9dc8-40e7-bd3d-b9a50ad57bca roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26672024-11-13T05:17:46.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 798898af-9dc8-40e7-bd3d-b9a50ad57bca resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26682024-11-13T05:17:46.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 798898af-9dc8-40e7-bd3d-b9a50ad57bca response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26692024-11-13T05:17:47.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 194d3cd8-0d05-4484-bddf-a832caa545f7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26702024-11-13T05:17:47.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 194d3cd8-0d05-4484-bddf-a832caa545f7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26712024-11-13T05:17:47.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 194d3cd8-0d05-4484-bddf-a832caa545f7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26722024-11-13T05:17:48.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e6e22a6e-9208-491a-bafa-afe020087247 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26732024-11-13T05:17:48.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e6e22a6e-9208-491a-bafa-afe020087247 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26742024-11-13T05:17:48.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e6e22a6e-9208-491a-bafa-afe020087247 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26752024-11-13T05:17:49.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f07ff549-8d8b-4c05-b682-acc0cd2b9eff roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26762024-11-13T05:17:49.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f07ff549-8d8b-4c05-b682-acc0cd2b9eff resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26772024-11-13T05:17:49.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f07ff549-8d8b-4c05-b682-acc0cd2b9eff response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
26782024-11-13T05:17:49.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
26792024-11-13T05:17:49.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
26802024-11-13T05:17:49.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26812024-11-13T05:17:49.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26822024-11-13T05:17:49.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26832024-11-13T05:17:49.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26842024-11-13T05:17:49.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26852024-11-13T05:17:49.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26862024-11-13T05:17:49.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26872024-11-13T05:17:49.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26882024-11-13T05:17:49.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26892024-11-13T05:17:49.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26902024-11-13T05:17:49.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26912024-11-13T05:17:49.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
26922024-11-13T05:17:49.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26932024-11-13T05:17:49.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26942024-11-13T05:17:49.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
26952024-11-13T05:17:49.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.101862ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
26962024-11-13T05:17:49.932ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26972024-11-13T05:17:49.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26982024-11-13T05:17:49.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.580906ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26992024-11-13T05:17:50.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fcc46ed9-69c3-4638-b8af-e964cfcd247a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27002024-11-13T05:17:50.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fcc46ed9-69c3-4638-b8af-e964cfcd247a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27012024-11-13T05:17:50.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fcc46ed9-69c3-4638-b8af-e964cfcd247a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27022024-11-13T05:17:51.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 432f5cd6-f185-47c5-b24d-8db54606bb7b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27032024-11-13T05:17:51.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 432f5cd6-f185-47c5-b24d-8db54606bb7b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27042024-11-13T05:17:51.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 432f5cd6-f185-47c5-b24d-8db54606bb7b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27052024-11-13T05:17:52.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b2097a1e-e5ae-4500-a612-56c0a9244fc3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27062024-11-13T05:17:52.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b2097a1e-e5ae-4500-a612-56c0a9244fc3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27072024-11-13T05:17:52.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b2097a1e-e5ae-4500-a612-56c0a9244fc3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27082024-11-13T05:17:53.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d82c44c7-8dd3-481f-bc59-b59e47fb3fc5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27092024-11-13T05:17:53.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d82c44c7-8dd3-481f-bc59-b59e47fb3fc5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27102024-11-13T05:17:53.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d82c44c7-8dd3-481f-bc59-b59e47fb3fc5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27112024-11-13T05:17:54.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 682b8140-93fa-4348-87fa-52c864f2a71a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27122024-11-13T05:17:54.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 682b8140-93fa-4348-87fa-52c864f2a71a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27132024-11-13T05:17:54.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 682b8140-93fa-4348-87fa-52c864f2a71a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27142024-11-13T05:17:55.579ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1473 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 4e552d12-ea15-41ed-9087-f636edde14e7 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
27152024-11-13T05:17:55.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c5360c55-3c78-44f6-9e82-cdc821af4f64 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27162024-11-13T05:17:55.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c5360c55-3c78-44f6-9e82-cdc821af4f64 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27172024-11-13T05:17:55.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c5360c55-3c78-44f6-9e82-cdc821af4f64 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27182024-11-13T05:17:56.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2d85a2e-aab6-40ef-a943-05fa023a0376 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27192024-11-13T05:17:56.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2d85a2e-aab6-40ef-a943-05fa023a0376 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27202024-11-13T05:17:56.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2d85a2e-aab6-40ef-a943-05fa023a0376 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27212024-11-13T05:17:57.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9259a01a-0c66-4b8d-b6e8-eda9ba2b71f5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27222024-11-13T05:17:57.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9259a01a-0c66-4b8d-b6e8-eda9ba2b71f5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27232024-11-13T05:17:57.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9259a01a-0c66-4b8d-b6e8-eda9ba2b71f5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27242024-11-13T05:17:58.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5ffde07-c6b8-4f8c-b455-4cfd47f1cdf8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27252024-11-13T05:17:58.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5ffde07-c6b8-4f8c-b455-4cfd47f1cdf8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27262024-11-13T05:17:58.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5ffde07-c6b8-4f8c-b455-4cfd47f1cdf8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27272024-11-13T05:17:59.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 949aef4d-ed52-406f-8b72-df2d2e7d63b7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27282024-11-13T05:17:59.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 949aef4d-ed52-406f-8b72-df2d2e7d63b7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27292024-11-13T05:17:59.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 949aef4d-ed52-406f-8b72-df2d2e7d63b7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27302024-11-13T05:17:59.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
27312024-11-13T05:17:59.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
27322024-11-13T05:17:59.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27332024-11-13T05:17:59.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27342024-11-13T05:17:59.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27352024-11-13T05:17:59.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27362024-11-13T05:17:59.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27372024-11-13T05:17:59.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27382024-11-13T05:17:59.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.783451ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27392024-11-13T05:17:59.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27402024-11-13T05:17:59.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27412024-11-13T05:17:59.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27422024-11-13T05:17:59.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27432024-11-13T05:17:59.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27442024-11-13T05:17:59.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27452024-11-13T05:17:59.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27462024-11-13T05:17:59.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
27472024-11-13T05:17:59.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27482024-11-13T05:17:59.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27492024-11-13T05:17:59.945ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
27502024-11-13T05:17:59.945ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.035818ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
27512024-11-13T05:18:00.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c7f9a3d1-4b4c-4d9d-ba28-55db2d483b76 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27522024-11-13T05:18:00.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c7f9a3d1-4b4c-4d9d-ba28-55db2d483b76 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27532024-11-13T05:18:00.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c7f9a3d1-4b4c-4d9d-ba28-55db2d483b76 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27542024-11-13T05:18:01.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0867f05e-67a0-4610-a20d-07152e594999 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27552024-11-13T05:18:01.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0867f05e-67a0-4610-a20d-07152e594999 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27562024-11-13T05:18:01.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0867f05e-67a0-4610-a20d-07152e594999 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27572024-11-13T05:18:02.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ac7dbb41-6c4f-4a34-ae6a-c2e1dd69206e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27582024-11-13T05:18:02.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ac7dbb41-6c4f-4a34-ae6a-c2e1dd69206e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27592024-11-13T05:18:02.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ac7dbb41-6c4f-4a34-ae6a-c2e1dd69206e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27602024-11-13T05:18:03.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = afc94f3d-5298-40b1-ae9c-1f4d81f620fa roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27612024-11-13T05:18:03.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = afc94f3d-5298-40b1-ae9c-1f4d81f620fa resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27622024-11-13T05:18:03.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = afc94f3d-5298-40b1-ae9c-1f4d81f620fa response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27632024-11-13T05:18:04.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6cef995d-0e22-4b6f-a31b-61befa96a91b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27642024-11-13T05:18:04.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6cef995d-0e22-4b6f-a31b-61befa96a91b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27652024-11-13T05:18:04.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6cef995d-0e22-4b6f-a31b-61befa96a91b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27662024-11-13T05:18:05.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1265d561-6614-4289-b468-3ee6397dad0b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27672024-11-13T05:18:05.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1265d561-6614-4289-b468-3ee6397dad0b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27682024-11-13T05:18:05.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1265d561-6614-4289-b468-3ee6397dad0b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27692024-11-13T05:18:07.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6d03b825-3783-4062-bb15-28d9b68faf47 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27702024-11-13T05:18:07.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6d03b825-3783-4062-bb15-28d9b68faf47 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27712024-11-13T05:18:07.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6d03b825-3783-4062-bb15-28d9b68faf47 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27722024-11-13T05:18:08.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 93ac90d9-e4f4-46ef-a3e2-dbff9601bc1c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27732024-11-13T05:18:08.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 93ac90d9-e4f4-46ef-a3e2-dbff9601bc1c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27742024-11-13T05:18:08.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 93ac90d9-e4f4-46ef-a3e2-dbff9601bc1c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27752024-11-13T05:18:09.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 353fbefb-e9c1-4c28-9d58-52b559fad253 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27762024-11-13T05:18:09.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 353fbefb-e9c1-4c28-9d58-52b559fad253 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27772024-11-13T05:18:09.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 353fbefb-e9c1-4c28-9d58-52b559fad253 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
27782024-11-13T05:18:09.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
27792024-11-13T05:18:09.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
27802024-11-13T05:18:09.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27812024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27822024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
27832024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27842024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
27852024-11-13T05:18:09.896ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71
27862024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
27872024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.881\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71"}
27882024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27892024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
27902024-11-13T05:18:09.896ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
27912024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27922024-11-13T05:18:09.896ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
27932024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
27942024-11-13T05:18:09.896ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-13 05:08:09.896491481 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
27952024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
27962024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
27972024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
27982024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
27992024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28002024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28012024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
28022024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
28032024-11-13T05:18:09.896ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28042024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28052024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
28062024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28072024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28082024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
28092024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28102024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28112024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
28122024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
28132024-11-13T05:18:09.896ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28142024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28152024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
28162024-11-13T05:18:09.896ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
28172024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28182024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28192024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
28202024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
28212024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
28222024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28232024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
28242024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28252024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28262024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
28272024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
28282024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
28292024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
28302024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28312024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
28322024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28332024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
28342024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
28352024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28362024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
28372024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
28382024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
28392024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
28402024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28412024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
28422024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
28432024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
28442024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28452024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
28462024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28472024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28482024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
28492024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
28502024-11-13T05:18:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28512024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28522024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28532024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28542024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28552024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28562024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28572024-11-13T05:18:09.897ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
28582024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28592024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28602024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28612024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28622024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28632024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28642024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28652024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
28662024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
28672024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28682024-11-13T05:18:09.897ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("038e4c2b-2408-42f1-b025-c88f1167faaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5471, tv_nsec: 407000336 } })
28692024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28702024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28712024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
28722024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28732024-11-13T05:18:09.897ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("105858cb-d3d5-4677-95c0-079ffa1259be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b62b18b5-c7f6-48f0-ab56-4213f6de7d44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5471, tv_nsec: 407034546 } })
28742024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28752024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28762024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28772024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28782024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28792024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
28802024-11-13T05:18:09.897ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.07445ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
28812024-11-13T05:18:09.898ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
28822024-11-13T05:18:09.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.09589ms iteration = 12 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
28832024-11-13T05:18:09.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28842024-11-13T05:18:09.900ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-13 05:08:09.896491481 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
28852024-11-13T05:18:09.900ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.875614ms iteration = 11 status = {"expiration":"2024-11-13T05:08:09.896491481Z","pruned":[]}
28862024-11-13T05:18:09.901ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28872024-11-13T05:18:09.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28882024-11-13T05:18:09.901ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.026834ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28892024-11-13T05:18:09.902ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28902024-11-13T05:18:09.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
28912024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28922024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28932024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28942024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28952024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28962024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
28972024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28982024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28992024-11-13T05:18:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29002024-11-13T05:18:09.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29012024-11-13T05:18:09.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29022024-11-13T05:18:09.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5471, tv_nsec: 416548810 } })
29032024-11-13T05:18:09.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
29042024-11-13T05:18:09.909ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.843362ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
29052024-11-13T05:18:09.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29062024-11-13T05:18:09.910ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5471, tv_nsec: 420206281 } })
29072024-11-13T05:18:09.911ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
29082024-11-13T05:18:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29092024-11-13T05:18:09.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29102024-11-13T05:18:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29112024-11-13T05:18:09.922ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29122024-11-13T05:18:09.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29132024-11-13T05:18:09.939ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.630923ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
29142024-11-13T05:18:09.941ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29152024-11-13T05:18:09.941ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.155185ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
29162024-11-13T05:18:09.941ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5471, tv_nsec: 451451835 } })
29172024-11-13T05:18:09.942ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29182024-11-13T05:18:09.942ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
29192024-11-13T05:18:09.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29202024-11-13T05:18:09.944ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29212024-11-13T05:18:09.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29222024-11-13T05:18:09.948ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
29232024-11-13T05:18:09.948ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
29242024-11-13T05:18:09.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
29252024-11-13T05:18:09.948ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29262024-11-13T05:18:09.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29272024-11-13T05:18:09.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29282024-11-13T05:18:09.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29292024-11-13T05:18:09.955ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
29302024-11-13T05:18:09.955ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
29312024-11-13T05:18:09.955ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.951835ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
29322024-11-13T05:18:09.959ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29332024-11-13T05:18:09.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29342024-11-13T05:18:09.959ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29352024-11-13T05:18:09.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362024-11-13T05:18:09.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29372024-11-13T05:18:09.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29382024-11-13T05:18:09.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29392024-11-13T05:18:09.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29402024-11-13T05:18:09.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29412024-11-13T05:18:09.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29422024-11-13T05:18:09.964ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(c66371ec-79e7-4213-90cb-1dcd790859d6, 0), (09537548-7fff-47b4-a02b-15ccc730bcdf, 0), (1a84a72a-d258-498b-bf06-ec08433244ca, 0), (76e41fae-ed31-4ce4-9691-49b6493f539f, 0)] collection_id = c66371ec-79e7-4213-90cb-1dcd790859d6
29432024-11-13T05:18:09.964ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
29442024-11-13T05:18:09.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
29452024-11-13T05:18:09.966ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29462024-11-13T05:18:09.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29472024-11-13T05:18:09.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29482024-11-13T05:18:09.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29492024-11-13T05:18:09.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29502024-11-13T05:18:09.967ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29512024-11-13T05:18:09.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29522024-11-13T05:18:09.968ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29532024-11-13T05:18:09.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29542024-11-13T05:18:09.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29552024-11-13T05:18:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29562024-11-13T05:18:09.969ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29572024-11-13T05:18:09.969ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29582024-11-13T05:18:09.969ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29592024-11-13T05:18:09.969ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29602024-11-13T05:18:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29612024-11-13T05:18:09.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29622024-11-13T05:18:09.970ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
29632024-11-13T05:18:09.970ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 823319e7-73bb-45cd-a920-1b364a68c099
29642024-11-13T05:18:09.970ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 8956c8e9-af05-41fa-87b0-6f06ebcea2df
29652024-11-13T05:18:09.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29662024-11-13T05:18:09.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29672024-11-13T05:18:09.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29682024-11-13T05:18:09.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29692024-11-13T05:18:09.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29702024-11-13T05:18:09.972ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29712024-11-13T05:18:09.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29722024-11-13T05:18:09.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29732024-11-13T05:18:09.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29742024-11-13T05:18:09.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29752024-11-13T05:18:09.973ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = a89189fe-3568-4721-a844-b1662e0d8323
29762024-11-13T05:18:09.973ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 823319e7-73bb-45cd-a920-1b364a68c099
29772024-11-13T05:18:09.973ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 8956c8e9-af05-41fa-87b0-6f06ebcea2df
29782024-11-13T05:18:09.973ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = a89189fe-3568-4721-a844-b1662e0d8323
29792024-11-13T05:18:09.973ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 77.014693ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
29802024-11-13T05:18:09.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29812024-11-13T05:18:09.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29822024-11-13T05:18:09.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29832024-11-13T05:18:09.975ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29842024-11-13T05:18:09.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29852024-11-13T05:18:09.977ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29862024-11-13T05:18:09.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29872024-11-13T05:18:09.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29882024-11-13T05:18:09.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29892024-11-13T05:18:09.979ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902024-11-13T05:18:09.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
29912024-11-13T05:18:09.983ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29922024-11-13T05:18:09.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29932024-11-13T05:18:09.994ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
29942024-11-13T05:18:09.994ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
29952024-11-13T05:18:09.994ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.678034ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
29962024-11-13T05:18:09.996ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 99.618571ms iteration = 24 status = {"physical_disks_added":0}
29972024-11-13T05:18:10.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29982024-11-13T05:18:10.002ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29992024-11-13T05:18:10.002ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.184259ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30002024-11-13T05:18:10.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30012024-11-13T05:18:10.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.878394ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30022024-11-13T05:18:10.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30032024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30042024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30052024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30062024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30072024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30082024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30092024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30102024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30112024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30122024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30132024-11-13T05:18:10.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30142024-11-13T05:18:10.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30152024-11-13T05:18:10.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30162024-11-13T05:18:10.007ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30172024-11-13T05:18:10.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30182024-11-13T05:18:10.008ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.150071ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30192024-11-13T05:18:10.008ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30202024-11-13T05:18:10.010ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30212024-11-13T05:18:10.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30222024-11-13T05:18:10.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30232024-11-13T05:18:10.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30242024-11-13T05:18:10.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30252024-11-13T05:18:10.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30262024-11-13T05:18:10.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30272024-11-13T05:18:10.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
30282024-11-13T05:18:10.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30292024-11-13T05:18:10.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30302024-11-13T05:18:10.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
30312024-11-13T05:18:10.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30322024-11-13T05:18:10.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30332024-11-13T05:18:10.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.066971ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30342024-11-13T05:18:10.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30352024-11-13T05:18:10.017ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30362024-11-13T05:18:10.017ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30372024-11-13T05:18:10.017ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30382024-11-13T05:18:10.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30392024-11-13T05:18:10.017ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.902607ms iteration = 21 status = 0
30402024-11-13T05:18:10.017ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30412024-11-13T05:18:10.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30422024-11-13T05:18:10.018ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = c66371ec-79e7-4213-90cb-1dcd790859d6 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
30432024-11-13T05:18:10.018ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
30442024-11-13T05:18:10.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
30452024-11-13T05:18:10.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30462024-11-13T05:18:10.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30472024-11-13T05:18:10.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30482024-11-13T05:18:10.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
30492024-11-13T05:18:10.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30502024-11-13T05:18:10.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30512024-11-13T05:18:10.023ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(09537548-7fff-47b4-a02b-15ccc730bcdf, 0), (1a84a72a-d258-498b-bf06-ec08433244ca, 0), (76e41fae-ed31-4ce4-9691-49b6493f539f, 0)]
30522024-11-13T05:18:10.024ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5471, tv_nsec: 533661993 } })
30532024-11-13T05:18:10.030ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
30542024-11-13T05:18:10.031ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.203743ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
30552024-11-13T05:18:10.034ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30562024-11-13T05:18:10.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30572024-11-13T05:18:10.036ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30582024-11-13T05:18:10.038ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30592024-11-13T05:18:10.038ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30602024-11-13T05:18:10.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30612024-11-13T05:18:10.043ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
30622024-11-13T05:18:10.043ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
30632024-11-13T05:18:10.043ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30642024-11-13T05:18:10.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30652024-11-13T05:18:10.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30662024-11-13T05:18:10.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30672024-11-13T05:18:10.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30682024-11-13T05:18:10.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30692024-11-13T05:18:10.050ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
30702024-11-13T05:18:10.050ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
30712024-11-13T05:18:10.050ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-13 05:08:54.008257 UTC dns_group = internal generation = 1
30722024-11-13T05:18:10.050ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 154.577352ms iteration = 12 status = {"generation":1}
30732024-11-13T05:18:10.052ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
30742024-11-13T05:18:10.052ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 0 version = 2
30752024-11-13T05:18:10.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30762024-11-13T05:18:10.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30772024-11-13T05:18:10.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30782024-11-13T05:18:10.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30792024-11-13T05:18:10.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30802024-11-13T05:18:10.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30812024-11-13T05:18:10.055ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.054421ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30822024-11-13T05:18:10.056ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30832024-11-13T05:18:10.056ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30842024-11-13T05:18:10.056ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 159.650315ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30852024-11-13T05:18:10.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30862024-11-13T05:18:10.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30872024-11-13T05:18:10.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30882024-11-13T05:18:10.057ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30892024-11-13T05:18:10.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30902024-11-13T05:18:10.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30912024-11-13T05:18:10.057ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30922024-11-13T05:18:10.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30932024-11-13T05:18:10.059ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 1 version = 2
30942024-11-13T05:18:10.059ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
30952024-11-13T05:18:10.059ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-13 05:08:54.834359 UTC dns_group = external generation = 2
30962024-11-13T05:18:10.059ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 162.897124ms iteration = 12 status = {"generation":2}
30972024-11-13T05:18:10.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30982024-11-13T05:18:10.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30992024-11-13T05:18:10.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31002024-11-13T05:18:10.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31012024-11-13T05:18:10.064ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31022024-11-13T05:18:10.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31032024-11-13T05:18:10.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31042024-11-13T05:18:10.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31052024-11-13T05:18:10.067ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31062024-11-13T05:18:10.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31072024-11-13T05:18:10.075ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-13T05:08:08.157062Z, time_modified: 2024-11-13T05:08:08.157062Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }) }
31082024-11-13T05:18:10.075ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 178.316829ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]}},"default_endpoint":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31092024-11-13T05:18:10.075ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31102024-11-13T05:18:10.075ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 178.672722ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31112024-11-13T05:18:10.076ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
31122024-11-13T05:18:10.076ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31132024-11-13T05:18:10.076ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80c0448d-972e-4aa5-ad7f-30d46cc27e69", "content-length": "26", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
31142024-11-13T05:18:10.076ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31152024-11-13T05:18:10.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31162024-11-13T05:18:10.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31172024-11-13T05:18:10.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31182024-11-13T05:18:10.078ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31192024-11-13T05:18:10.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
31202024-11-13T05:18:10.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31212024-11-13T05:18:10.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31222024-11-13T05:18:10.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31232024-11-13T05:18:10.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31242024-11-13T05:18:10.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31252024-11-13T05:18:10.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 58472b20-43be-4e4b-af15-fb068a9a1b96 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
31262024-11-13T05:18:10.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 58472b20-43be-4e4b-af15-fb068a9a1b96 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
31272024-11-13T05:18:10.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31282024-11-13T05:18:10.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 58472b20-43be-4e4b-af15-fb068a9a1b96 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
31292024-11-13T05:18:10.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31302024-11-13T05:18:10.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31312024-11-13T05:18:10.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31322024-11-13T05:18:10.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31332024-11-13T05:18:10.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31342024-11-13T05:18:10.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31352024-11-13T05:18:10.092ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31362024-11-13T05:18:10.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31372024-11-13T05:18:10.094ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31382024-11-13T05:18:10.095ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31392024-11-13T05:18:10.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31402024-11-13T05:18:10.097ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31412024-11-13T05:18:10.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
31422024-11-13T05:18:10.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31432024-11-13T05:18:10.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31442024-11-13T05:18:10.098ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31452024-11-13T05:18:10.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31462024-11-13T05:18:10.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31472024-11-13T05:18:10.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31482024-11-13T05:18:10.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31492024-11-13T05:18:10.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31502024-11-13T05:18:10.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31512024-11-13T05:18:10.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31522024-11-13T05:18:10.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31532024-11-13T05:18:10.102ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31542024-11-13T05:18:10.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31552024-11-13T05:18:10.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31562024-11-13T05:18:10.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
31572024-11-13T05:18:10.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31582024-11-13T05:18:10.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31592024-11-13T05:18:10.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31602024-11-13T05:18:10.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31612024-11-13T05:18:10.111ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31622024-11-13T05:18:10.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31632024-11-13T05:18:10.112ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31642024-11-13T05:18:10.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31652024-11-13T05:18:10.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31662024-11-13T05:18:10.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31672024-11-13T05:18:10.116ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31682024-11-13T05:18:10.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31692024-11-13T05:18:10.118ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31702024-11-13T05:18:10.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31712024-11-13T05:18:10.120ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31722024-11-13T05:18:10.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31732024-11-13T05:18:10.121ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31742024-11-13T05:18:10.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
31752024-11-13T05:18:10.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31762024-11-13T05:18:10.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31772024-11-13T05:18:10.127ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31782024-11-13T05:18:10.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31792024-11-13T05:18:10.129ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31802024-11-13T05:18:10.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31812024-11-13T05:18:10.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31822024-11-13T05:18:10.131ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
31832024-11-13T05:18:10.131ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31842024-11-13T05:18:10.131ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "017be60f-f68b-44cd-a1ba-adba33800319", "content-length": "26", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
31852024-11-13T05:18:10.131ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31862024-11-13T05:18:10.133ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
31872024-11-13T05:18:10.133ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
31882024-11-13T05:18:10.133ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31892024-11-13T05:18:10.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31902024-11-13T05:18:10.142ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 150e1804-b3f0-4f2c-82cf-fb2bbaab0984, kind: Service { id: 038e4c2b-2408-42f1-b025-c88f1167faaf }, name: Name("external-dns-038e4c2b-2408-42f1-b025-c88f1167faaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b98af94a-ceb1-41e9-82a5-9be8a66b4c85, kind: Service { id: eb4a98a4-3147-445f-9881-33f4dffeca66 }, name: Name("external-dns-eb4a98a4-3147-445f-9881-33f4dffeca66"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 145])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 55f88ed5-95d7-43db-b06a-514b7adb4cdb, kind: Service { id: 7641195e-73b4-4972-ad51-4fcacb36a4be }, name: Name("nexus-7641195e-73b4-4972-ad51-4fcacb36a4be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 984220cf-9c9a-412c-a465-3579565ca87a, kind: Service { id: e181617d-520a-429d-85ef-385f6dde38ea }, name: Name("nexus-e181617d-520a-429d-85ef-385f6dde38ea"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9df31eec-63bd-49fd-99e9-b3a05e952553, kind: Service { id: 6c4893ca-1b18-4910-8b18-504e5fcb8dc5 }, name: Name("nexus-6c4893ca-1b18-4910-8b18-504e5fcb8dc5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
31912024-11-13T05:18:10.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31922024-11-13T05:18:10.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31932024-11-13T05:18:10.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942024-11-13T05:18:10.146ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
31952024-11-13T05:18:10.146ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31962024-11-13T05:18:10.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31972024-11-13T05:18:10.156ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
31982024-11-13T05:18:10.156ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 150e1804-b3f0-4f2c-82cf-fb2bbaab0984, kind: Service { id: 038e4c2b-2408-42f1-b025-c88f1167faaf }, name: Name("external-dns-038e4c2b-2408-42f1-b025-c88f1167faaf"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 83])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b98af94a-ceb1-41e9-82a5-9be8a66b4c85, kind: Service { id: eb4a98a4-3147-445f-9881-33f4dffeca66 }, name: Name("external-dns-eb4a98a4-3147-445f-9881-33f4dffeca66"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 145])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 55f88ed5-95d7-43db-b06a-514b7adb4cdb, kind: Service { id: 7641195e-73b4-4972-ad51-4fcacb36a4be }, name: Name("nexus-7641195e-73b4-4972-ad51-4fcacb36a4be"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 984220cf-9c9a-412c-a465-3579565ca87a, kind: Service { id: e181617d-520a-429d-85ef-385f6dde38ea }, name: Name("nexus-e181617d-520a-429d-85ef-385f6dde38ea"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9df31eec-63bd-49fd-99e9-b3a05e952553, kind: Service { id: 6c4893ca-1b18-4910-8b18-504e5fcb8dc5 }, name: Name("nexus-6c4893ca-1b18-4910-8b18-504e5fcb8dc5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 5])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
31992024-11-13T05:18:10.156ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
32002024-11-13T05:18:10.216ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 4d997277-f640-48d7-af56-6df261d5afe1, time_created: 2024-11-13T05:08:52.009934Z, time_modified: 2024-11-13T05:08:52.009934Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
32012024-11-13T05:18:10.216ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
32022024-11-13T05:18:10.216ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32032024-11-13T05:18:10.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32042024-11-13T05:18:10.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32052024-11-13T05:18:10.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32062024-11-13T05:18:10.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32072024-11-13T05:18:10.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
32082024-11-13T05:18:10.226ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32092024-11-13T05:18:10.234ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32102024-11-13T05:18:10.344ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
32112024-11-13T05:18:10.344ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32122024-11-13T05:18:10.345ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cd36731-b9b1-4991-86d7-78224a955d35", "content-length": "26", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32132024-11-13T05:18:10.345ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32142024-11-13T05:18:10.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32152024-11-13T05:18:10.398ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
32162024-11-13T05:18:10.398ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
32172024-11-13T05:18:10.398ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
32182024-11-13T05:18:10.398ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "86d19b42-72e1-4a6f-b16d-b5b05f8a5e49", "content-length": "476", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32192024-11-13T05:18:10.398ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
32202024-11-13T05:18:10.398ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d105e9d2-c2ef-4bde-83a0-3080d42ebb25", "content-length": "734", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32212024-11-13T05:18:10.398ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
32222024-11-13T05:18:10.399ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "98880bca-0b93-4366-bdb7-462aa9c28f85", "content-length": "111", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32232024-11-13T05:18:10.399ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
32242024-11-13T05:18:10.399ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "09941bd1-7ad5-4295-8d8c-ebb0af44a49d", "content-length": "111", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32252024-11-13T05:18:10.399ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
32262024-11-13T05:18:10.399ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f6c987d-3dbc-4992-a393-3472cb09b01b", "content-length": "167", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32272024-11-13T05:18:10.399ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
32282024-11-13T05:18:10.399ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f558713-88cc-425e-ae88-a072386c59a1", "content-length": "167", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32292024-11-13T05:18:10.399ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
32302024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "112d5b24-a4c7-4e8d-baff-c085f51163d5", "content-length": "175", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32312024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
32322024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad153383-5de5-4558-a35e-f78abab1f55a", "content-length": "175", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32332024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
32342024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bf2d3dc-612b-4980-b452-8bcf6dd3b264", "content-length": "702", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32352024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
32362024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e230569-0ead-45cc-87ed-3d69cc42d34e", "content-length": "727", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32372024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
32382024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9979ed34-1812-467c-8ed9-bd8384371d43", "content-length": "729", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32392024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
32402024-11-13T05:18:10.400ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "595f3fe5-4c04-48b7-a2dd-cdb207bab78d", "content-length": "728", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32412024-11-13T05:18:10.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
32422024-11-13T05:18:10.401ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b69b800d-7864-44c1-99eb-f9a093fc7d9a", "content-length": "722", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32432024-11-13T05:18:10.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
32442024-11-13T05:18:10.401ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8dab1c1-e6c4-4901-a1b3-799b5a0d83c5", "content-length": "109", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32452024-11-13T05:18:10.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
32462024-11-13T05:18:10.401ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0160981e-3253-45e6-a7c5-51cec3236a60", "content-length": "109", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32472024-11-13T05:18:10.401ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
32482024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "60640bca-3fff-4f82-b8bd-a490f97eb270", "content-length": "169", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32492024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
32502024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0622680a-473a-4876-9693-8a89b8fe5c57", "content-length": "169", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32512024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
32522024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1572594f-b336-41a6-b2bd-001815e7cd99", "content-length": "178", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32532024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
32542024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c52c2c8a-e4c6-471c-b51a-3e4007ce45e9", "content-length": "178", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32552024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
32562024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2e48e12-f165-40fa-89a1-6deba059b79e", "content-length": "702", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32572024-11-13T05:18:10.402ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
32582024-11-13T05:18:10.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6fdc876-8223-4cc0-85c6-29eda2181656", "content-length": "727", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32592024-11-13T05:18:10.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
32602024-11-13T05:18:10.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5fc0781e-32fa-40ad-9aee-378fdb96d8ce", "content-length": "729", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32612024-11-13T05:18:10.403ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
32622024-11-13T05:18:10.403ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d97755b0-624c-4bb7-916d-ff91f87bb326", "content-length": "728", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32632024-11-13T05:18:10.403ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32642024-11-13T05:18:10.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
32652024-11-13T05:18:10.405ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32662024-11-13T05:18:10.407ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
32672024-11-13T05:18:10.407ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32682024-11-13T05:18:10.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
32692024-11-13T05:18:10.442ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32702024-11-13T05:18:10.442ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "18fd8327-1419-4847-be50-f27c1491a903", "content-length": "691", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32712024-11-13T05:18:10.442ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32722024-11-13T05:18:10.442ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
32732024-11-13T05:18:10.442ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
32742024-11-13T05:18:10.443ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 547.332694ms iteration = 21 status = {}
32752024-11-13T05:18:10.444ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32762024-11-13T05:18:10.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
32772024-11-13T05:18:10.445ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
32782024-11-13T05:18:10.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
32792024-11-13T05:18:10.464ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32802024-11-13T05:18:10.465ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "96c425e0-a39a-4221-9396-7743bc08ad29", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
32812024-11-13T05:18:10.465ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
32822024-11-13T05:18:10.466ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "88ffd74e-13b5-478e-8924-9318a924c4b0", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
32832024-11-13T05:18:10.466ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
32842024-11-13T05:18:10.468ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2c9db436-af7d-4e11-9176-787ed672b4e0", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
32852024-11-13T05:18:10.468ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
32862024-11-13T05:18:10.470ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
32872024-11-13T05:18:10.470ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 574.238559ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32882024-11-13T05:18:10.475ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32892024-11-13T05:18:10.475ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32902024-11-13T05:18:10.475ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "daf23b49-14be-41c2-a652-480388bb3f93", "content-length": "372", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32912024-11-13T05:18:10.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32922024-11-13T05:18:10.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32932024-11-13T05:18:10.489ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32942024-11-13T05:18:10.489ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32952024-11-13T05:18:10.489ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "14de0de3-46a5-4a29-8f3d-2dde98b20d95", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
32962024-11-13T05:18:10.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32972024-11-13T05:18:10.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32982024-11-13T05:18:10.494ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
32992024-11-13T05:18:10.495ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "4f0fe75f-bf47-4027-9e89-4f921e416272", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33002024-11-13T05:18:10.496ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
33012024-11-13T05:18:10.496ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 599.871313ms
33022024-11-13T05:18:10.496ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 599.882453ms iteration = 3 status = {}
33032024-11-13T05:18:10.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33042024-11-13T05:18:10.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33052024-11-13T05:18:10.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33062024-11-13T05:18:10.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33072024-11-13T05:18:10.502ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33082024-11-13T05:18:10.502ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33092024-11-13T05:18:10.502ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6d8f5711-e8cc-4854-b990-b455f46f2c51", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33102024-11-13T05:18:10.504ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 608.339797ms iteration = 22 status = {}
33112024-11-13T05:18:10.550ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 653.689503ms iteration = 21 status = {}
33122024-11-13T05:18:10.579ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33132024-11-13T05:18:10.579ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e6f2adc5-1b89-4144-bfa0-ccd056b41159", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33142024-11-13T05:18:10.579ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33152024-11-13T05:18:10.579ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1382 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = c17e83b3-c6a5-488d-83fd-f83fbd340261 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
33162024-11-13T05:18:10.581ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1bee328f-6571-4aa7-b1e8-eec4bf721e43", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33172024-11-13T05:18:10.581ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33182024-11-13T05:18:10.583ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
33192024-11-13T05:18:10.583ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 686.39973ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
33202024-11-13T05:18:10.603ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
33212024-11-13T05:18:10.603ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
33222024-11-13T05:18:10.633ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
33232024-11-13T05:18:10.633ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "beebb4ac-7f56-4fcd-90ab-7bdf7c94e761", "content-length": "1", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33242024-11-13T05:18:10.635ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33252024-11-13T05:18:10.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33262024-11-13T05:18:10.638ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 741.845905ms iteration = 21 status = null
33272024-11-13T05:18:10.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33282024-11-13T05:18:10.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33292024-11-13T05:18:10.669ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
33302024-11-13T05:18:10.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33312024-11-13T05:18:10.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33322024-11-13T05:18:10.684ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33332024-11-13T05:18:10.684ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0760f3a6-3c3c-4300-abab-23b3df68c242", "content-length": "134", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33342024-11-13T05:18:10.684ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33352024-11-13T05:18:10.684ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
33362024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33372024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33382024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33392024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33402024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33412024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33422024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33432024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33442024-11-13T05:18:10.685ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
33452024-11-13T05:18:10.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33462024-11-13T05:18:10.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33472024-11-13T05:18:10.687ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33482024-11-13T05:18:10.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0469f51c-f9d7-41b1-b8e7-60559dac0861", "content-length": "2", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33492024-11-13T05:18:10.687ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33502024-11-13T05:18:10.687ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "52be8716-8728-4da3-96fb-0fe158eaeda5", "content-length": "52", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33512024-11-13T05:18:10.687ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
33522024-11-13T05:18:10.687ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33532024-11-13T05:18:10.803ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "715d223c-db22-46c2-a287-85ae60c1e5b3", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33542024-11-13T05:18:10.803ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
33552024-11-13T05:18:10.803ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33562024-11-13T05:18:10.803ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d5cf88a-f328-48c6-93f5-5e443b98ae70", "content-length": "682", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33572024-11-13T05:18:10.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33582024-11-13T05:18:10.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33592024-11-13T05:18:10.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33602024-11-13T05:18:10.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33612024-11-13T05:18:10.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33622024-11-13T05:18:10.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33632024-11-13T05:18:10.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33642024-11-13T05:18:10.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33652024-11-13T05:18:10.820ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 924.037827ms iteration = 21 status = {}
33662024-11-13T05:18:10.868ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f9003ad-0297-4098-8fd8-bbbed563d780", "content-length": "30761", "date": "Wed, 13 Nov 2024 05:18:10 GMT"} })
33672024-11-13T05:18:10.870ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
33682024-11-13T05:18:10.870ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
33692024-11-13T05:18:10.870ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
33702024-11-13T05:18:10.872ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33712024-11-13T05:18:10.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33722024-11-13T05:18:10.875ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33732024-11-13T05:18:10.878ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
33742024-11-13T05:18:10.878ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
33752024-11-13T05:18:10.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
33762024-11-13T05:18:11.089ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = eb00fd78-6f60-4eed-ad14-c4ec87f662d2 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
33772024-11-13T05:18:11.089ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = eb00fd78-6f60-4eed-ad14-c4ec87f662d2 time_started = 2024-11-13 05:18:10.398110 UTC
33782024-11-13T05:18:11.089ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.192690056s iteration = 4 status = {"collection_id":"eb00fd78-6f60-4eed-ad14-c4ec87f662d2","time_done":"2024-11-13 05:18:10.870934 UTC","time_started":"2024-11-13 05:18:10.398110 UTC"}
33792024-11-13T05:18:11.089ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
33802024-11-13T05:18:11.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33812024-11-13T05:18:11.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33822024-11-13T05:18:11.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33832024-11-13T05:18:11.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33842024-11-13T05:18:11.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33852024-11-13T05:18:11.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33862024-11-13T05:18:11.095ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33872024-11-13T05:18:11.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33882024-11-13T05:18:11.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33892024-11-13T05:18:11.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33902024-11-13T05:18:11.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33912024-11-13T05:18:11.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33922024-11-13T05:18:11.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e50a5a02-3ba3-459f-b405-37f6e8341ce1 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
33932024-11-13T05:18:11.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e50a5a02-3ba3-459f-b405-37f6e8341ce1 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
33942024-11-13T05:18:11.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e50a5a02-3ba3-459f-b405-37f6e8341ce1 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
33952024-11-13T05:18:11.217ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.15646ms iteration = 25 status = {"physical_disks_added":0}
33962024-11-13T05:18:12.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad9a1381-8dd3-4df8-89df-1dfc10b08be4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
33972024-11-13T05:18:12.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad9a1381-8dd3-4df8-89df-1dfc10b08be4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
33982024-11-13T05:18:12.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad9a1381-8dd3-4df8-89df-1dfc10b08be4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
33992024-11-13T05:18:13.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ba84b297-954e-44b5-b526-5fa08fbca1c2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34002024-11-13T05:18:13.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ba84b297-954e-44b5-b526-5fa08fbca1c2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34012024-11-13T05:18:13.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ba84b297-954e-44b5-b526-5fa08fbca1c2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34022024-11-13T05:18:14.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8abcd872-d33a-4c94-a146-0425ecc618d4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34032024-11-13T05:18:14.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8abcd872-d33a-4c94-a146-0425ecc618d4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34042024-11-13T05:18:14.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8abcd872-d33a-4c94-a146-0425ecc618d4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34052024-11-13T05:18:15.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8538ca4-e19e-4524-82f1-c8bb33c2489c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34062024-11-13T05:18:15.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8538ca4-e19e-4524-82f1-c8bb33c2489c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34072024-11-13T05:18:15.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1623 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8538ca4-e19e-4524-82f1-c8bb33c2489c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34082024-11-13T05:18:16.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d4033256-cee8-43a2-8d4c-bcd3c23510db roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34092024-11-13T05:18:16.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d4033256-cee8-43a2-8d4c-bcd3c23510db resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34102024-11-13T05:18:16.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d4033256-cee8-43a2-8d4c-bcd3c23510db response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34112024-11-13T05:18:16.653ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:52608
34122024-11-13T05:18:16.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52608 req_id = 0700c5c8-ccc4-4a2d-8568-497fdf9f13e9 roles = RoleSet { roles: {} } uri = /metrics/producers
34132024-11-13T05:18:16.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52608 req_id = 0700c5c8-ccc4-4a2d-8568-497fdf9f13e9 resource = Database result = Ok(()) uri = /metrics/producers
34142024-11-13T05:18:16.689ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 4d997277-f640-48d7-af56-6df261d5afe1
34152024-11-13T05:18:16.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35425 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52608 req_id = 0700c5c8-ccc4-4a2d-8568-497fdf9f13e9 response_code = 201 uri = /metrics/producers
34162024-11-13T05:18:16.945ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:51201
34172024-11-13T05:18:16.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51201 req_id = a821664f-02a0-43de-89bd-06ab37da04e3 roles = RoleSet { roles: {} } uri = /metrics/producers
34182024-11-13T05:18:16.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51201 req_id = a821664f-02a0-43de-89bd-06ab37da04e3 resource = Database result = Ok(()) uri = /metrics/producers
34192024-11-13T05:18:16.984ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 10a586d4-9652-4a30-9058-49973290a890
34202024-11-13T05:18:16.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39189 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51201 req_id = a821664f-02a0-43de-89bd-06ab37da04e3 response_code = 201 uri = /metrics/producers
34212024-11-13T05:18:17.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c022efc1-a6fb-4341-978b-6b8df7da63f0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34222024-11-13T05:18:17.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c022efc1-a6fb-4341-978b-6b8df7da63f0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34232024-11-13T05:18:17.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c022efc1-a6fb-4341-978b-6b8df7da63f0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34242024-11-13T05:18:17.616ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60014
34252024-11-13T05:18:17.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60014 req_id = 7352c0f0-3ed6-4837-8cdb-93739c0e2d04 roles = RoleSet { roles: {} } uri = /metrics/producers
34262024-11-13T05:18:17.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60014 req_id = 7352c0f0-3ed6-4837-8cdb-93739c0e2d04 resource = Database result = Ok(()) uri = /metrics/producers
34272024-11-13T05:18:17.658ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = eb1311f8-6807-471a-a8f7-8fe643dea75d
34282024-11-13T05:18:17.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41516 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60014 req_id = 7352c0f0-3ed6-4837-8cdb-93739c0e2d04 response_code = 201 uri = /metrics/producers
34292024-11-13T05:18:18.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4292168b-6269-463a-abaf-77bd3fb7c655 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34302024-11-13T05:18:18.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4292168b-6269-463a-abaf-77bd3fb7c655 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34312024-11-13T05:18:18.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4292168b-6269-463a-abaf-77bd3fb7c655 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34322024-11-13T05:18:19.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a8f26e7e-e3b7-49f7-9ed0-44ec480dd7bc roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34332024-11-13T05:18:19.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a8f26e7e-e3b7-49f7-9ed0-44ec480dd7bc resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34342024-11-13T05:18:19.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a8f26e7e-e3b7-49f7-9ed0-44ec480dd7bc response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34352024-11-13T05:18:19.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
34362024-11-13T05:18:19.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
34372024-11-13T05:18:19.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34382024-11-13T05:18:19.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34392024-11-13T05:18:19.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34402024-11-13T05:18:19.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34412024-11-13T05:18:19.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422024-11-13T05:18:19.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34432024-11-13T05:18:19.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34442024-11-13T05:18:19.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34452024-11-13T05:18:19.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34462024-11-13T05:18:19.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34472024-11-13T05:18:19.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34482024-11-13T05:18:19.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
34492024-11-13T05:18:19.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34502024-11-13T05:18:19.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34512024-11-13T05:18:19.917ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
34522024-11-13T05:18:19.917ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.77217ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
34532024-11-13T05:18:19.926ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34542024-11-13T05:18:19.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34552024-11-13T05:18:19.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.924909ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34562024-11-13T05:18:20.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 20113b9f-d0ec-4d69-abcc-f39743f37f95 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34572024-11-13T05:18:20.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 20113b9f-d0ec-4d69-abcc-f39743f37f95 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34582024-11-13T05:18:20.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 20113b9f-d0ec-4d69-abcc-f39743f37f95 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34592024-11-13T05:18:21.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7f6d661e-20a7-46ac-9298-525faa698bf3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34602024-11-13T05:18:21.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7f6d661e-20a7-46ac-9298-525faa698bf3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34612024-11-13T05:18:21.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7f6d661e-20a7-46ac-9298-525faa698bf3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34622024-11-13T05:18:22.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4525e9ec-0000-4933-beee-b4357793c2aa roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34632024-11-13T05:18:22.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4525e9ec-0000-4933-beee-b4357793c2aa resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34642024-11-13T05:18:22.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4525e9ec-0000-4933-beee-b4357793c2aa response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34652024-11-13T05:18:23.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = aaf3575e-8e16-484b-98fd-ffafc374253f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34662024-11-13T05:18:23.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = aaf3575e-8e16-484b-98fd-ffafc374253f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34672024-11-13T05:18:23.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = aaf3575e-8e16-484b-98fd-ffafc374253f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34682024-11-13T05:18:24.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b96a627b-3a0b-4c98-bcd9-40c441dd9b7d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34692024-11-13T05:18:24.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b96a627b-3a0b-4c98-bcd9-40c441dd9b7d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34702024-11-13T05:18:24.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b96a627b-3a0b-4c98-bcd9-40c441dd9b7d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34712024-11-13T05:18:25.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9f7104cc-3ee3-40a2-855f-ff8e5037a6c7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34722024-11-13T05:18:25.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9f7104cc-3ee3-40a2-855f-ff8e5037a6c7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34732024-11-13T05:18:25.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9f7104cc-3ee3-40a2-855f-ff8e5037a6c7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34742024-11-13T05:18:25.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1582 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = c607dc29-c9be-48da-abb8-5bded3f86b96 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
34752024-11-13T05:18:26.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4cdad72-7994-4ce2-835f-77a1343c7026 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34762024-11-13T05:18:26.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4cdad72-7994-4ce2-835f-77a1343c7026 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34772024-11-13T05:18:26.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1853 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4cdad72-7994-4ce2-835f-77a1343c7026 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34782024-11-13T05:18:27.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 57e2b0e2-1dd0-4434-9bd9-deeef0b9a552 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34792024-11-13T05:18:27.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 57e2b0e2-1dd0-4434-9bd9-deeef0b9a552 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34802024-11-13T05:18:27.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 57e2b0e2-1dd0-4434-9bd9-deeef0b9a552 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34812024-11-13T05:18:28.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = de46c8b3-a2ee-40de-9803-4c3c39d72a28 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34822024-11-13T05:18:28.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = de46c8b3-a2ee-40de-9803-4c3c39d72a28 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34832024-11-13T05:18:28.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = de46c8b3-a2ee-40de-9803-4c3c39d72a28 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34842024-11-13T05:18:29.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23f6498d-171f-4dde-b3ed-4449c9a76bad roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34852024-11-13T05:18:29.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23f6498d-171f-4dde-b3ed-4449c9a76bad resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34862024-11-13T05:18:29.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23f6498d-171f-4dde-b3ed-4449c9a76bad response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
34872024-11-13T05:18:29.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
34882024-11-13T05:18:29.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34892024-11-13T05:18:29.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
34902024-11-13T05:18:29.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34912024-11-13T05:18:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34922024-11-13T05:18:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34932024-11-13T05:18:29.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34942024-11-13T05:18:29.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34952024-11-13T05:18:29.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34962024-11-13T05:18:29.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.109506ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34972024-11-13T05:18:29.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34982024-11-13T05:18:29.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34992024-11-13T05:18:29.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35002024-11-13T05:18:29.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35012024-11-13T05:18:29.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35022024-11-13T05:18:29.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35032024-11-13T05:18:29.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
35042024-11-13T05:18:29.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35052024-11-13T05:18:29.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35062024-11-13T05:18:29.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
35072024-11-13T05:18:29.924ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.019956ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
35082024-11-13T05:18:30.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a9858c91-e6c0-4fb6-9040-51ff10d5f9b7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35092024-11-13T05:18:30.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a9858c91-e6c0-4fb6-9040-51ff10d5f9b7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35102024-11-13T05:18:30.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a9858c91-e6c0-4fb6-9040-51ff10d5f9b7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35112024-11-13T05:18:30.824ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:35947
35122024-11-13T05:18:30.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35947 req_id = c5e0707f-9df1-47d7-9379-389618cd0a4f roles = RoleSet { roles: {} } uri = /metrics/producers
35132024-11-13T05:18:30.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35947 req_id = c5e0707f-9df1-47d7-9379-389618cd0a4f resource = Database result = Ok(()) uri = /metrics/producers
35142024-11-13T05:18:30.860ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 31913a62-fea3-4aea-8cf3-f0c6569df8d6
35152024-11-13T05:18:30.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35991 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35947 req_id = c5e0707f-9df1-47d7-9379-389618cd0a4f response_code = 201 uri = /metrics/producers
35162024-11-13T05:18:31.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fc68166-ba66-475d-995b-106faa33e6b8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35172024-11-13T05:18:31.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fc68166-ba66-475d-995b-106faa33e6b8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35182024-11-13T05:18:31.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5fc68166-ba66-475d-995b-106faa33e6b8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35192024-11-13T05:18:32.077ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63999
35202024-11-13T05:18:32.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63999 req_id = e4a7eef3-fd4d-40f7-a603-94e7415a5ee4 roles = RoleSet { roles: {} } uri = /metrics/producers
35212024-11-13T05:18:32.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63999 req_id = e4a7eef3-fd4d-40f7-a603-94e7415a5ee4 resource = Database result = Ok(()) uri = /metrics/producers
35222024-11-13T05:18:32.085ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 059eb401-7fec-4da1-95e5-eea11ccf6ab1
35232024-11-13T05:18:32.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7919 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63999 req_id = e4a7eef3-fd4d-40f7-a603-94e7415a5ee4 response_code = 201 uri = /metrics/producers
35242024-11-13T05:18:32.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 53c6c83f-4093-4bda-8fb4-dfb1639c1e02 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35252024-11-13T05:18:32.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 53c6c83f-4093-4bda-8fb4-dfb1639c1e02 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35262024-11-13T05:18:32.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 53c6c83f-4093-4bda-8fb4-dfb1639c1e02 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35272024-11-13T05:18:33.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c89e7da5-c772-4b37-9a4f-1d9a8cab7f23 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35282024-11-13T05:18:33.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c89e7da5-c772-4b37-9a4f-1d9a8cab7f23 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35292024-11-13T05:18:33.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c89e7da5-c772-4b37-9a4f-1d9a8cab7f23 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35302024-11-13T05:18:34.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b5566c29-e4ee-41c2-be04-dccfd88d3272 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35312024-11-13T05:18:34.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b5566c29-e4ee-41c2-be04-dccfd88d3272 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35322024-11-13T05:18:34.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b5566c29-e4ee-41c2-be04-dccfd88d3272 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35332024-11-13T05:18:34.901ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:59845
35342024-11-13T05:18:34.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59845 req_id = ae359c70-0031-4d87-95cc-d58a62667055 roles = RoleSet { roles: {} } uri = /metrics/producers
35352024-11-13T05:18:34.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59845 req_id = ae359c70-0031-4d87-95cc-d58a62667055 resource = Database result = Ok(()) uri = /metrics/producers
35362024-11-13T05:18:34.910ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 05102f67-14d0-4743-98e7-bdad704b43e5
35372024-11-13T05:18:34.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8922 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59845 req_id = ae359c70-0031-4d87-95cc-d58a62667055 response_code = 201 uri = /metrics/producers
35382024-11-13T05:18:35.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a11d5d82-7afd-4d8e-801d-46247456ca14 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35392024-11-13T05:18:35.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a11d5d82-7afd-4d8e-801d-46247456ca14 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35402024-11-13T05:18:35.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a11d5d82-7afd-4d8e-801d-46247456ca14 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35412024-11-13T05:18:36.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6fc8537b-8e60-417b-8d09-cf976d8b2112 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35422024-11-13T05:18:36.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6fc8537b-8e60-417b-8d09-cf976d8b2112 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35432024-11-13T05:18:36.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6fc8537b-8e60-417b-8d09-cf976d8b2112 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35442024-11-13T05:18:37.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 637a0123-d97e-45b2-aea3-13024e3ac8b9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35452024-11-13T05:18:37.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 637a0123-d97e-45b2-aea3-13024e3ac8b9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35462024-11-13T05:18:37.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 637a0123-d97e-45b2-aea3-13024e3ac8b9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35472024-11-13T05:18:38.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 966fba0a-c68e-400b-869f-d2e3d317add3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35482024-11-13T05:18:38.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 966fba0a-c68e-400b-869f-d2e3d317add3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35492024-11-13T05:18:38.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 966fba0a-c68e-400b-869f-d2e3d317add3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35502024-11-13T05:18:39.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2b4cbb6e-cf5c-417a-b91e-41cf026c1af9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35512024-11-13T05:18:39.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2b4cbb6e-cf5c-417a-b91e-41cf026c1af9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35522024-11-13T05:18:39.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2b4cbb6e-cf5c-417a-b91e-41cf026c1af9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
35532024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
35542024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35552024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
35562024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
35572024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35582024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
35592024-11-13T05:18:39.896ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35602024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35612024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35622024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
35632024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35642024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35652024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
35662024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35672024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
35682024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35692024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
35702024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35712024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
35722024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35732024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
35742024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35752024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
35762024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
35772024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35782024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35792024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
35802024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35812024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
35822024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35832024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
35842024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35852024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
35862024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35872024-11-13T05:18:39.896ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
35882024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35892024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35902024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35912024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35922024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35932024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35942024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35952024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35962024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35972024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35982024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35992024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36002024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36012024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36022024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36032024-11-13T05:18:39.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36042024-11-13T05:18:39.899ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.598783ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36052024-11-13T05:18:39.900ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.771553ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
36062024-11-13T05:18:39.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36072024-11-13T05:18:39.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36082024-11-13T05:18:39.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36092024-11-13T05:18:39.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36102024-11-13T05:18:39.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36112024-11-13T05:18:39.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36122024-11-13T05:18:39.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36132024-11-13T05:18:39.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36142024-11-13T05:18:39.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36152024-11-13T05:18:39.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36162024-11-13T05:18:39.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36172024-11-13T05:18:39.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36182024-11-13T05:18:39.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36192024-11-13T05:18:39.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36202024-11-13T05:18:39.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36212024-11-13T05:18:39.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36222024-11-13T05:18:39.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36232024-11-13T05:18:39.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36242024-11-13T05:18:39.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36252024-11-13T05:18:39.909ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5501, tv_nsec: 418833610 } })
36262024-11-13T05:18:39.909ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
36272024-11-13T05:18:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36282024-11-13T05:18:39.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36292024-11-13T05:18:39.910ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5501, tv_nsec: 419290474 } })
36302024-11-13T05:18:39.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36312024-11-13T05:18:39.910ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
36322024-11-13T05:18:39.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36332024-11-13T05:18:39.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36342024-11-13T05:18:39.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36352024-11-13T05:18:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36362024-11-13T05:18:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36372024-11-13T05:18:39.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36382024-11-13T05:18:39.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36392024-11-13T05:18:39.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36402024-11-13T05:18:39.915ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36412024-11-13T05:18:39.915ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.224128ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36422024-11-13T05:18:39.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36432024-11-13T05:18:39.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36442024-11-13T05:18:39.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36452024-11-13T05:18:39.916ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36462024-11-13T05:18:39.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36472024-11-13T05:18:39.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36482024-11-13T05:18:39.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36492024-11-13T05:18:39.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
36502024-11-13T05:18:39.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36512024-11-13T05:18:39.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36522024-11-13T05:18:39.939ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36532024-11-13T05:18:39.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36542024-11-13T05:18:39.941ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36552024-11-13T05:18:39.941ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36562024-11-13T05:18:39.941ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36572024-11-13T05:18:39.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36582024-11-13T05:18:39.944ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36592024-11-13T05:18:39.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36602024-11-13T05:18:39.946ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36612024-11-13T05:18:39.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36622024-11-13T05:18:39.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36632024-11-13T05:18:39.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36642024-11-13T05:18:39.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36652024-11-13T05:18:39.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36662024-11-13T05:18:39.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.61545ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36672024-11-13T05:18:39.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.63817ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
36682024-11-13T05:18:39.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36692024-11-13T05:18:39.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36702024-11-13T05:18:39.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36712024-11-13T05:18:39.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36722024-11-13T05:18:40.002ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
36732024-11-13T05:18:40.002ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36742024-11-13T05:18:40.003ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3953a5b6-ba95-444f-b870-21bfc4304594", "content-length": "26", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
36752024-11-13T05:18:40.003ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36762024-11-13T05:18:40.003ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
36772024-11-13T05:18:40.003ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36782024-11-13T05:18:40.004ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fa0049e-21e9-4a1a-bc2d-6bd7c80434f8", "content-length": "26", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
36792024-11-13T05:18:40.004ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36802024-11-13T05:18:40.004ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36812024-11-13T05:18:40.006ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36822024-11-13T05:18:40.027ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36832024-11-13T05:18:40.027ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36842024-11-13T05:18:40.027ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "88a5ec32-2135-4b68-b78d-fa95a1365b67", "content-length": "372", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
36852024-11-13T05:18:40.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36862024-11-13T05:18:40.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36872024-11-13T05:18:40.031ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36882024-11-13T05:18:40.031ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36892024-11-13T05:18:40.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36902024-11-13T05:18:40.031ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 134.531546ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36912024-11-13T05:18:40.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36922024-11-13T05:18:40.033ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5501, tv_nsec: 542445500 } })
36932024-11-13T05:18:40.033ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
36942024-11-13T05:18:40.033ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36952024-11-13T05:18:40.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36962024-11-13T05:18:40.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36972024-11-13T05:18:40.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
36982024-11-13T05:18:40.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36992024-11-13T05:18:40.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37002024-11-13T05:18:40.040ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 144.345972ms iteration = 22 status = 0
37012024-11-13T05:18:40.042ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
37022024-11-13T05:18:40.042ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 145.835774ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
37032024-11-13T05:18:40.064ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37042024-11-13T05:18:40.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37052024-11-13T05:18:40.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 168.735955ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37062024-11-13T05:18:40.066ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37072024-11-13T05:18:40.066ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37082024-11-13T05:18:40.066ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.029496ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37092024-11-13T05:18:40.081ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
37102024-11-13T05:18:40.082ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8655374-0653-4b3d-80d1-5c1b75da45f2", "content-length": "1", "date": "Wed, 13 Nov 2024 05:18:39 GMT"} })
37112024-11-13T05:18:40.083ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37122024-11-13T05:18:40.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37132024-11-13T05:18:40.084ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
37142024-11-13T05:18:40.084ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37152024-11-13T05:18:40.084ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "22fb230f-68e0-4f02-a4e4-6bf4bce5412c", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
37162024-11-13T05:18:40.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37172024-11-13T05:18:40.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37182024-11-13T05:18:40.086ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 189.373205ms iteration = 22 status = null
37192024-11-13T05:18:40.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37202024-11-13T05:18:40.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37212024-11-13T05:18:40.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37222024-11-13T05:18:40.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37232024-11-13T05:18:40.091ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.166746ms iteration = 22 status = {}
37242024-11-13T05:18:40.093ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37252024-11-13T05:18:40.093ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37262024-11-13T05:18:40.093ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "32cf1e57-359d-4848-8884-6835cf971662", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
37272024-11-13T05:18:40.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 197.026993ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37282024-11-13T05:18:40.095ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 198.964569ms iteration = 23 status = {}
37292024-11-13T05:18:40.100ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
37302024-11-13T05:18:40.100ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37312024-11-13T05:18:40.101ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7569733-c4b8-45a0-ad28-c21496a791e3", "content-length": "26", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
37322024-11-13T05:18:40.101ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37332024-11-13T05:18:40.102ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
37342024-11-13T05:18:40.123ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 227.114466ms iteration = 26 status = {"physical_disks_added":0}
37352024-11-13T05:18:40.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37362024-11-13T05:18:40.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37372024-11-13T05:18:40.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37382024-11-13T05:18:40.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37392024-11-13T05:18:40.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37402024-11-13T05:18:40.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37412024-11-13T05:18:40.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37422024-11-13T05:18:40.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37432024-11-13T05:18:40.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37442024-11-13T05:18:40.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37452024-11-13T05:18:40.178ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37462024-11-13T05:18:40.178ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3f84fe7-e844-4204-b9b0-3795b44b14e6", "content-length": "691", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
37472024-11-13T05:18:40.178ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37482024-11-13T05:18:40.178ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37492024-11-13T05:18:40.178ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37502024-11-13T05:18:40.181ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 284.688168ms iteration = 22 status = {}
37512024-11-13T05:18:40.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37522024-11-13T05:18:40.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37532024-11-13T05:18:40.200ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
37542024-11-13T05:18:40.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37552024-11-13T05:18:40.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37562024-11-13T05:18:40.210ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37572024-11-13T05:18:40.210ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c6e880e-5d16-45f1-8124-2de4c71476a0", "content-length": "134", "date": "Wed, 13 Nov 2024 05:18:39 GMT"} })
37582024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37592024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
37602024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37612024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37622024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37632024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37642024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37652024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37662024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37672024-11-13T05:18:40.210ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37682024-11-13T05:18:40.211ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
37692024-11-13T05:18:40.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37702024-11-13T05:18:40.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37712024-11-13T05:18:40.213ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37722024-11-13T05:18:40.213ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d673f1e-a0db-4811-a730-9b128c0bc562", "content-length": "2", "date": "Wed, 13 Nov 2024 05:18:39 GMT"} })
37732024-11-13T05:18:40.213ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37742024-11-13T05:18:40.213ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fd4c09d-e3ad-4305-913f-6c6b9b5345a5", "content-length": "52", "date": "Wed, 13 Nov 2024 05:18:39 GMT"} })
37752024-11-13T05:18:40.213ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
37762024-11-13T05:18:40.213ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37772024-11-13T05:18:40.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a1a78bed-bae6-42b0-9e67-b2587a7125db", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
37782024-11-13T05:18:40.316ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
37792024-11-13T05:18:40.316ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37802024-11-13T05:18:40.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "084b2aa9-1697-485e-bc96-272c2edb1602", "content-length": "682", "date": "Wed, 13 Nov 2024 05:18:40 GMT"} })
37812024-11-13T05:18:40.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37822024-11-13T05:18:40.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37832024-11-13T05:18:40.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37842024-11-13T05:18:40.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37852024-11-13T05:18:40.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37862024-11-13T05:18:40.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37872024-11-13T05:18:40.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37882024-11-13T05:18:40.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37892024-11-13T05:18:40.333ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 436.508475ms iteration = 22 status = {}
37902024-11-13T05:18:40.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1294 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 1bb4d08f-5dba-4bcf-b0d2-7c0d3224e3aa response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
37912024-11-13T05:18:40.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eb634411-4bf8-446f-86d9-416c4cb7b0a1 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
37922024-11-13T05:18:40.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eb634411-4bf8-446f-86d9-416c4cb7b0a1 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
37932024-11-13T05:18:40.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eb634411-4bf8-446f-86d9-416c4cb7b0a1 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
37942024-11-13T05:18:41.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e150ca21-88ab-4668-86d2-79347f7bd148 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
37952024-11-13T05:18:41.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e150ca21-88ab-4668-86d2-79347f7bd148 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
37962024-11-13T05:18:41.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e150ca21-88ab-4668-86d2-79347f7bd148 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
37972024-11-13T05:18:42.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bee134bf-47d6-49df-a3fc-553c06b8bf62 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
37982024-11-13T05:18:42.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bee134bf-47d6-49df-a3fc-553c06b8bf62 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
37992024-11-13T05:18:42.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bee134bf-47d6-49df-a3fc-553c06b8bf62 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38002024-11-13T05:18:43.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ae281df7-fd60-432f-89c2-42ba58f72ce1 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38012024-11-13T05:18:43.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ae281df7-fd60-432f-89c2-42ba58f72ce1 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38022024-11-13T05:18:43.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ae281df7-fd60-432f-89c2-42ba58f72ce1 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38032024-11-13T05:18:44.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d35870fd-f735-4df0-b03f-714d64db0437 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38042024-11-13T05:18:44.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d35870fd-f735-4df0-b03f-714d64db0437 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38052024-11-13T05:18:44.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d35870fd-f735-4df0-b03f-714d64db0437 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38062024-11-13T05:18:45.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 40a682f0-c59f-4887-9257-678c6323ee2f roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
38072024-11-13T05:18:45.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 40a682f0-c59f-4887-9257-678c6323ee2f resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
38082024-11-13T05:18:45.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 40a682f0-c59f-4887-9257-678c6323ee2f response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
38092024-11-13T05:18:45.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 8a5beb90-5301-43fa-8a8d-c7376a03bc1f roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
38102024-11-13T05:18:45.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 8a5beb90-5301-43fa-8a8d-c7376a03bc1f resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
38112024-11-13T05:18:45.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 8a5beb90-5301-43fa-8a8d-c7376a03bc1f response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
38122024-11-13T05:18:45.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9b0e4141-0606-456d-a6b9-c4d5afbcb20e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38132024-11-13T05:18:45.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9b0e4141-0606-456d-a6b9-c4d5afbcb20e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38142024-11-13T05:18:45.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9b0e4141-0606-456d-a6b9-c4d5afbcb20e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38152024-11-13T05:18:46.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b3343fc5-5ef5-4803-8c2a-0b4a06132bbb roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38162024-11-13T05:18:46.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b3343fc5-5ef5-4803-8c2a-0b4a06132bbb resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38172024-11-13T05:18:46.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b3343fc5-5ef5-4803-8c2a-0b4a06132bbb response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38182024-11-13T05:18:47.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f3482814-6353-4a73-a6d8-d553d461bb7e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38192024-11-13T05:18:47.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f3482814-6353-4a73-a6d8-d553d461bb7e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38202024-11-13T05:18:47.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f3482814-6353-4a73-a6d8-d553d461bb7e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38212024-11-13T05:18:48.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 43a7f4ef-5c62-4734-8f6a-d88367e23436 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38222024-11-13T05:18:48.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 43a7f4ef-5c62-4734-8f6a-d88367e23436 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38232024-11-13T05:18:48.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 43a7f4ef-5c62-4734-8f6a-d88367e23436 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38242024-11-13T05:18:49.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
38252024-11-13T05:18:49.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
38262024-11-13T05:18:49.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38272024-11-13T05:18:49.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38282024-11-13T05:18:49.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38292024-11-13T05:18:49.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38302024-11-13T05:18:49.924ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38312024-11-13T05:18:49.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38322024-11-13T05:18:49.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38332024-11-13T05:18:49.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.927552ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38342024-11-13T05:18:49.929ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38352024-11-13T05:18:49.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38362024-11-13T05:18:49.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38372024-11-13T05:18:49.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38382024-11-13T05:18:49.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38392024-11-13T05:18:49.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38402024-11-13T05:18:49.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
38412024-11-13T05:18:49.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38422024-11-13T05:18:49.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38432024-11-13T05:18:49.946ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
38442024-11-13T05:18:49.946ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.715584ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
38452024-11-13T05:18:50.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a11eca5b-40ea-44c4-baa5-3107b37dc049 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38462024-11-13T05:18:50.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a11eca5b-40ea-44c4-baa5-3107b37dc049 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38472024-11-13T05:18:50.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a11eca5b-40ea-44c4-baa5-3107b37dc049 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38482024-11-13T05:18:51.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d19f7ac-52b8-4de3-ae0d-02d5b2c75182 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38492024-11-13T05:18:51.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d19f7ac-52b8-4de3-ae0d-02d5b2c75182 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38502024-11-13T05:18:51.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d19f7ac-52b8-4de3-ae0d-02d5b2c75182 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38512024-11-13T05:18:52.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 83ba014c-7000-47dd-b20c-e104cc2705ee roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38522024-11-13T05:18:52.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 83ba014c-7000-47dd-b20c-e104cc2705ee resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38532024-11-13T05:18:52.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 83ba014c-7000-47dd-b20c-e104cc2705ee response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38542024-11-13T05:18:53.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0c33a40c-5346-4a24-97e1-ace3f0f8e914 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38552024-11-13T05:18:53.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0c33a40c-5346-4a24-97e1-ace3f0f8e914 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38562024-11-13T05:18:53.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0c33a40c-5346-4a24-97e1-ace3f0f8e914 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38572024-11-13T05:18:54.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 86f4f15c-d350-442e-ab3b-295f2a90f431 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38582024-11-13T05:18:54.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 86f4f15c-d350-442e-ab3b-295f2a90f431 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38592024-11-13T05:18:54.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 86f4f15c-d350-442e-ab3b-295f2a90f431 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38602024-11-13T05:18:55.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bbba5d61-3c0d-4623-b4f4-f763dbf25770 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38612024-11-13T05:18:55.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bbba5d61-3c0d-4623-b4f4-f763dbf25770 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38622024-11-13T05:18:55.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bbba5d61-3c0d-4623-b4f4-f763dbf25770 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38632024-11-13T05:18:55.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1632 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 53d41fd0-53f0-4013-afbc-1152f6b67cf5 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
38642024-11-13T05:18:55.778ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
38652024-11-13T05:18:55.778ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
38662024-11-13T05:18:55.808ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
38672024-11-13T05:18:55.808ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:59162
38682024-11-13T05:18:55.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59162 req_id = 524cd2a8-dd44-441d-b616-4a12315ba90b roles = RoleSet { roles: {} } uri = /metrics/producers
38692024-11-13T05:18:55.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59162 req_id = 524cd2a8-dd44-441d-b616-4a12315ba90b resource = Database result = Ok(()) uri = /metrics/producers
38702024-11-13T05:18:55.850ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
38712024-11-13T05:18:55.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42321 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59162 req_id = 524cd2a8-dd44-441d-b616-4a12315ba90b response_code = 201 uri = /metrics/producers
38722024-11-13T05:18:55.850ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "524cd2a8-dd44-441d-b616-4a12315ba90b", "content-length": "41", "date": "Wed, 13 Nov 2024 05:18:55 GMT"} })
38732024-11-13T05:18:55.852ZDEBGnexus (producer-registration-task): registered with nexus successfully
38742024-11-13T05:18:55.852ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
38752024-11-13T05:18:56.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 03180f7e-3ffa-42ca-932a-98ca6ea7fdf4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38762024-11-13T05:18:56.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 03180f7e-3ffa-42ca-932a-98ca6ea7fdf4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38772024-11-13T05:18:56.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 03180f7e-3ffa-42ca-932a-98ca6ea7fdf4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38782024-11-13T05:18:57.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 721c35ec-1c5d-4290-a7e3-9768c5536482 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38792024-11-13T05:18:57.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 721c35ec-1c5d-4290-a7e3-9768c5536482 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38802024-11-13T05:18:57.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 721c35ec-1c5d-4290-a7e3-9768c5536482 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38812024-11-13T05:18:58.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bee4dbf7-c1f7-4107-a0f1-39fcacd27b8f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38822024-11-13T05:18:58.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bee4dbf7-c1f7-4107-a0f1-39fcacd27b8f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38832024-11-13T05:18:58.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bee4dbf7-c1f7-4107-a0f1-39fcacd27b8f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38842024-11-13T05:18:59.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1e5d2fef-9d35-4da7-8d5f-1568a33e1238 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38852024-11-13T05:18:59.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1e5d2fef-9d35-4da7-8d5f-1568a33e1238 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38862024-11-13T05:18:59.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1e5d2fef-9d35-4da7-8d5f-1568a33e1238 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
38872024-11-13T05:18:59.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
38882024-11-13T05:18:59.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
38892024-11-13T05:18:59.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38902024-11-13T05:18:59.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38912024-11-13T05:18:59.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38922024-11-13T05:18:59.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38932024-11-13T05:18:59.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38942024-11-13T05:18:59.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38952024-11-13T05:18:59.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38962024-11-13T05:18:59.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38972024-11-13T05:18:59.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38982024-11-13T05:18:59.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38992024-11-13T05:18:59.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39002024-11-13T05:18:59.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39012024-11-13T05:18:59.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39022024-11-13T05:18:59.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
39032024-11-13T05:18:59.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39042024-11-13T05:18:59.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39052024-11-13T05:18:59.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
39062024-11-13T05:18:59.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.174322ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
39072024-11-13T05:18:59.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.88106ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39082024-11-13T05:19:00.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e756be11-f4b6-4529-aa6f-8beded875838 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39092024-11-13T05:19:00.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e756be11-f4b6-4529-aa6f-8beded875838 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39102024-11-13T05:19:00.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e756be11-f4b6-4529-aa6f-8beded875838 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39112024-11-13T05:19:01.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fa6f9eb3-2a9c-4a78-a526-4bde80841585 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39122024-11-13T05:19:01.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fa6f9eb3-2a9c-4a78-a526-4bde80841585 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39132024-11-13T05:19:01.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fa6f9eb3-2a9c-4a78-a526-4bde80841585 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39142024-11-13T05:19:02.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 672889ea-0dc2-45b9-9d91-7d92889f8c2e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39152024-11-13T05:19:02.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 672889ea-0dc2-45b9-9d91-7d92889f8c2e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39162024-11-13T05:19:02.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 672889ea-0dc2-45b9-9d91-7d92889f8c2e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39172024-11-13T05:19:03.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3756b241-9fd0-417b-970e-a024fe666fec roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39182024-11-13T05:19:03.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3756b241-9fd0-417b-970e-a024fe666fec resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39192024-11-13T05:19:03.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3756b241-9fd0-417b-970e-a024fe666fec response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39202024-11-13T05:19:04.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7ccf1e92-4ce7-48fb-accb-66b348fa0560 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39212024-11-13T05:19:04.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7ccf1e92-4ce7-48fb-accb-66b348fa0560 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39222024-11-13T05:19:04.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7ccf1e92-4ce7-48fb-accb-66b348fa0560 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39232024-11-13T05:19:05.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9ff2ced5-27b9-489b-a51f-997288d72f43 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39242024-11-13T05:19:05.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9ff2ced5-27b9-489b-a51f-997288d72f43 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39252024-11-13T05:19:05.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9ff2ced5-27b9-489b-a51f-997288d72f43 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39262024-11-13T05:19:06.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7116b78-a78c-4839-886b-d2a518497b7a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39272024-11-13T05:19:06.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7116b78-a78c-4839-886b-d2a518497b7a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39282024-11-13T05:19:06.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7116b78-a78c-4839-886b-d2a518497b7a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39292024-11-13T05:19:07.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f5d7ca16-0883-4e8d-a089-1be8e7a46415 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39302024-11-13T05:19:07.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f5d7ca16-0883-4e8d-a089-1be8e7a46415 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39312024-11-13T05:19:07.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f5d7ca16-0883-4e8d-a089-1be8e7a46415 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39322024-11-13T05:19:08.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f2f4dd16-8798-4368-86fe-aa8ac0bb712e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39332024-11-13T05:19:08.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f2f4dd16-8798-4368-86fe-aa8ac0bb712e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39342024-11-13T05:19:08.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f2f4dd16-8798-4368-86fe-aa8ac0bb712e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39352024-11-13T05:19:09.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2f875d75-4913-4b4b-af8f-1360c2607492 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39362024-11-13T05:19:09.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2f875d75-4913-4b4b-af8f-1360c2607492 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39372024-11-13T05:19:09.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2f875d75-4913-4b4b-af8f-1360c2607492 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
39382024-11-13T05:19:09.895ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
39392024-11-13T05:19:09.895ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39402024-11-13T05:19:09.895ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39412024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39422024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
39432024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39442024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
39452024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39462024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39472024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
39482024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
39492024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
39502024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39512024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
39522024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
39532024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39542024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39552024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
39562024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39572024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39582024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
39592024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39602024-11-13T05:19:09.896ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
39612024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39622024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39632024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
39642024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
39652024-11-13T05:19:09.897ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39662024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
39672024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39682024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39692024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
39702024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39712024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39722024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
39732024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39742024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
39752024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39762024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
39772024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
39782024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39792024-11-13T05:19:09.897ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
39802024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39812024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
39822024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
39832024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
39842024-11-13T05:19:09.897ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71
39852024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.83\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71"}
39862024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
39872024-11-13T05:19:09.897ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-13 05:09:09.897178581 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39882024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
39892024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39902024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39912024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
39922024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39932024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39942024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
39952024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39962024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
39972024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39982024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
39992024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
40002024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40012024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
40022024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40032024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40042024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40052024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40062024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40072024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40082024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40092024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40102024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40112024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40122024-11-13T05:19:09.897ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("038e4c2b-2408-42f1-b025-c88f1167faaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5531, tv_nsec: 406522902 } })
40132024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40142024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40152024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40162024-11-13T05:19:09.897ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("105858cb-d3d5-4677-95c0-079ffa1259be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b62b18b5-c7f6-48f0-ab56-4213f6de7d44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5531, tv_nsec: 406594013 } })
40172024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40182024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40192024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40202024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40212024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40222024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40232024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40242024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40252024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40262024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40272024-11-13T05:19:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40282024-11-13T05:19:09.898ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
40292024-11-13T05:19:09.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.278881ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
40302024-11-13T05:19:09.898ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
40312024-11-13T05:19:09.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.13032ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
40322024-11-13T05:19:09.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 1.730325ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
40332024-11-13T05:19:09.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40342024-11-13T05:19:09.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40352024-11-13T05:19:09.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362024-11-13T05:19:09.901ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.315987ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40372024-11-13T05:19:09.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40382024-11-13T05:19:09.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40392024-11-13T05:19:09.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40402024-11-13T05:19:09.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40412024-11-13T05:19:09.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40422024-11-13T05:19:09.903ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40432024-11-13T05:19:09.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40442024-11-13T05:19:09.904ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40452024-11-13T05:19:09.904ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40462024-11-13T05:19:09.904ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40472024-11-13T05:19:09.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40482024-11-13T05:19:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40492024-11-13T05:19:09.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40502024-11-13T05:19:09.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40512024-11-13T05:19:09.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5531, tv_nsec: 415303569 } })
40522024-11-13T05:19:09.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
40532024-11-13T05:19:09.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40542024-11-13T05:19:09.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40552024-11-13T05:19:09.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40562024-11-13T05:19:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40572024-11-13T05:19:09.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40582024-11-13T05:19:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40592024-11-13T05:19:09.909ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.519379ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
40602024-11-13T05:19:09.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40612024-11-13T05:19:09.910ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40622024-11-13T05:19:09.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40632024-11-13T05:19:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40642024-11-13T05:19:09.912ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40652024-11-13T05:19:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40662024-11-13T05:19:09.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40672024-11-13T05:19:09.913ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40682024-11-13T05:19:09.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40692024-11-13T05:19:09.914ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40702024-11-13T05:19:09.914ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40712024-11-13T05:19:09.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40722024-11-13T05:19:09.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40732024-11-13T05:19:09.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40742024-11-13T05:19:09.916ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5531, tv_nsec: 425509898 } })
40752024-11-13T05:19:09.916ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
40762024-11-13T05:19:09.917ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-13 05:09:09.897178581 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40772024-11-13T05:19:09.917ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.961115ms iteration = 12 status = {"expiration":"2024-11-13T05:09:09.897178581Z","pruned":[]}
40782024-11-13T05:19:09.918ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40792024-11-13T05:19:09.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40802024-11-13T05:19:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40812024-11-13T05:19:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40822024-11-13T05:19:09.918ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5531, tv_nsec: 427806528 } })
40832024-11-13T05:19:09.919ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
40842024-11-13T05:19:09.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40852024-11-13T05:19:09.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40862024-11-13T05:19:09.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40872024-11-13T05:19:09.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40882024-11-13T05:19:09.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40892024-11-13T05:19:09.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40902024-11-13T05:19:09.922ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40912024-11-13T05:19:09.924ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40922024-11-13T05:19:09.924ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 26.995766ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40932024-11-13T05:19:09.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40942024-11-13T05:19:09.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40952024-11-13T05:19:09.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40962024-11-13T05:19:09.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40972024-11-13T05:19:09.926ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40982024-11-13T05:19:09.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40992024-11-13T05:19:09.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
41002024-11-13T05:19:09.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41012024-11-13T05:19:09.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41022024-11-13T05:19:09.935ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41032024-11-13T05:19:09.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41042024-11-13T05:19:09.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41052024-11-13T05:19:09.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41062024-11-13T05:19:09.940ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41072024-11-13T05:19:09.940ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
41082024-11-13T05:19:09.940ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
41092024-11-13T05:19:09.940ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 43.52785ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
41102024-11-13T05:19:09.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41112024-11-13T05:19:09.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41122024-11-13T05:19:09.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41132024-11-13T05:19:09.942ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41142024-11-13T05:19:09.942ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41152024-11-13T05:19:09.942ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41162024-11-13T05:19:09.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41172024-11-13T05:19:09.947ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
41182024-11-13T05:19:09.947ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.688924ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
41192024-11-13T05:19:09.948ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41202024-11-13T05:19:09.949ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41212024-11-13T05:19:09.949ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41222024-11-13T05:19:09.949ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41232024-11-13T05:19:09.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41242024-11-13T05:19:09.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41252024-11-13T05:19:09.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.638108ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41262024-11-13T05:19:09.951ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41272024-11-13T05:19:09.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41282024-11-13T05:19:09.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41292024-11-13T05:19:09.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41302024-11-13T05:19:09.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.446805ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
41312024-11-13T05:19:09.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41322024-11-13T05:19:09.960ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41332024-11-13T05:19:09.960ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41342024-11-13T05:19:09.960ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 63.844829ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41352024-11-13T05:19:09.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41362024-11-13T05:19:09.965ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41372024-11-13T05:19:09.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41382024-11-13T05:19:09.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
41392024-11-13T05:19:09.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41402024-11-13T05:19:09.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41412024-11-13T05:19:09.966ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41422024-11-13T05:19:09.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41432024-11-13T05:19:09.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41442024-11-13T05:19:09.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41452024-11-13T05:19:09.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41462024-11-13T05:19:09.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41472024-11-13T05:19:09.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41482024-11-13T05:19:09.969ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.115641ms iteration = 23 status = 0
41492024-11-13T05:19:09.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.0566ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41502024-11-13T05:19:09.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41512024-11-13T05:19:09.971ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41522024-11-13T05:19:09.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41532024-11-13T05:19:09.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41542024-11-13T05:19:09.976ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41552024-11-13T05:19:09.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41562024-11-13T05:19:09.978ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41572024-11-13T05:19:09.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41582024-11-13T05:19:09.980ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41592024-11-13T05:19:09.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41602024-11-13T05:19:09.983ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41612024-11-13T05:19:09.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41622024-11-13T05:19:09.986ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41632024-11-13T05:19:09.986ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41642024-11-13T05:19:09.986ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.182209ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41652024-11-13T05:19:09.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.205865ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41662024-11-13T05:19:09.999ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41672024-11-13T05:19:09.999ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41682024-11-13T05:19:09.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41692024-11-13T05:19:09.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41702024-11-13T05:19:10.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41712024-11-13T05:19:10.001ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 104.542194ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41722024-11-13T05:19:10.002ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41732024-11-13T05:19:10.003ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41742024-11-13T05:19:10.003ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41752024-11-13T05:19:10.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41762024-11-13T05:19:10.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41772024-11-13T05:19:10.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41782024-11-13T05:19:10.003ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41792024-11-13T05:19:10.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41802024-11-13T05:19:10.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41812024-11-13T05:19:10.006ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41822024-11-13T05:19:10.006ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41832024-11-13T05:19:10.006ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-13 05:08:54.008257 UTC dns_group = internal generation = 1
41842024-11-13T05:19:10.006ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 110.493966ms iteration = 13 status = {"generation":1}
41852024-11-13T05:19:10.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41862024-11-13T05:19:10.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41872024-11-13T05:19:10.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41882024-11-13T05:19:10.018ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-13T05:08:08.157062Z, time_modified: 2024-11-13T05:08:08.157062Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }) }
41892024-11-13T05:19:10.018ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 121.444492ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]}},"default_endpoint":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41902024-11-13T05:19:10.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41912024-11-13T05:19:10.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41922024-11-13T05:19:10.036ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41932024-11-13T05:19:10.036ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 0 version = 2
41942024-11-13T05:19:10.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41952024-11-13T05:19:10.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41962024-11-13T05:19:10.037ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.987013ms iteration = 27 status = {"physical_disks_added":0}
41972024-11-13T05:19:10.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41982024-11-13T05:19:10.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41992024-11-13T05:19:10.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42002024-11-13T05:19:10.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42012024-11-13T05:19:10.048ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
42022024-11-13T05:19:10.048ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42032024-11-13T05:19:10.048ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6824bb6-8a35-45ae-ae29-e05223178197", "content-length": "26", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
42042024-11-13T05:19:10.048ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42052024-11-13T05:19:10.050ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42062024-11-13T05:19:10.058ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42072024-11-13T05:19:10.075ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
42082024-11-13T05:19:10.076ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 178.927524ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42092024-11-13T05:19:10.079ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
42102024-11-13T05:19:10.079ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42112024-11-13T05:19:10.079ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71564e94-3650-4748-9d72-71f7ebee89c2", "content-length": "26", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
42122024-11-13T05:19:10.079ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42132024-11-13T05:19:10.081ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42142024-11-13T05:19:10.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42152024-11-13T05:19:10.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42162024-11-13T05:19:10.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42172024-11-13T05:19:10.187ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42182024-11-13T05:19:10.187ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42192024-11-13T05:19:10.188ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "672fb1ff-7da8-42ca-ab45-c80f5d5e1b94", "content-length": "372", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
42202024-11-13T05:19:10.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42212024-11-13T05:19:10.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42222024-11-13T05:19:10.189ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 1 version = 2
42232024-11-13T05:19:10.189ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42242024-11-13T05:19:10.189ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-13 05:08:54.834359 UTC dns_group = external generation = 2
42252024-11-13T05:19:10.189ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 292.635608ms iteration = 13 status = {"generation":2}
42262024-11-13T05:19:10.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42272024-11-13T05:19:10.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42282024-11-13T05:19:10.192ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42292024-11-13T05:19:10.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42302024-11-13T05:19:10.201ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
42312024-11-13T05:19:10.201ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42322024-11-13T05:19:10.202ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dae8973a-eaaa-4157-8186-e5545ea97368", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
42332024-11-13T05:19:10.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42342024-11-13T05:19:10.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42352024-11-13T05:19:10.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42362024-11-13T05:19:10.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42372024-11-13T05:19:10.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42382024-11-13T05:19:10.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42392024-11-13T05:19:10.210ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42402024-11-13T05:19:10.210ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42412024-11-13T05:19:10.211ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7c49483d-842c-4bbf-b28b-bcb99cc745ee", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
42422024-11-13T05:19:10.213ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 316.142883ms iteration = 24 status = {}
42432024-11-13T05:19:10.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42442024-11-13T05:19:10.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42452024-11-13T05:19:10.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42462024-11-13T05:19:10.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42472024-11-13T05:19:10.230ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42482024-11-13T05:19:10.251ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
42492024-11-13T05:19:10.251ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42502024-11-13T05:19:10.251ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad10b894-5d21-4185-b4de-f97637770210", "content-length": "26", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
42512024-11-13T05:19:10.251ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42522024-11-13T05:19:10.253ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
42532024-11-13T05:19:10.327ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 430.015868ms iteration = 23 status = {}
42542024-11-13T05:19:10.351ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42552024-11-13T05:19:10.351ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "19ec3303-d6a3-4c5a-9eca-0b4a92c6891c", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42562024-11-13T05:19:10.351ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42572024-11-13T05:19:10.353ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "48628c7e-2879-4f95-98a9-9b4540fb0c4b", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42582024-11-13T05:19:10.353ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42592024-11-13T05:19:10.354ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42602024-11-13T05:19:10.354ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 457.62797ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42612024-11-13T05:19:10.356ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42622024-11-13T05:19:10.356ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9585d963-366c-45dc-8f38-01393dcded04", "content-length": "1", "date": "Wed, 13 Nov 2024 05:19:09 GMT"} })
42632024-11-13T05:19:10.358ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42642024-11-13T05:19:10.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42652024-11-13T05:19:10.360ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.819515ms iteration = 23 status = null
42662024-11-13T05:19:10.365ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42672024-11-13T05:19:10.365ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "306b84b4-f73f-4f9e-bd88-aed8fd7dc65c", "content-length": "691", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
42682024-11-13T05:19:10.365ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42692024-11-13T05:19:10.365ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42702024-11-13T05:19:10.365ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42712024-11-13T05:19:10.366ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42722024-11-13T05:19:10.366ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1eb16b60-9702-4406-8423-4d6073cfe857", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42732024-11-13T05:19:10.366ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42742024-11-13T05:19:10.367ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.868865ms iteration = 23 status = {}
42752024-11-13T05:19:10.368ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6ce677a5-3b8a-49f6-ab74-62829e6cbba5", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42762024-11-13T05:19:10.368ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42772024-11-13T05:19:10.370ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "040fbd25-7e56-4a24-857a-48bcca6f1e2e", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42782024-11-13T05:19:10.370ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42792024-11-13T05:19:10.372ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
42802024-11-13T05:19:10.372ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 476.112052ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42812024-11-13T05:19:10.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42822024-11-13T05:19:10.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42832024-11-13T05:19:10.432ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
42842024-11-13T05:19:10.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42852024-11-13T05:19:10.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42862024-11-13T05:19:10.442ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42872024-11-13T05:19:10.442ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e34d9d3-af0b-4f60-85ef-22da5fbaf354", "content-length": "134", "date": "Wed, 13 Nov 2024 05:19:09 GMT"} })
42882024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42892024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
42902024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42912024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42922024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42932024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42942024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42952024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42962024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42972024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42982024-11-13T05:19:10.442ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
42992024-11-13T05:19:10.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43002024-11-13T05:19:10.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43012024-11-13T05:19:10.445ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
43022024-11-13T05:19:10.445ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b702cf43-5d74-4422-a344-94c888c9745c", "content-length": "2", "date": "Wed, 13 Nov 2024 05:19:09 GMT"} })
43032024-11-13T05:19:10.445ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
43042024-11-13T05:19:10.445ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a107efd-98d6-47df-ad47-5319f7578931", "content-length": "52", "date": "Wed, 13 Nov 2024 05:19:09 GMT"} })
43052024-11-13T05:19:10.445ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
43062024-11-13T05:19:10.445ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43072024-11-13T05:19:10.539ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "30380248-9697-4a58-bf68-519243dcd0dc", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
43082024-11-13T05:19:10.539ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
43092024-11-13T05:19:10.539ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43102024-11-13T05:19:10.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ba3e44a7-5889-4763-846b-98d15013cb5a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43112024-11-13T05:19:10.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ba3e44a7-5889-4763-846b-98d15013cb5a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43122024-11-13T05:19:10.540ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "597313b6-1f98-4fac-8a8b-dd2a8f4c3aa2", "content-length": "682", "date": "Wed, 13 Nov 2024 05:19:10 GMT"} })
43132024-11-13T05:19:10.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43142024-11-13T05:19:10.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43152024-11-13T05:19:10.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ba3e44a7-5889-4763-846b-98d15013cb5a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43162024-11-13T05:19:10.544ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43172024-11-13T05:19:10.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43182024-11-13T05:19:10.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43192024-11-13T05:19:10.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43202024-11-13T05:19:10.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43212024-11-13T05:19:10.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43222024-11-13T05:19:10.560ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.845922ms iteration = 23 status = {}
43232024-11-13T05:19:10.580ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1204 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = f3e1e8f9-6460-43b9-bece-5e08b6b1a5ba response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
43242024-11-13T05:19:11.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a082898-cf44-4b2c-bc3f-3894546056a6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43252024-11-13T05:19:11.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a082898-cf44-4b2c-bc3f-3894546056a6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43262024-11-13T05:19:11.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4a082898-cf44-4b2c-bc3f-3894546056a6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43272024-11-13T05:19:12.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 375fa59f-9106-4074-82c7-87bc45575e29 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43282024-11-13T05:19:12.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 375fa59f-9106-4074-82c7-87bc45575e29 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43292024-11-13T05:19:12.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 375fa59f-9106-4074-82c7-87bc45575e29 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43302024-11-13T05:19:13.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9e1da8e4-7d8b-4446-acee-28472d126bad roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43312024-11-13T05:19:13.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9e1da8e4-7d8b-4446-acee-28472d126bad resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43322024-11-13T05:19:13.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9e1da8e4-7d8b-4446-acee-28472d126bad response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43332024-11-13T05:19:14.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9496a7e3-46e8-460f-97a5-cadd964b058a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43342024-11-13T05:19:14.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9496a7e3-46e8-460f-97a5-cadd964b058a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43352024-11-13T05:19:14.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9496a7e3-46e8-460f-97a5-cadd964b058a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43362024-11-13T05:19:15.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 00de830b-3325-475c-a254-b6df858ad00d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43372024-11-13T05:19:15.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 00de830b-3325-475c-a254-b6df858ad00d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43382024-11-13T05:19:15.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 00de830b-3325-475c-a254-b6df858ad00d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43392024-11-13T05:19:16.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 790fcfae-87b8-4d83-8d40-5cf59e19f049 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43402024-11-13T05:19:16.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 790fcfae-87b8-4d83-8d40-5cf59e19f049 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43412024-11-13T05:19:16.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 790fcfae-87b8-4d83-8d40-5cf59e19f049 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43422024-11-13T05:19:17.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 903c6e7b-74c6-4339-b4d9-0f04ea122e9b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43432024-11-13T05:19:17.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 903c6e7b-74c6-4339-b4d9-0f04ea122e9b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43442024-11-13T05:19:17.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 903c6e7b-74c6-4339-b4d9-0f04ea122e9b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43452024-11-13T05:19:18.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ff39b724-aa0e-4410-b46e-7205e081eaf3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43462024-11-13T05:19:18.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ff39b724-aa0e-4410-b46e-7205e081eaf3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43472024-11-13T05:19:18.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2013 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ff39b724-aa0e-4410-b46e-7205e081eaf3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43482024-11-13T05:19:19.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0f89c2f1-e162-4375-8e51-162d34246968 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43492024-11-13T05:19:19.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0f89c2f1-e162-4375-8e51-162d34246968 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43502024-11-13T05:19:19.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0f89c2f1-e162-4375-8e51-162d34246968 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43512024-11-13T05:19:19.896ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
43522024-11-13T05:19:19.896ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
43532024-11-13T05:19:19.896ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43542024-11-13T05:19:19.896ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43552024-11-13T05:19:19.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43562024-11-13T05:19:19.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43572024-11-13T05:19:19.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43582024-11-13T05:19:19.901ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43592024-11-13T05:19:19.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43602024-11-13T05:19:19.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43612024-11-13T05:19:19.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43622024-11-13T05:19:19.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43632024-11-13T05:19:19.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642024-11-13T05:19:19.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
43652024-11-13T05:19:19.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43662024-11-13T05:19:19.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43672024-11-13T05:19:19.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
43682024-11-13T05:19:19.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.100012ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
43692024-11-13T05:19:19.925ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43702024-11-13T05:19:19.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43712024-11-13T05:19:19.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.539904ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43722024-11-13T05:19:20.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6935d19-6b23-4d29-8b9b-c552dbd4e37c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43732024-11-13T05:19:20.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6935d19-6b23-4d29-8b9b-c552dbd4e37c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43742024-11-13T05:19:20.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6935d19-6b23-4d29-8b9b-c552dbd4e37c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43752024-11-13T05:19:21.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4c615e2-2c6d-46ec-bf2c-df8a8b3dc9dd roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43762024-11-13T05:19:21.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4c615e2-2c6d-46ec-bf2c-df8a8b3dc9dd resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43772024-11-13T05:19:21.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4c615e2-2c6d-46ec-bf2c-df8a8b3dc9dd response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43782024-11-13T05:19:22.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 24ab7aea-acdc-46a3-b1ea-f68a8f2731ac roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43792024-11-13T05:19:22.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 24ab7aea-acdc-46a3-b1ea-f68a8f2731ac resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43802024-11-13T05:19:22.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 24ab7aea-acdc-46a3-b1ea-f68a8f2731ac response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43812024-11-13T05:19:23.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51d3f450-d476-4466-bee9-76c655085fc0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43822024-11-13T05:19:23.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51d3f450-d476-4466-bee9-76c655085fc0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43832024-11-13T05:19:23.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51d3f450-d476-4466-bee9-76c655085fc0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43842024-11-13T05:19:24.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e77b5164-0af7-49da-946e-dbc68652454d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43852024-11-13T05:19:24.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e77b5164-0af7-49da-946e-dbc68652454d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43862024-11-13T05:19:24.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e77b5164-0af7-49da-946e-dbc68652454d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43872024-11-13T05:19:25.579ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1343 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 942c4d8e-8f41-4e20-9e07-2c067673b8d3 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
43882024-11-13T05:19:25.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 370d6b78-414f-414d-b96b-ab3815cf687b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43892024-11-13T05:19:25.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 370d6b78-414f-414d-b96b-ab3815cf687b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43902024-11-13T05:19:25.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 370d6b78-414f-414d-b96b-ab3815cf687b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43912024-11-13T05:19:26.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a31aadb9-2a4e-4b58-996b-afc1e72528bf roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43922024-11-13T05:19:26.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a31aadb9-2a4e-4b58-996b-afc1e72528bf resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43932024-11-13T05:19:26.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a31aadb9-2a4e-4b58-996b-afc1e72528bf response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43942024-11-13T05:19:27.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4869927b-528a-4fcd-b367-f282d909ff42 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43952024-11-13T05:19:27.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4869927b-528a-4fcd-b367-f282d909ff42 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43962024-11-13T05:19:27.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4869927b-528a-4fcd-b367-f282d909ff42 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43972024-11-13T05:19:28.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 44fd4559-5afa-4025-8c3c-5add0d7dd702 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43982024-11-13T05:19:28.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 44fd4559-5afa-4025-8c3c-5add0d7dd702 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
43992024-11-13T05:19:28.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 44fd4559-5afa-4025-8c3c-5add0d7dd702 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44002024-11-13T05:19:29.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
44012024-11-13T05:19:29.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
44022024-11-13T05:19:29.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44032024-11-13T05:19:29.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44042024-11-13T05:19:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44052024-11-13T05:19:29.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44062024-11-13T05:19:29.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44072024-11-13T05:19:29.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44082024-11-13T05:19:29.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44092024-11-13T05:19:29.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44102024-11-13T05:19:29.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44112024-11-13T05:19:29.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44122024-11-13T05:19:29.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44132024-11-13T05:19:29.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44142024-11-13T05:19:29.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44152024-11-13T05:19:29.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
44162024-11-13T05:19:29.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44172024-11-13T05:19:29.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44182024-11-13T05:19:29.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
44192024-11-13T05:19:29.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.405037ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
44202024-11-13T05:19:29.928ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.839719ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44212024-11-13T05:19:29.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5d9204d5-99c4-44f1-b997-0dfa6ce69c93 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44222024-11-13T05:19:30.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5d9204d5-99c4-44f1-b997-0dfa6ce69c93 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44232024-11-13T05:19:30.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5d9204d5-99c4-44f1-b997-0dfa6ce69c93 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44242024-11-13T05:19:30.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 6956b372-4cbb-4cf8-9b6f-fc0ad39ebba0 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
44252024-11-13T05:19:30.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 6956b372-4cbb-4cf8-9b6f-fc0ad39ebba0 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
44262024-11-13T05:19:30.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 6956b372-4cbb-4cf8-9b6f-fc0ad39ebba0 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
44272024-11-13T05:19:30.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 27a8bb9f-a127-4e6f-a822-d7772757d107 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
44282024-11-13T05:19:30.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 27a8bb9f-a127-4e6f-a822-d7772757d107 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
44292024-11-13T05:19:30.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 27a8bb9f-a127-4e6f-a822-d7772757d107 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
44302024-11-13T05:19:31.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1af6eaa3-0bc6-437f-895d-0c2c25eba303 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44312024-11-13T05:19:31.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1af6eaa3-0bc6-437f-895d-0c2c25eba303 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44322024-11-13T05:19:31.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1822 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1af6eaa3-0bc6-437f-895d-0c2c25eba303 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44332024-11-13T05:19:32.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b445306-edbb-403d-9f87-12b7e4592938 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44342024-11-13T05:19:32.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b445306-edbb-403d-9f87-12b7e4592938 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44352024-11-13T05:19:32.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b445306-edbb-403d-9f87-12b7e4592938 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44362024-11-13T05:19:33.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1b418682-2942-4d39-b020-9ae835f5bd4a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44372024-11-13T05:19:33.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1b418682-2942-4d39-b020-9ae835f5bd4a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44382024-11-13T05:19:33.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1b418682-2942-4d39-b020-9ae835f5bd4a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44392024-11-13T05:19:34.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5e7efda-f086-4e9f-9f2f-01870f17ad71 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44402024-11-13T05:19:34.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5e7efda-f086-4e9f-9f2f-01870f17ad71 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44412024-11-13T05:19:34.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5e7efda-f086-4e9f-9f2f-01870f17ad71 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44422024-11-13T05:19:35.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 329c8c21-5431-4815-8425-f3d9f254c32a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44432024-11-13T05:19:35.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 329c8c21-5431-4815-8425-f3d9f254c32a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44442024-11-13T05:19:35.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 329c8c21-5431-4815-8425-f3d9f254c32a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44452024-11-13T05:19:36.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bf60ecb8-4b4c-4164-86fb-c193717f52d6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44462024-11-13T05:19:36.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bf60ecb8-4b4c-4164-86fb-c193717f52d6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44472024-11-13T05:19:36.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1837 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bf60ecb8-4b4c-4164-86fb-c193717f52d6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44482024-11-13T05:19:37.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1aaee206-1b1d-4834-b802-9332aa638802 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44492024-11-13T05:19:37.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1aaee206-1b1d-4834-b802-9332aa638802 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44502024-11-13T05:19:37.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1aaee206-1b1d-4834-b802-9332aa638802 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44512024-11-13T05:19:38.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5d9fed7-ab01-4e8c-b608-5316e71a999b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44522024-11-13T05:19:38.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5d9fed7-ab01-4e8c-b608-5316e71a999b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44532024-11-13T05:19:38.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5d9fed7-ab01-4e8c-b608-5316e71a999b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44542024-11-13T05:19:39.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 33de70aa-dbbc-43e3-92b6-57f5f073f30e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44552024-11-13T05:19:39.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 33de70aa-dbbc-43e3-92b6-57f5f073f30e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44562024-11-13T05:19:39.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 33de70aa-dbbc-43e3-92b6-57f5f073f30e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
44572024-11-13T05:19:39.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
44582024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
44592024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44602024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44612024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
44622024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
44632024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
44642024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
44652024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44662024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44672024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
44682024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44692024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44702024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
44712024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
44722024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44732024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44742024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
44752024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44762024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44772024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
44782024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
44792024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44802024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44812024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
44822024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
44832024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44842024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
44852024-11-13T05:19:39.898ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44862024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44872024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44882024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
44892024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44902024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
44912024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44922024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44932024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44942024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44952024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44962024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44972024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44982024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44992024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45002024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45012024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45022024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45032024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45042024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45052024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45062024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45072024-11-13T05:19:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45082024-11-13T05:19:39.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45092024-11-13T05:19:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45102024-11-13T05:19:39.901ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.766833ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45112024-11-13T05:19:39.902ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45122024-11-13T05:19:39.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45132024-11-13T05:19:39.903ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5561, tv_nsec: 412442934 } })
45142024-11-13T05:19:39.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
45152024-11-13T05:19:39.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5561, tv_nsec: 413257131 } })
45162024-11-13T05:19:39.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45172024-11-13T05:19:39.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
45182024-11-13T05:19:39.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45192024-11-13T05:19:39.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45202024-11-13T05:19:39.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45212024-11-13T05:19:39.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45222024-11-13T05:19:39.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45232024-11-13T05:19:39.945ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45242024-11-13T05:19:39.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45252024-11-13T05:19:39.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.08536ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
45262024-11-13T05:19:39.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272024-11-13T05:19:39.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45282024-11-13T05:19:39.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45292024-11-13T05:19:39.952ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45302024-11-13T05:19:39.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312024-11-13T05:19:39.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322024-11-13T05:19:39.953ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.96259ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45332024-11-13T05:19:39.953ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45342024-11-13T05:19:39.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45352024-11-13T05:19:39.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45362024-11-13T05:19:39.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45372024-11-13T05:19:39.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45382024-11-13T05:19:39.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45392024-11-13T05:19:39.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45402024-11-13T05:19:39.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45412024-11-13T05:19:39.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45422024-11-13T05:19:39.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45432024-11-13T05:19:39.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45442024-11-13T05:19:39.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45452024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45462024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45472024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45482024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45492024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45502024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45512024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.324029ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
45522024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45532024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45542024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45552024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45562024-11-13T05:19:39.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45572024-11-13T05:19:39.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45582024-11-13T05:19:39.958ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45592024-11-13T05:19:39.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45602024-11-13T05:19:39.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45612024-11-13T05:19:39.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
45622024-11-13T05:19:39.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45632024-11-13T05:19:39.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45642024-11-13T05:19:39.960ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45652024-11-13T05:19:39.960ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45662024-11-13T05:19:39.960ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45672024-11-13T05:19:39.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45682024-11-13T05:19:39.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45692024-11-13T05:19:39.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 64.821886ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45702024-11-13T05:19:39.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45712024-11-13T05:19:39.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45722024-11-13T05:19:39.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45732024-11-13T05:19:39.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45742024-11-13T05:19:39.963ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45752024-11-13T05:19:39.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45762024-11-13T05:19:39.964ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 66.580522ms iteration = 24 status = 0
45772024-11-13T05:19:39.964ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5561, tv_nsec: 473460437 } })
45782024-11-13T05:19:39.965ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
45792024-11-13T05:19:39.966ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45802024-11-13T05:19:39.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45812024-11-13T05:19:39.967ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
45822024-11-13T05:19:39.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45832024-11-13T05:19:39.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45842024-11-13T05:19:39.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45852024-11-13T05:19:39.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45862024-11-13T05:19:39.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45872024-11-13T05:19:39.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45882024-11-13T05:19:39.972ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
45892024-11-13T05:19:39.972ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45902024-11-13T05:19:39.972ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea996183-6824-4b37-8e30-45781e246207", "content-length": "26", "date": "Wed, 13 Nov 2024 05:19:39 GMT"} })
45912024-11-13T05:19:39.972ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45922024-11-13T05:19:39.974ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45932024-11-13T05:19:39.980ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
45942024-11-13T05:19:39.980ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.498221ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
45952024-11-13T05:19:39.981ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
45962024-11-13T05:19:39.981ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45972024-11-13T05:19:39.981ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "45ac76ae-e797-4af2-ae3c-61ab97389862", "content-length": "26", "date": "Wed, 13 Nov 2024 05:19:39 GMT"} })
45982024-11-13T05:19:39.981ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45992024-11-13T05:19:39.983ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46002024-11-13T05:19:39.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.807235ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
46012024-11-13T05:19:39.993ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46022024-11-13T05:19:39.993ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
46032024-11-13T05:19:39.993ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46042024-11-13T05:19:39.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46052024-11-13T05:19:39.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 96.204281ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46062024-11-13T05:19:39.996ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46072024-11-13T05:19:39.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.778484ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46082024-11-13T05:19:39.998ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46092024-11-13T05:19:40.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46102024-11-13T05:19:40.000ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46112024-11-13T05:19:40.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46122024-11-13T05:19:40.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46132024-11-13T05:19:40.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46142024-11-13T05:19:40.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46152024-11-13T05:19:40.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46162024-11-13T05:19:40.023ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46172024-11-13T05:19:40.023ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46182024-11-13T05:19:40.023ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.528757ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46192024-11-13T05:19:40.033ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
46202024-11-13T05:19:40.033ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46212024-11-13T05:19:40.033ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef207189-598e-4bd9-bb1f-ac86e813668e", "content-length": "26", "date": "Wed, 13 Nov 2024 05:19:39 GMT"} })
46222024-11-13T05:19:40.033ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46232024-11-13T05:19:40.035ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
46242024-11-13T05:19:40.047ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46252024-11-13T05:19:40.048ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e33bea5d-db35-4001-ab90-1166ecf98116", "content-length": "1", "date": "Wed, 13 Nov 2024 05:19:39 GMT"} })
46262024-11-13T05:19:40.049ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46272024-11-13T05:19:40.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46282024-11-13T05:19:40.051ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 153.29285ms iteration = 24 status = null
46292024-11-13T05:19:40.072ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 174.359414ms iteration = 24 status = {}
46302024-11-13T05:19:40.088ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 190.435644ms iteration = 28 status = {"physical_disks_added":0}
46312024-11-13T05:19:40.111ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46322024-11-13T05:19:40.111ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46332024-11-13T05:19:40.111ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4cb2cb4-ff57-4716-925e-39f2287ea96d", "content-length": "372", "date": "Wed, 13 Nov 2024 05:19:40 GMT"} })
46342024-11-13T05:19:40.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46352024-11-13T05:19:40.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46362024-11-13T05:19:40.159ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46372024-11-13T05:19:40.159ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46382024-11-13T05:19:40.159ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "79b730b0-9259-4a01-afb8-40f7010e21d0", "date": "Wed, 13 Nov 2024 05:19:40 GMT"} })
46392024-11-13T05:19:40.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46402024-11-13T05:19:40.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46412024-11-13T05:19:40.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46422024-11-13T05:19:40.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46432024-11-13T05:19:40.199ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46442024-11-13T05:19:40.199ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7184bea-4bfc-4ef0-ad74-987598bb08af", "content-length": "691", "date": "Wed, 13 Nov 2024 05:19:40 GMT"} })
46452024-11-13T05:19:40.199ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46462024-11-13T05:19:40.199ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46472024-11-13T05:19:40.199ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46482024-11-13T05:19:40.201ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 303.793205ms iteration = 24 status = {}
46492024-11-13T05:19:40.202ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46502024-11-13T05:19:40.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46512024-11-13T05:19:40.206ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46522024-11-13T05:19:40.206ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46532024-11-13T05:19:40.206ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0c293196-3256-4b9d-87b5-6518c3ef7030", "date": "Wed, 13 Nov 2024 05:19:40 GMT"} })
46542024-11-13T05:19:40.208ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 310.681645ms iteration = 25 status = {}
46552024-11-13T05:19:40.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e3761f07-aa49-4e80-b94e-9c778c042e72 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
46562024-11-13T05:19:40.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e3761f07-aa49-4e80-b94e-9c778c042e72 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
46572024-11-13T05:19:40.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e3761f07-aa49-4e80-b94e-9c778c042e72 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
46582024-11-13T05:19:40.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46592024-11-13T05:19:40.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46602024-11-13T05:19:40.258ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
46612024-11-13T05:19:40.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46622024-11-13T05:19:40.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46632024-11-13T05:19:40.268ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46642024-11-13T05:19:40.268ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "79ae231e-3782-4530-8334-085934082ffb", "content-length": "134", "date": "Wed, 13 Nov 2024 05:19:39 GMT"} })
46652024-11-13T05:19:40.268ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46662024-11-13T05:19:40.268ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
46672024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46682024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46692024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46702024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46712024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46722024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46732024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46742024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46752024-11-13T05:19:40.269ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
46762024-11-13T05:19:40.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46772024-11-13T05:19:40.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46782024-11-13T05:19:40.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46792024-11-13T05:19:40.271ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "41335c4a-fd16-46ad-9afb-08b78a2f41e8", "content-length": "2", "date": "Wed, 13 Nov 2024 05:19:39 GMT"} })
46802024-11-13T05:19:40.271ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46812024-11-13T05:19:40.271ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "437ca9bb-e8c3-4b78-8673-906d670bcdf3", "content-length": "52", "date": "Wed, 13 Nov 2024 05:19:39 GMT"} })
46822024-11-13T05:19:40.271ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
46832024-11-13T05:19:40.271ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46842024-11-13T05:19:40.382ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c64b1082-077b-474c-b09e-bc3940d8aa95", "date": "Wed, 13 Nov 2024 05:19:40 GMT"} })
46852024-11-13T05:19:40.382ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
46862024-11-13T05:19:40.382ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46872024-11-13T05:19:40.382ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8964454c-576b-48ea-ba63-c14aac41b8d6", "content-length": "682", "date": "Wed, 13 Nov 2024 05:19:40 GMT"} })
46882024-11-13T05:19:40.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46892024-11-13T05:19:40.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46902024-11-13T05:19:40.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46912024-11-13T05:19:40.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46922024-11-13T05:19:40.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46932024-11-13T05:19:40.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46942024-11-13T05:19:40.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46952024-11-13T05:19:40.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46962024-11-13T05:19:40.398ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 500.858928ms iteration = 24 status = {}
46972024-11-13T05:19:40.580ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1201 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 482cfcb1-0237-4ae8-aa98-485b07fd42cc response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
46982024-11-13T05:19:41.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8caa636-2353-4838-9e38-bea0e7f6abf5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
46992024-11-13T05:19:41.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8caa636-2353-4838-9e38-bea0e7f6abf5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47002024-11-13T05:19:41.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8caa636-2353-4838-9e38-bea0e7f6abf5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47012024-11-13T05:19:42.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 039ba83d-6cca-4ab1-87b7-0209bbbe9632 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47022024-11-13T05:19:42.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 039ba83d-6cca-4ab1-87b7-0209bbbe9632 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47032024-11-13T05:19:42.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 039ba83d-6cca-4ab1-87b7-0209bbbe9632 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47042024-11-13T05:19:43.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8f427626-689a-4a12-a6f2-58f75e4ce62f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47052024-11-13T05:19:43.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8f427626-689a-4a12-a6f2-58f75e4ce62f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47062024-11-13T05:19:43.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8f427626-689a-4a12-a6f2-58f75e4ce62f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47072024-11-13T05:19:44.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 783aca78-ff64-4dd9-b78c-b02af28ab1b8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47082024-11-13T05:19:44.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 783aca78-ff64-4dd9-b78c-b02af28ab1b8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47092024-11-13T05:19:44.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 783aca78-ff64-4dd9-b78c-b02af28ab1b8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47102024-11-13T05:19:45.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0975f01a-2bfb-4cd9-8f7d-f09fa433357f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47112024-11-13T05:19:45.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0975f01a-2bfb-4cd9-8f7d-f09fa433357f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47122024-11-13T05:19:45.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0975f01a-2bfb-4cd9-8f7d-f09fa433357f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47132024-11-13T05:19:45.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 21ed286c-a01c-46fd-933e-46e00bd4b405 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
47142024-11-13T05:19:45.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 21ed286c-a01c-46fd-933e-46e00bd4b405 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
47152024-11-13T05:19:45.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 21ed286c-a01c-46fd-933e-46e00bd4b405 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
47162024-11-13T05:19:45.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 6f401234-c277-47a3-8d22-c955ee136782 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
47172024-11-13T05:19:45.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 6f401234-c277-47a3-8d22-c955ee136782 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
47182024-11-13T05:19:45.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 6f401234-c277-47a3-8d22-c955ee136782 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
47192024-11-13T05:19:46.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6039bc0-8e25-4006-a90b-0580a7bc756e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47202024-11-13T05:19:46.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6039bc0-8e25-4006-a90b-0580a7bc756e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47212024-11-13T05:19:46.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d6039bc0-8e25-4006-a90b-0580a7bc756e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47222024-11-13T05:19:47.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1a6f1dd3-e8b6-4121-ac2d-411175701dea roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47232024-11-13T05:19:47.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1a6f1dd3-e8b6-4121-ac2d-411175701dea resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47242024-11-13T05:19:47.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1a6f1dd3-e8b6-4121-ac2d-411175701dea response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47252024-11-13T05:19:48.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7fc75576-5e50-4c94-82b7-705c841f16ba roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47262024-11-13T05:19:48.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7fc75576-5e50-4c94-82b7-705c841f16ba resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47272024-11-13T05:19:48.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7fc75576-5e50-4c94-82b7-705c841f16ba response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47282024-11-13T05:19:49.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d560145b-96d8-4d6c-9be1-ef29ef45af21 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47292024-11-13T05:19:49.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d560145b-96d8-4d6c-9be1-ef29ef45af21 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47302024-11-13T05:19:49.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d560145b-96d8-4d6c-9be1-ef29ef45af21 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47312024-11-13T05:19:49.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
47322024-11-13T05:19:49.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
47332024-11-13T05:19:49.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47342024-11-13T05:19:49.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47352024-11-13T05:19:49.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47362024-11-13T05:19:49.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47372024-11-13T05:19:49.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47382024-11-13T05:19:49.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47392024-11-13T05:19:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47402024-11-13T05:19:49.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47412024-11-13T05:19:49.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47422024-11-13T05:19:49.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47432024-11-13T05:19:49.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47442024-11-13T05:19:49.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47452024-11-13T05:19:49.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.581312ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47462024-11-13T05:19:49.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47472024-11-13T05:19:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
47482024-11-13T05:19:49.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47492024-11-13T05:19:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47502024-11-13T05:19:49.949ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
47512024-11-13T05:19:49.949ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.971424ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
47522024-11-13T05:19:50.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e5e9f4d0-d43e-4214-b5d5-78bcb485c33c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47532024-11-13T05:19:50.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e5e9f4d0-d43e-4214-b5d5-78bcb485c33c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47542024-11-13T05:19:50.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e5e9f4d0-d43e-4214-b5d5-78bcb485c33c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47552024-11-13T05:19:51.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 82eff170-4cad-43d5-84ac-f7c83bb8e02d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47562024-11-13T05:19:51.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 82eff170-4cad-43d5-84ac-f7c83bb8e02d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47572024-11-13T05:19:51.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 82eff170-4cad-43d5-84ac-f7c83bb8e02d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47582024-11-13T05:19:52.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c172388f-e01a-42c6-b29a-d3567fbff8c0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47592024-11-13T05:19:52.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c172388f-e01a-42c6-b29a-d3567fbff8c0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47602024-11-13T05:19:52.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c172388f-e01a-42c6-b29a-d3567fbff8c0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47612024-11-13T05:19:53.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 518b86c8-5045-4099-b93d-f3ce02bb7062 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47622024-11-13T05:19:53.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 518b86c8-5045-4099-b93d-f3ce02bb7062 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47632024-11-13T05:19:53.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 518b86c8-5045-4099-b93d-f3ce02bb7062 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47642024-11-13T05:19:53.700ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0c90c4af-fcbc-45e0-82c8-050aac5b3b10 remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8f85a9f4-87b1-4c15-a902-1b51ce14ba13 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-13T05:19:53.697967719Z }
47652024-11-13T05:19:53.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8f85a9f4-87b1-4c15-a902-1b51ce14ba13 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
47662024-11-13T05:19:53.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8f85a9f4-87b1-4c15-a902-1b51ce14ba13 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
47672024-11-13T05:19:53.727ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:39013
47682024-11-13T05:19:53.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39013 req_id = 9ced92c4-591f-43b7-8111-531a120b5a51 roles = RoleSet { roles: {} } uri = /metrics/producers
47692024-11-13T05:19:53.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39013 req_id = 9ced92c4-591f-43b7-8111-531a120b5a51 resource = Database result = Ok(()) uri = /metrics/producers
47702024-11-13T05:19:53.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37548 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8f85a9f4-87b1-4c15-a902-1b51ce14ba13 response_code = 204 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
47712024-11-13T05:19:53.736ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0c90c4af-fcbc-45e0-82c8-050aac5b3b10 remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 93576455-0b79-4695-ae10-a8bae8f1d73b uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-13T05:19:53.736108433Z }
47722024-11-13T05:19:53.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 93576455-0b79-4695-ae10-a8bae8f1d73b roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
47732024-11-13T05:19:53.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 93576455-0b79-4695-ae10-a8bae8f1d73b resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
47742024-11-13T05:19:53.761ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 3bddec9b-236c-407a-ae26-63052a5ace8c
47752024-11-13T05:19:53.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33887 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39013 req_id = 9ced92c4-591f-43b7-8111-531a120b5a51 response_code = 201 uri = /metrics/producers
47762024-11-13T05:19:53.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35580 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 93576455-0b79-4695-ae10-a8bae8f1d73b response_code = 204 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
47772024-11-13T05:19:54.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d1d083cb-3ae6-4f52-b5ba-8aeeddfa9627 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47782024-11-13T05:19:54.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d1d083cb-3ae6-4f52-b5ba-8aeeddfa9627 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47792024-11-13T05:19:54.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d1d083cb-3ae6-4f52-b5ba-8aeeddfa9627 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47802024-11-13T05:19:55.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1644 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 956bf933-1e1c-44ec-a6bc-00f7ac94d850 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
47812024-11-13T05:19:55.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 03aceb94-39dc-466d-ab88-40de7c6fabc2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47822024-11-13T05:19:55.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 03aceb94-39dc-466d-ab88-40de7c6fabc2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47832024-11-13T05:19:55.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 03aceb94-39dc-466d-ab88-40de7c6fabc2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47842024-11-13T05:19:56.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b1cefbd-cfb9-4dea-b7ed-18d34b8212a2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47852024-11-13T05:19:56.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b1cefbd-cfb9-4dea-b7ed-18d34b8212a2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47862024-11-13T05:19:56.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b1cefbd-cfb9-4dea-b7ed-18d34b8212a2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47872024-11-13T05:19:57.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 524116c7-76e8-4105-a7aa-771f2828cb82 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47882024-11-13T05:19:57.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 524116c7-76e8-4105-a7aa-771f2828cb82 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47892024-11-13T05:19:57.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 524116c7-76e8-4105-a7aa-771f2828cb82 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47902024-11-13T05:19:58.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8d2f5f4-6602-493d-87c8-4eb9615b30f2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47912024-11-13T05:19:58.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8d2f5f4-6602-493d-87c8-4eb9615b30f2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47922024-11-13T05:19:58.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c8d2f5f4-6602-493d-87c8-4eb9615b30f2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47932024-11-13T05:19:59.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c62a40dc-6492-4abb-9b33-e7675e90b893 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47942024-11-13T05:19:59.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c62a40dc-6492-4abb-9b33-e7675e90b893 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47952024-11-13T05:19:59.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c62a40dc-6492-4abb-9b33-e7675e90b893 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
47962024-11-13T05:19:59.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
47972024-11-13T05:19:59.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
47982024-11-13T05:19:59.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47992024-11-13T05:19:59.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48002024-11-13T05:19:59.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48012024-11-13T05:19:59.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48022024-11-13T05:19:59.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48032024-11-13T05:19:59.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48042024-11-13T05:19:59.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48052024-11-13T05:19:59.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48062024-11-13T05:19:59.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48072024-11-13T05:19:59.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48082024-11-13T05:19:59.926ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48092024-11-13T05:19:59.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48102024-11-13T05:19:59.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48112024-11-13T05:19:59.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
48122024-11-13T05:19:59.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48132024-11-13T05:19:59.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48142024-11-13T05:19:59.947ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
48152024-11-13T05:19:59.947ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.882686ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
48162024-11-13T05:19:59.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.999047ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48172024-11-13T05:20:00.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = cdb6f641-36aa-466f-8f91-ab45814a7692 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
48182024-11-13T05:20:00.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = cdb6f641-36aa-466f-8f91-ab45814a7692 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
48192024-11-13T05:20:00.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = cdb6f641-36aa-466f-8f91-ab45814a7692 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
48202024-11-13T05:20:00.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = f0768fed-fb54-4d03-b30b-f5436cf5dab8 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
48212024-11-13T05:20:00.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = f0768fed-fb54-4d03-b30b-f5436cf5dab8 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
48222024-11-13T05:20:00.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = f0768fed-fb54-4d03-b30b-f5436cf5dab8 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
48232024-11-13T05:20:00.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d1e6297-7332-4e02-990f-c2d464b9c973 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48242024-11-13T05:20:00.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d1e6297-7332-4e02-990f-c2d464b9c973 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48252024-11-13T05:20:00.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d1e6297-7332-4e02-990f-c2d464b9c973 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48262024-11-13T05:20:01.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78ff62ff-8c08-45f3-b0ac-f40e6e5c6767 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48272024-11-13T05:20:01.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78ff62ff-8c08-45f3-b0ac-f40e6e5c6767 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48282024-11-13T05:20:01.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78ff62ff-8c08-45f3-b0ac-f40e6e5c6767 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48292024-11-13T05:20:02.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 977fd6af-d58d-4912-b195-313afd586d3c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48302024-11-13T05:20:02.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 977fd6af-d58d-4912-b195-313afd586d3c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48312024-11-13T05:20:02.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 977fd6af-d58d-4912-b195-313afd586d3c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48322024-11-13T05:20:03.762ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0c90c4af-fcbc-45e0-82c8-050aac5b3b10 remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eb3ae10d-45e4-4d42-8fe3-96da52a4eef9 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-13T05:20:03.762612484Z }
48332024-11-13T05:20:03.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eb3ae10d-45e4-4d42-8fe3-96da52a4eef9 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48342024-11-13T05:20:03.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eb3ae10d-45e4-4d42-8fe3-96da52a4eef9 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48352024-11-13T05:20:03.775ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:159 retry_after (ms) = 4 transaction = vmm_and_migration_update_runtime
48362024-11-13T05:20:03.785ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:115 transaction = vmm_and_migration_update_runtime
48372024-11-13T05:20:03.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 23130 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eb3ae10d-45e4-4d42-8fe3-96da52a4eef9 response_code = 204 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48382024-11-13T05:20:03.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 408bcc74-b6e4-4fe6-a2db-f10064513818 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48392024-11-13T05:20:03.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 408bcc74-b6e4-4fe6-a2db-f10064513818 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48402024-11-13T05:20:03.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 408bcc74-b6e4-4fe6-a2db-f10064513818 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48412024-11-13T05:20:04.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2260d50c-9393-47e7-bfa6-f2623479b62b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48422024-11-13T05:20:04.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2260d50c-9393-47e7-bfa6-f2623479b62b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48432024-11-13T05:20:04.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2260d50c-9393-47e7-bfa6-f2623479b62b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48442024-11-13T05:20:05.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78442223-91cf-40ba-b5a1-12d06f2252e0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48452024-11-13T05:20:05.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78442223-91cf-40ba-b5a1-12d06f2252e0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48462024-11-13T05:20:05.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78442223-91cf-40ba-b5a1-12d06f2252e0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
48472024-11-13T05:20:06.220ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0c90c4af-fcbc-45e0-82c8-050aac5b3b10 remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-13T05:20:06.220429317Z }
48482024-11-13T05:20:06.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48492024-11-13T05:20:06.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48502024-11-13T05:20:06.257ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 0c90c4af-fcbc-45e0-82c8-050aac5b3b10 remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10 vmm_needs_update = true
48512024-11-13T05:20:06.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48522024-11-13T05:20:06.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48532024-11-13T05:20:06.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48542024-11-13T05:20:06.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48552024-11-13T05:20:06.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48562024-11-13T05:20:06.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48572024-11-13T05:20:06.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48582024-11-13T05:20:06.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48592024-11-13T05:20:06.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48602024-11-13T05:20:06.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48612024-11-13T05:20:06.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48622024-11-13T05:20:06.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48632024-11-13T05:20:06.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48642024-11-13T05:20:06.274ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, lookup_type: ById(26cfece8-d05c-41eb-b6a0-db2c20fff7a5) }, key: e384052f-88fa-4666-ac34-dbd6b201f32f, lookup_type: ById(e384052f-88fa-4666-ac34-dbd6b201f32f) }, key: 3bddec9b-236c-407a-ae26-63052a5ace8c, lookup_type: ById(3bddec9b-236c-407a-ae26-63052a5ace8c) } result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48652024-11-13T05:20:06.274ZINFOnexus (dropshot_internal): starting update saga for 3bddec9b-236c-407a-ae26-63052a5ace8c actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-13T05:20:06.220429317Z }
48662024-11-13T05:20:06.274ZDEBGnexus (dropshot_internal): preparing instance-update saga for 3bddec9b-236c-407a-ae26-63052a5ace8c... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48672024-11-13T05:20:06.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53641 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e55740b3-3da1-410a-854e-8b033ffec247 response_code = 204 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48682024-11-13T05:20:06.274ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update
48692024-11-13T05:20:06.274ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"3bddec9b-236c-407a-ae26-63052a5ace8c","lookup_type":{"ById":"3bddec9b-236c-407a-ae26-63052a5ace8c"},"parent":{"key":"e384052f-88fa-4666-ac34-dbd6b201f32f","lookup_type":{"ById":"e384052f-88fa-4666-ac34-dbd6b201f32f"},"parent":{"key":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","lookup_type":{"ById":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
48702024-11-13T05:20:06.274ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update
48712024-11-13T05:20:06.274ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 0c90c4af-fcbc-45e0-82c8-050aac5b3b10 remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6ff76b02-cda8-4214-b50a-47c622c06acc uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-13T05:20:06.220429317Z }
48722024-11-13T05:20:06.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6ff76b02-cda8-4214-b50a-47c622c06acc roles = RoleSet { roles: {} } uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48732024-11-13T05:20:06.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6ff76b02-cda8-4214-b50a-47c622c06acc resource = Database result = Ok(()) uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48742024-11-13T05:20:06.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6440 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6ff76b02-cda8-4214-b50a-47c622c06acc response_code = 204 uri = /vmms/0c90c4af-fcbc-45e0-82c8-050aac5b3b10
48752024-11-13T05:20:06.302ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update
48762024-11-13T05:20:06.302ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
48772024-11-13T05:20:06.302ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
48782024-11-13T05:20:06.302ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
48792024-11-13T05:20:06.307ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
48802024-11-13T05:20:06.307ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
48812024-11-13T05:20:06.310ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
48822024-11-13T05:20:06.310ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
48832024-11-13T05:20:06.313ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
48842024-11-13T05:20:06.313ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("4d1fb2b4-855f-4e3d-922b-7b3d80908669")) node_id = 0 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
48852024-11-13T05:20:06.316ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
48862024-11-13T05:20:06.316ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
48872024-11-13T05:20:06.321ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update
48882024-11-13T05:20:06.322ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48892024-11-13T05:20:06.322ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48902024-11-13T05:20:06.324ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48912024-11-13T05:20:06.324ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48922024-11-13T05:20:06.325ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48932024-11-13T05:20:06.325ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48942024-11-13T05:20:06.327ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48952024-11-13T05:20:06.327ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48962024-11-13T05:20:06.354ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48972024-11-13T05:20:06.354ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48982024-11-13T05:20:06.356ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
48992024-11-13T05:20:06.356ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
49002024-11-13T05:20:06.357ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
49012024-11-13T05:20:06.360ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, lookup_type: ById(26cfece8-d05c-41eb-b6a0-db2c20fff7a5) }, key: e384052f-88fa-4666-ac34-dbd6b201f32f, lookup_type: ById(e384052f-88fa-4666-ac34-dbd6b201f32f) }, key: 3bddec9b-236c-407a-ae26-63052a5ace8c, lookup_type: ById(3bddec9b-236c-407a-ae26-63052a5ace8c) } result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
49022024-11-13T05:20:06.360ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance updater_id = 4d1fb2b4-855f-4e3d-922b-7b3d80908669
49032024-11-13T05:20:06.360ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
49042024-11-13T05:20:06.360ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
49052024-11-13T05:20:06.369ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance updater_id = 4d1fb2b4-855f-4e3d-922b-7b3d80908669
49062024-11-13T05:20:06.369ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
49072024-11-13T05:20:06.369ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance
49082024-11-13T05:20:06.376ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c locked_gen = Generation(Generation(2)) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = LockInstance updater_id = 4d1fb2b4-855f-4e3d-922b-7b3d80908669
49092024-11-13T05:20:06.378ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49102024-11-13T05:20:06.378ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("4d1fb2b4-855f-4e3d-922b-7b3d80908669")}) node_id = 1 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
49112024-11-13T05:20:06.382ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49122024-11-13T05:20:06.382ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
49132024-11-13T05:20:06.385ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49142024-11-13T05:20:06.385ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49152024-11-13T05:20:06.386ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49162024-11-13T05:20:06.386ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49172024-11-13T05:20:06.387ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49182024-11-13T05:20:06.387ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49192024-11-13T05:20:06.388ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49202024-11-13T05:20:06.391ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, lookup_type: ById(26cfece8-d05c-41eb-b6a0-db2c20fff7a5) }, key: e384052f-88fa-4666-ac34-dbd6b201f32f, lookup_type: ById(e384052f-88fa-4666-ac34-dbd6b201f32f) }, key: 3bddec9b-236c-407a-ae26-63052a5ace8c, lookup_type: ById(3bddec9b-236c-407a-ae26-63052a5ace8c) } result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49212024-11-13T05:20:06.391ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49222024-11-13T05:20:06.391ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
49232024-11-13T05:20:06.406ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 0c90c4af-fcbc-45e0-82c8-050aac5b3b10, time_created: 2024-11-13T05:19:45.739016Z, time_deleted: None, instance_id: 3bddec9b-236c-407a-ae26-63052a5ace8c, sled_id: 4d997277-f640-48d7-af56-6df261d5afe1, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-13T05:20:06.220429Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-13T05:19:43.770072Z, gen: Generation(Generation(3)), propolis_id: Some(0c90c4af-fcbc-45e0-82c8-050aac5b3b10), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(0c90c4af-fcbc-45e0-82c8-050aac5b3b10 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-13T05:20:06.401992714Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
49242024-11-13T05:20:06.406ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49252024-11-13T05:20:06.406ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"3bddec9b-236c-407a-ae26-63052a5ace8c","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"0c90c4af-fcbc-45e0-82c8-050aac5b3b10"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"3bddec9b-236c-407a-ae26-63052a5ace8c","lookup_type":{"ById":"3bddec9b-236c-407a-ae26-63052a5ace8c"},"parent":{"key":"e384052f-88fa-4666-ac34-dbd6b201f32f","lookup_type":{"ById":"e384052f-88fa-4666-ac34-dbd6b201f32f"},"parent":{"key":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","lookup_type":{"ById":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"4d1fb2b4-855f-4e3d-922b-7b3d80908669"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"e384052f-88fa-4666-ac34-dbd6b201f32f","ram_diff":1073741824},"destroy_active_vmm":"0c90c4af-fcbc-45e0-82c8-050aac5b3b10","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-13T05:20:06.401992714Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49262024-11-13T05:20:06.406ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49272024-11-13T05:20:06.437ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49282024-11-13T05:20:06.437ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49292024-11-13T05:20:06.437ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49302024-11-13T05:20:06.437ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49312024-11-13T05:20:06.441ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49322024-11-13T05:20:06.441ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49332024-11-13T05:20:06.444ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49342024-11-13T05:20:06.444ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49352024-11-13T05:20:06.446ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49362024-11-13T05:20:06.446ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e7ca7532-21d6-4799-a5d8-f6ce4334d738")) node_id = 0 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49372024-11-13T05:20:06.450ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49382024-11-13T05:20:06.450ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49392024-11-13T05:20:06.456ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c parent_lock = UpdaterLock { updater_id: 4d1fb2b4-855f-4e3d-922b-7b3d80908669, locked_gen: Generation(Generation(2)) } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49402024-11-13T05:20:06.456ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = BecomeUpdater
49412024-11-13T05:20:06.456ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = BecomeUpdater
49422024-11-13T05:20:06.463ZDEBGnexus (SagaExecutor): inherited lock from 4d1fb2b4-855f-4e3d-922b-7b3d80908669 to e7ca7532-21d6-4799-a5d8-f6ce4334d738 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 4d1fb2b4-855f-4e3d-922b-7b3d80908669 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = BecomeUpdater updater_id = e7ca7532-21d6-4799-a5d8-f6ce4334d738
49432024-11-13T05:20:06.463ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49442024-11-13T05:20:06.463ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49452024-11-13T05:20:06.463ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("e7ca7532-21d6-4799-a5d8-f6ce4334d738")}) node_id = 1 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49462024-11-13T05:20:06.466ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49472024-11-13T05:20:06.466ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49482024-11-13T05:20:06.469ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49492024-11-13T05:20:06.469ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49502024-11-13T05:20:06.472ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49512024-11-13T05:20:06.472ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49522024-11-13T05:20:06.475ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49532024-11-13T05:20:06.478ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c
49542024-11-13T05:20:06.480ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UpdateNetworkConfig
49552024-11-13T05:20:06.480ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UpdateNetworkConfig
49562024-11-13T05:20:06.486ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UpdateNetworkConfig
49572024-11-13T05:20:06.486ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UpdateNetworkConfig
49582024-11-13T05:20:06.488ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
49592024-11-13T05:20:06.488ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UpdateNetworkConfig
49602024-11-13T05:20:06.488ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UpdateNetworkConfig
49612024-11-13T05:20:06.490ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
49622024-11-13T05:20:06.490ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
49632024-11-13T05:20:06.490ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
49642024-11-13T05:20:06.491ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
49652024-11-13T05:20:06.493ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
49662024-11-13T05:20:06.493ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
49672024-11-13T05:20:06.493ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
49682024-11-13T05:20:06.497ZDEBGnexus: notifying dendrite of updates instance_id = Some(3bddec9b-236c-407a-ae26-63052a5ace8c (instance)) switch = switch0
49692024-11-13T05:20:06.498ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5588, tv_nsec: 6367791 } })
49702024-11-13T05:20:06.498ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
49712024-11-13T05:20:06.528ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
49722024-11-13T05:20:06.528ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49732024-11-13T05:20:06.528ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "704c41d9-3a28-4f94-a913-daca7b603164", "content-length": "26", "date": "Wed, 13 Nov 2024 05:20:06 GMT"} })
49742024-11-13T05:20:06.528ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49752024-11-13T05:20:06.529ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49762024-11-13T05:20:06.557ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
49772024-11-13T05:20:06.558ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8edd6fb-88fe-4cbb-9550-9eb5ec704360", "content-length": "4", "date": "Wed, 13 Nov 2024 05:20:05 GMT"} })
49782024-11-13T05:20:06.558ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49792024-11-13T05:20:06.558ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49802024-11-13T05:20:06.562ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49812024-11-13T05:20:06.562ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49822024-11-13T05:20:06.567ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
49832024-11-13T05:20:06.567ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
49842024-11-13T05:20:06.598ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-13T05:20:06.570411Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, time_modified: Some(2024-11-13T05:20:06.570411Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: e384052f-88fa-4666-ac34-dbd6b201f32f, time_modified: Some(2024-11-13T05:20:06.570411Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49852024-11-13T05:20:06.598ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49862024-11-13T05:20:06.598ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49872024-11-13T05:20:06.601ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
49882024-11-13T05:20:06.601ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
49892024-11-13T05:20:06.605ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49902024-11-13T05:20:06.605ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UnassignOximeterProducer
49912024-11-13T05:20:06.605ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UnassignOximeterProducer
49922024-11-13T05:20:06.611ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 producer_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49932024-11-13T05:20:06.611ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UnassignOximeterProducer
49942024-11-13T05:20:06.611ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = UnassignOximeterProducer
49952024-11-13T05:20:06.645ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49962024-11-13T05:20:06.647ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/3bddec9b-236c-407a-ae26-63052a5ace8c
49972024-11-13T05:20:06.660ZDEBGnexus (SagaExecutor): client response oximeter-collector = 3bddec9b-236c-407a-ae26-63052a5ace8c result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/3bddec9b-236c-407a-ae26-63052a5ace8c", status: 204, headers: {"x-request-id": "db7a8233-e6ec-476b-987e-f7768eebc188", "date": "Wed, 13 Nov 2024 05:20:06 GMT"} }) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49982024-11-13T05:20:06.660ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 producer_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
49992024-11-13T05:20:06.661ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50002024-11-13T05:20:06.661ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50012024-11-13T05:20:06.664ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50022024-11-13T05:20:06.664ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50032024-11-13T05:20:06.667ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c lock = UpdaterLock { updater_id: e7ca7532-21d6-4799-a5d8-f6ce4334d738, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-13T05:20:06.401992714Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
50042024-11-13T05:20:06.667ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = CommitInstanceUpdates
50052024-11-13T05:20:06.668ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = CommitInstanceUpdates
50062024-11-13T05:20:06.703ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c new_runtime = InstanceRuntimeState { time_updated: 2024-11-13T05:20:06.401992714Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
50072024-11-13T05:20:06.703ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50082024-11-13T05:20:06.703ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50092024-11-13T05:20:06.703ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
50102024-11-13T05:20:06.703ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
50112024-11-13T05:20:06.703ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50122024-11-13T05:20:06.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50132024-11-13T05:20:06.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50142024-11-13T05:20:06.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50152024-11-13T05:20:06.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50162024-11-13T05:20:06.704ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50172024-11-13T05:20:06.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50182024-11-13T05:20:06.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50192024-11-13T05:20:06.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50202024-11-13T05:20:06.707ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50212024-11-13T05:20:06.707ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50222024-11-13T05:20:06.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50232024-11-13T05:20:06.710ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50242024-11-13T05:20:06.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50252024-11-13T05:20:06.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50262024-11-13T05:20:06.710ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50272024-11-13T05:20:06.710ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("3bddec9b-236c-407a-ae26-63052a5ace8c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0c90c4af-fcbc-45e0-82c8-050aac5b3b10")}) node_id = 7 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50282024-11-13T05:20:06.714ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50292024-11-13T05:20:06.714ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50302024-11-13T05:20:06.719ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50312024-11-13T05:20:06.719ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50322024-11-13T05:20:06.722ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50332024-11-13T05:20:06.723ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50342024-11-13T05:20:06.728ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c propolis_id = 0c90c4af-fcbc-45e0-82c8-050aac5b3b10 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
50352024-11-13T05:20:06.728ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ReleaseSledResources
50362024-11-13T05:20:06.729ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ReleaseSledResources
50372024-11-13T05:20:06.733ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50382024-11-13T05:20:06.733ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50392024-11-13T05:20:06.736ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50402024-11-13T05:20:06.736ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50412024-11-13T05:20:06.741ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c propolis_id = 0c90c4af-fcbc-45e0-82c8-050aac5b3b10 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
50422024-11-13T05:20:06.741ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = MarkVmmDeleted
50432024-11-13T05:20:06.742ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = MarkVmmDeleted
50442024-11-13T05:20:06.751ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50452024-11-13T05:20:06.751ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50462024-11-13T05:20:06.755ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50472024-11-13T05:20:06.755ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50482024-11-13T05:20:06.758ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50492024-11-13T05:20:06.758ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50502024-11-13T05:20:06.762ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50512024-11-13T05:20:06.762ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50522024-11-13T05:20:06.765ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50532024-11-13T05:20:06.766ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50542024-11-13T05:20:06.767ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50552024-11-13T05:20:06.767ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50562024-11-13T05:20:06.768ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50572024-11-13T05:20:06.769ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50582024-11-13T05:20:06.798ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50592024-11-13T05:20:06.801ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, lookup_type: ById(26cfece8-d05c-41eb-b6a0-db2c20fff7a5) }, key: e384052f-88fa-4666-ac34-dbd6b201f32f, lookup_type: ById(e384052f-88fa-4666-ac34-dbd6b201f32f) }, key: 3bddec9b-236c-407a-ae26-63052a5ace8c, lookup_type: ById(3bddec9b-236c-407a-ae26-63052a5ace8c) } result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50602024-11-13T05:20:06.801ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50612024-11-13T05:20:06.801ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_node = ChainSuccessorSaga
50622024-11-13T05:20:06.805ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c karmic_state = WillReincarnate needs_reincarnation = false saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update
50632024-11-13T05:20:06.805ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50642024-11-13T05:20:06.805ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50652024-11-13T05:20:06.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50662024-11-13T05:20:06.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50672024-11-13T05:20:06.805ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50682024-11-13T05:20:06.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50692024-11-13T05:20:06.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8c968ce-96c7-447c-b629-5e0bd64c956c", "content-length": "372", "date": "Wed, 13 Nov 2024 05:20:06 GMT"} })
50702024-11-13T05:20:06.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50712024-11-13T05:20:06.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50722024-11-13T05:20:06.808ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50732024-11-13T05:20:06.808ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50742024-11-13T05:20:06.811ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50752024-11-13T05:20:06.811ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50762024-11-13T05:20:06.816ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50772024-11-13T05:20:06.816ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3
50782024-11-13T05:20:06.824ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50792024-11-13T05:20:06.824ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 saga_name = instance-update saga_result = SagaResult { saga_id: a7b1bea8-c3ca-4b15-af2d-27981186dab3, saga_log: SagaLog { saga_id: a7b1bea8-c3ca-4b15-af2d-27981186dab3, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("e7ca7532-21d6-4799-a5d8-f6ce4334d738")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("e7ca7532-21d6-4799-a5d8-f6ce4334d738")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("3bddec9b-236c-407a-ae26-63052a5ace8c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0c90c4af-fcbc-45e0-82c8-050aac5b3b10")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("3bddec9b-236c-407a-ae26-63052a5ace8c"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("0c90c4af-fcbc-45e0-82c8-050aac5b3b10")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("e7ca7532-21d6-4799-a5d8-f6ce4334d738"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("e7ca7532-21d6-4799-a5d8-f6ce4334d738")}} }) }
50802024-11-13T05:20:06.824ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = a7b1bea8-c3ca-4b15-af2d-27981186dab3 instance_id = 3bddec9b-236c-407a-ae26-63052a5ace8c saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update
50812024-11-13T05:20:06.824ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50822024-11-13T05:20:06.824ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
50832024-11-13T05:20:06.827ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50842024-11-13T05:20:06.827ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
50852024-11-13T05:20:06.831ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50862024-11-13T05:20:06.831ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
50872024-11-13T05:20:06.834ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50882024-11-13T05:20:06.834ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74
50892024-11-13T05:20:06.839ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update sec_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
50902024-11-13T05:20:06.839ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = cfda0eb7-08d7-4c4a-bb62-0151214c7f74 saga_name = start-instance-update saga_result = SagaResult { saga_id: cfda0eb7-08d7-4c4a-bb62-0151214c7f74, saga_log: SagaLog { saga_id: cfda0eb7-08d7-4c4a-bb62-0151214c7f74, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("4d1fb2b4-855f-4e3d-922b-7b3d80908669")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("4d1fb2b4-855f-4e3d-922b-7b3d80908669")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("4d1fb2b4-855f-4e3d-922b-7b3d80908669"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("4d1fb2b4-855f-4e3d-922b-7b3d80908669")}} }) }
50912024-11-13T05:20:06.854ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
50922024-11-13T05:20:06.854ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50932024-11-13T05:20:06.855ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e3847a84-9688-493a-96a2-094e54e7461f", "date": "Wed, 13 Nov 2024 05:20:06 GMT"} })
50942024-11-13T05:20:06.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50952024-11-13T05:20:06.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50962024-11-13T05:20:06.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50972024-11-13T05:20:06.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50982024-11-13T05:20:06.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50992024-11-13T05:20:06.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51002024-11-13T05:20:06.863ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51012024-11-13T05:20:06.863ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51022024-11-13T05:20:06.864ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d0c8389c-8158-48cc-b28b-4ec156c560f4", "date": "Wed, 13 Nov 2024 05:20:06 GMT"} })
51032024-11-13T05:20:06.865ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 162.3527ms iteration = 26 status = {}
51042024-11-13T05:20:06.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51052024-11-13T05:20:06.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51062024-11-13T05:20:06.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51072024-11-13T05:20:06.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51082024-11-13T05:20:06.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51092024-11-13T05:20:06.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51102024-11-13T05:20:06.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51112024-11-13T05:20:06.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51122024-11-13T05:20:06.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51132024-11-13T05:20:06.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51142024-11-13T05:20:06.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92677f4c-1ab0-4356-bac2-86b35e65a798 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51152024-11-13T05:20:06.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92677f4c-1ab0-4356-bac2-86b35e65a798 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51162024-11-13T05:20:06.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92677f4c-1ab0-4356-bac2-86b35e65a798 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51172024-11-13T05:20:06.936ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51182024-11-13T05:20:06.937ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2f978ce-49f2-4301-9e13-46d163fe062c", "content-length": "691", "date": "Wed, 13 Nov 2024 05:20:06 GMT"} })
51192024-11-13T05:20:06.937ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51202024-11-13T05:20:06.937ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51212024-11-13T05:20:06.937ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51222024-11-13T05:20:06.938ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 235.242787ms iteration = 25 status = {}
51232024-11-13T05:20:07.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9d07fb2-1328-4b9a-81b3-cfaf5f60d063 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51242024-11-13T05:20:07.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9d07fb2-1328-4b9a-81b3-cfaf5f60d063 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51252024-11-13T05:20:07.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9d07fb2-1328-4b9a-81b3-cfaf5f60d063 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51262024-11-13T05:20:08.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89c5be5d-45c5-45ef-b32b-129c490c4f68 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51272024-11-13T05:20:08.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89c5be5d-45c5-45ef-b32b-129c490c4f68 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51282024-11-13T05:20:08.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89c5be5d-45c5-45ef-b32b-129c490c4f68 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
51292024-11-13T05:20:09.896ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
51302024-11-13T05:20:09.896ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
51312024-11-13T05:20:09.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51322024-11-13T05:20:09.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51332024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51342024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
51352024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
51362024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
51372024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
51382024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51392024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51402024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
51412024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51422024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
51432024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
51442024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51452024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51462024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
51472024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
51482024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
51492024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51502024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
51512024-11-13T05:20:09.897ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
51522024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51532024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
51542024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
51552024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51562024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51572024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
51582024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
51592024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51602024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
51612024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51622024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
51632024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
51642024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51652024-11-13T05:20:09.897ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71
51662024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
51672024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.02\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71"}
51682024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
51692024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51702024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
51712024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51722024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
51732024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
51742024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
51752024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51762024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
51772024-11-13T05:20:09.897ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
51782024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
51792024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51802024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51812024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
51822024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
51832024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
51842024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
51852024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51862024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51872024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
51882024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51892024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
51902024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
51912024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51922024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
51932024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
51942024-11-13T05:20:09.897ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-13 05:10:09.897774921 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
51952024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
51962024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51972024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51982024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51992024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52002024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52012024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52022024-11-13T05:20:09.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52032024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52042024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52052024-11-13T05:20:09.898ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("105858cb-d3d5-4677-95c0-079ffa1259be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b62b18b5-c7f6-48f0-ab56-4213f6de7d44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5591, tv_nsec: 406367531 } })
52062024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52072024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52082024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52092024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52102024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52112024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52122024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52132024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52142024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52152024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52162024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52172024-11-13T05:20:09.898ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("038e4c2b-2408-42f1-b025-c88f1167faaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5591, tv_nsec: 406472902 } })
52182024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52192024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52202024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52212024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52222024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52232024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52242024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52252024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52262024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
52272024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52282024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 990.379\u{b5}s iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
52292024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
52302024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.242941ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
52312024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52322024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52332024-11-13T05:20:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52342024-11-13T05:20:09.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52352024-11-13T05:20:09.900ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.299919ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52362024-11-13T05:20:09.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52372024-11-13T05:20:09.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52382024-11-13T05:20:09.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52392024-11-13T05:20:09.903ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
52402024-11-13T05:20:09.903ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
52412024-11-13T05:20:09.903ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.861901ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
52422024-11-13T05:20:09.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52432024-11-13T05:20:09.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52442024-11-13T05:20:09.906ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52452024-11-13T05:20:09.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52462024-11-13T05:20:09.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52472024-11-13T05:20:09.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5591, tv_nsec: 415492320 } })
52482024-11-13T05:20:09.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
52492024-11-13T05:20:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
52502024-11-13T05:20:09.908ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52512024-11-13T05:20:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52522024-11-13T05:20:09.909ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.148627ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
52532024-11-13T05:20:09.911ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52542024-11-13T05:20:09.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52552024-11-13T05:20:09.913ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52562024-11-13T05:20:09.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52572024-11-13T05:20:09.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5591, tv_nsec: 421678905 } })
52582024-11-13T05:20:09.913ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
52592024-11-13T05:20:09.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.842266ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
52602024-11-13T05:20:09.915ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52612024-11-13T05:20:09.916ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-13 05:10:09.897774921 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
52622024-11-13T05:20:09.916ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.32621ms iteration = 13 status = {"expiration":"2024-11-13T05:10:09.897774921Z","pruned":[]}
52632024-11-13T05:20:09.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
52642024-11-13T05:20:09.917ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52652024-11-13T05:20:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52662024-11-13T05:20:09.919ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52672024-11-13T05:20:09.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52682024-11-13T05:20:09.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
52692024-11-13T05:20:09.922ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
52702024-11-13T05:20:09.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
52712024-11-13T05:20:09.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52722024-11-13T05:20:09.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52732024-11-13T05:20:09.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52742024-11-13T05:20:09.934ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52752024-11-13T05:20:09.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52762024-11-13T05:20:09.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52772024-11-13T05:20:09.934ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52782024-11-13T05:20:09.935ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52792024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52802024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52812024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52822024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52832024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52842024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52852024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52862024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52872024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52882024-11-13T05:20:09.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52892024-11-13T05:20:09.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52902024-11-13T05:20:09.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52912024-11-13T05:20:09.938ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52922024-11-13T05:20:09.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52932024-11-13T05:20:09.940ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52942024-11-13T05:20:09.940ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52952024-11-13T05:20:09.940ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52962024-11-13T05:20:09.940ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52972024-11-13T05:20:09.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52982024-11-13T05:20:09.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992024-11-13T05:20:09.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53002024-11-13T05:20:09.943ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53012024-11-13T05:20:09.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53022024-11-13T05:20:09.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53032024-11-13T05:20:09.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53042024-11-13T05:20:09.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53052024-11-13T05:20:09.944ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53062024-11-13T05:20:09.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53072024-11-13T05:20:09.949ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53082024-11-13T05:20:09.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53092024-11-13T05:20:09.949ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53102024-11-13T05:20:09.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53112024-11-13T05:20:09.950ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53122024-11-13T05:20:09.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53132024-11-13T05:20:09.950ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53142024-11-13T05:20:09.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53152024-11-13T05:20:09.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53162024-11-13T05:20:09.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
53172024-11-13T05:20:09.955ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53182024-11-13T05:20:09.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53192024-11-13T05:20:09.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.139861ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
53202024-11-13T05:20:09.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53212024-11-13T05:20:09.956ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53222024-11-13T05:20:09.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53232024-11-13T05:20:09.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53242024-11-13T05:20:09.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53252024-11-13T05:20:09.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53262024-11-13T05:20:09.959ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53272024-11-13T05:20:09.959ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
53282024-11-13T05:20:09.959ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53292024-11-13T05:20:09.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53302024-11-13T05:20:09.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53312024-11-13T05:20:09.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53322024-11-13T05:20:09.964ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5591, tv_nsec: 472933163 } })
53332024-11-13T05:20:09.965ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
53342024-11-13T05:20:09.965ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53352024-11-13T05:20:09.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.352288ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53362024-11-13T05:20:09.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53372024-11-13T05:20:09.967ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53382024-11-13T05:20:09.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53392024-11-13T05:20:09.969ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53402024-11-13T05:20:09.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53412024-11-13T05:20:09.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53422024-11-13T05:20:09.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53432024-11-13T05:20:09.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53442024-11-13T05:20:09.971ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53452024-11-13T05:20:09.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53462024-11-13T05:20:09.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53472024-11-13T05:20:09.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53482024-11-13T05:20:09.973ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53492024-11-13T05:20:09.975ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53502024-11-13T05:20:09.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53512024-11-13T05:20:09.980ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53522024-11-13T05:20:09.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53532024-11-13T05:20:09.980ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53542024-11-13T05:20:09.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
53552024-11-13T05:20:09.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53562024-11-13T05:20:09.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53572024-11-13T05:20:09.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
53582024-11-13T05:20:09.981ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
53592024-11-13T05:20:09.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
53602024-11-13T05:20:09.983ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53612024-11-13T05:20:09.983ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53622024-11-13T05:20:09.983ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53632024-11-13T05:20:09.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53642024-11-13T05:20:09.984ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 86.330354ms iteration = 6 status = {"nsuccess":5}
53652024-11-13T05:20:09.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53662024-11-13T05:20:09.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53672024-11-13T05:20:09.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53682024-11-13T05:20:09.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53692024-11-13T05:20:09.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53702024-11-13T05:20:09.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.577864ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53712024-11-13T05:20:09.994ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53722024-11-13T05:20:09.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b40c67ce-57d4-471d-9ff7-5a5ce2c200b5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
53732024-11-13T05:20:09.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53742024-11-13T05:20:09.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b40c67ce-57d4-471d-9ff7-5a5ce2c200b5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
53752024-11-13T05:20:09.996ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
53762024-11-13T05:20:09.996ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.183807ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
53772024-11-13T05:20:09.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b40c67ce-57d4-471d-9ff7-5a5ce2c200b5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
53782024-11-13T05:20:09.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53792024-11-13T05:20:09.997ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.233156ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53802024-11-13T05:20:09.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53812024-11-13T05:20:09.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53822024-11-13T05:20:09.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53832024-11-13T05:20:09.999ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53842024-11-13T05:20:10.000ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53852024-11-13T05:20:10.000ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
53862024-11-13T05:20:10.000ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.495106ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
53872024-11-13T05:20:10.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53882024-11-13T05:20:10.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53892024-11-13T05:20:10.001ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
53902024-11-13T05:20:10.001ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
53912024-11-13T05:20:10.001ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.660666ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
53922024-11-13T05:20:10.001ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53932024-11-13T05:20:10.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53942024-11-13T05:20:10.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53952024-11-13T05:20:10.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
53962024-11-13T05:20:10.003ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53972024-11-13T05:20:10.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53982024-11-13T05:20:10.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53992024-11-13T05:20:10.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54002024-11-13T05:20:10.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54012024-11-13T05:20:10.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54022024-11-13T05:20:10.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54032024-11-13T05:20:10.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54042024-11-13T05:20:10.007ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54052024-11-13T05:20:10.007ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54062024-11-13T05:20:10.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54072024-11-13T05:20:10.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54082024-11-13T05:20:10.007ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.302674ms iteration = 25 status = 0
54092024-11-13T05:20:10.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54102024-11-13T05:20:10.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54112024-11-13T05:20:10.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54122024-11-13T05:20:10.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54132024-11-13T05:20:10.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54142024-11-13T05:20:10.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54152024-11-13T05:20:10.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54162024-11-13T05:20:10.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54172024-11-13T05:20:10.013ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
54182024-11-13T05:20:10.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.389127ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54192024-11-13T05:20:10.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54202024-11-13T05:20:10.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54212024-11-13T05:20:10.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54222024-11-13T05:20:10.017ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
54232024-11-13T05:20:10.017ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54242024-11-13T05:20:10.017ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-13 05:08:54.008257 UTC dns_group = internal generation = 1
54252024-11-13T05:20:10.017ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 120.834227ms iteration = 14 status = {"generation":1}
54262024-11-13T05:20:10.019ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54272024-11-13T05:20:10.019ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 0 version = 2
54282024-11-13T05:20:10.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54292024-11-13T05:20:10.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54302024-11-13T05:20:10.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54312024-11-13T05:20:10.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54322024-11-13T05:20:10.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54332024-11-13T05:20:10.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54342024-11-13T05:20:10.026ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 1 version = 2
54352024-11-13T05:20:10.026ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54362024-11-13T05:20:10.026ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-13 05:08:54.834359 UTC dns_group = external generation = 2
54372024-11-13T05:20:10.026ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 128.947727ms iteration = 14 status = {"generation":2}
54382024-11-13T05:20:10.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.568349ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54392024-11-13T05:20:10.060ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-13T05:08:08.157062Z, time_modified: 2024-11-13T05:08:08.157062Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
54402024-11-13T05:20:10.060ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 162.834853ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]}},"default_endpoint":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54412024-11-13T05:20:10.069ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
54422024-11-13T05:20:10.069ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54432024-11-13T05:20:10.069ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f0fa0de-c294-4e1d-a56e-d3cb32d57d61", "content-length": "26", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
54442024-11-13T05:20:10.069ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54452024-11-13T05:20:10.070ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54462024-11-13T05:20:10.071ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.349653ms iteration = 29 status = {"physical_disks_added":0}
54472024-11-13T05:20:10.072ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
54482024-11-13T05:20:10.079ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
54492024-11-13T05:20:10.079ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54502024-11-13T05:20:10.079ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bef982ea-abc3-4fb6-91f5-3e1b939716db", "content-length": "26", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
54512024-11-13T05:20:10.079ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54522024-11-13T05:20:10.080ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54532024-11-13T05:20:10.089ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
54542024-11-13T05:20:10.089ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 192.129879ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
54552024-11-13T05:20:10.241ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54562024-11-13T05:20:10.241ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54572024-11-13T05:20:10.242ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7cba2be-968d-4ba3-8386-76a6687b80c7", "content-length": "372", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
54582024-11-13T05:20:10.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54592024-11-13T05:20:10.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54602024-11-13T05:20:10.256ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
54612024-11-13T05:20:10.256ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54622024-11-13T05:20:10.257ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5a4c1151-c185-4f20-8c69-089e8725d217", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
54632024-11-13T05:20:10.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54642024-11-13T05:20:10.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54652024-11-13T05:20:10.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54662024-11-13T05:20:10.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54672024-11-13T05:20:10.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54682024-11-13T05:20:10.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54692024-11-13T05:20:10.266ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54702024-11-13T05:20:10.266ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54712024-11-13T05:20:10.266ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "53331f03-0b24-4d94-9222-e44b7ef8156d", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
54722024-11-13T05:20:10.268ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 370.74532ms iteration = 27 status = {}
54732024-11-13T05:20:10.279ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54742024-11-13T05:20:10.280ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "232dd621-30ad-4092-b1e8-07633ec98432", "content-length": "2", "date": "Wed, 13 Nov 2024 05:20:09 GMT"} })
54752024-11-13T05:20:10.282ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54762024-11-13T05:20:10.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54772024-11-13T05:20:10.284ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 386.819121ms iteration = 25 status = null
54782024-11-13T05:20:10.293ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 395.832849ms iteration = 25 status = {}
54792024-11-13T05:20:10.309ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
54802024-11-13T05:20:10.309ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54812024-11-13T05:20:10.310ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b323961-a5bc-405d-b903-dc9467c5d402", "content-length": "26", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
54822024-11-13T05:20:10.310ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54832024-11-13T05:20:10.311ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
54842024-11-13T05:20:10.323ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54852024-11-13T05:20:10.323ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5968466a-b838-4842-8db4-678e0266d531", "content-length": "691", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
54862024-11-13T05:20:10.323ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
54872024-11-13T05:20:10.323ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
54882024-11-13T05:20:10.323ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
54892024-11-13T05:20:10.325ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 428.067301ms iteration = 26 status = {}
54902024-11-13T05:20:10.337ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54912024-11-13T05:20:10.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5798e17b-40a9-4d6e-8277-e1756af678b5", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54922024-11-13T05:20:10.337ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54932024-11-13T05:20:10.339ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
54942024-11-13T05:20:10.340ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "48f721da-8129-4d43-9777-2de439b844f6", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54952024-11-13T05:20:10.340ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54962024-11-13T05:20:10.341ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54972024-11-13T05:20:10.341ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 444.160042ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
54982024-11-13T05:20:10.375ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54992024-11-13T05:20:10.375ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "72e38773-c1e8-427c-9dc1-f51d52955d13", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
55002024-11-13T05:20:10.375ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
55012024-11-13T05:20:10.377ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b72f1ebb-8487-400e-a53a-99d039d6cefc", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
55022024-11-13T05:20:10.377ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
55032024-11-13T05:20:10.378ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a7667d02-a417-418d-ba30-05827a24a7c6", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
55042024-11-13T05:20:10.378ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
55052024-11-13T05:20:10.380ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
55062024-11-13T05:20:10.380ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 482.651738ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
55072024-11-13T05:20:10.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55082024-11-13T05:20:10.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55092024-11-13T05:20:10.426ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
55102024-11-13T05:20:10.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55112024-11-13T05:20:10.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55122024-11-13T05:20:10.436ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55132024-11-13T05:20:10.436ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4624d5f-17e5-4356-a555-9a5e44706c69", "content-length": "134", "date": "Wed, 13 Nov 2024 05:20:09 GMT"} })
55142024-11-13T05:20:10.436ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55152024-11-13T05:20:10.436ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
55162024-11-13T05:20:10.436ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55172024-11-13T05:20:10.436ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55182024-11-13T05:20:10.436ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55192024-11-13T05:20:10.436ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55202024-11-13T05:20:10.436ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55212024-11-13T05:20:10.436ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55222024-11-13T05:20:10.437ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55232024-11-13T05:20:10.437ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55242024-11-13T05:20:10.437ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
55252024-11-13T05:20:10.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55262024-11-13T05:20:10.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55272024-11-13T05:20:10.439ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55282024-11-13T05:20:10.439ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "57e9f901-53b1-4eab-862f-18a5d65fa912", "content-length": "2", "date": "Wed, 13 Nov 2024 05:20:09 GMT"} })
55292024-11-13T05:20:10.439ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55302024-11-13T05:20:10.439ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fa22e92-ee72-43a7-88e7-3bbb742b93a1", "content-length": "52", "date": "Wed, 13 Nov 2024 05:20:09 GMT"} })
55312024-11-13T05:20:10.439ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
55322024-11-13T05:20:10.439ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55332024-11-13T05:20:10.541ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3926d55c-03fa-42ca-b664-1e055edac940", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
55342024-11-13T05:20:10.541ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
55352024-11-13T05:20:10.541ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55362024-11-13T05:20:10.541ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1cf3e3e-4867-4adf-afd0-a983da008767", "content-length": "682", "date": "Wed, 13 Nov 2024 05:20:10 GMT"} })
55372024-11-13T05:20:10.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55382024-11-13T05:20:10.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55392024-11-13T05:20:10.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55402024-11-13T05:20:10.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55412024-11-13T05:20:10.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55422024-11-13T05:20:10.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55432024-11-13T05:20:10.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55442024-11-13T05:20:10.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55452024-11-13T05:20:10.560ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.469719ms iteration = 25 status = {}
55462024-11-13T05:20:10.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1569 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 54703f38-4203-420f-a52c-bc1a5487e3f4 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
55472024-11-13T05:20:11.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14e38d7d-f6bb-48f3-82c6-625cf2ede69a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55482024-11-13T05:20:11.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14e38d7d-f6bb-48f3-82c6-625cf2ede69a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55492024-11-13T05:20:11.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14e38d7d-f6bb-48f3-82c6-625cf2ede69a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55502024-11-13T05:20:12.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2197f75-bc59-46cb-93b1-a060e9a8b2ad roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55512024-11-13T05:20:12.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2197f75-bc59-46cb-93b1-a060e9a8b2ad resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55522024-11-13T05:20:12.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2197f75-bc59-46cb-93b1-a060e9a8b2ad response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55532024-11-13T05:20:13.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9106a5ac-73ce-40ac-ad44-0eb14b46e73a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55542024-11-13T05:20:13.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9106a5ac-73ce-40ac-ad44-0eb14b46e73a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55552024-11-13T05:20:13.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9106a5ac-73ce-40ac-ad44-0eb14b46e73a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55562024-11-13T05:20:14.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 749e113b-d5ea-48e6-873f-b5d971ab982b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55572024-11-13T05:20:14.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 749e113b-d5ea-48e6-873f-b5d971ab982b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55582024-11-13T05:20:14.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 749e113b-d5ea-48e6-873f-b5d971ab982b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55592024-11-13T05:20:15.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a737cd83-3cb3-4d3c-adfb-26fb3aee6b1c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55602024-11-13T05:20:15.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a737cd83-3cb3-4d3c-adfb-26fb3aee6b1c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55612024-11-13T05:20:15.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a737cd83-3cb3-4d3c-adfb-26fb3aee6b1c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55622024-11-13T05:20:15.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 69435efb-2072-4bbf-a11c-f1329def9656 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
55632024-11-13T05:20:15.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 69435efb-2072-4bbf-a11c-f1329def9656 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
55642024-11-13T05:20:15.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 69435efb-2072-4bbf-a11c-f1329def9656 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
55652024-11-13T05:20:15.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = bba4bac0-d260-4680-b0a5-4e9415e0c6bf roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
55662024-11-13T05:20:15.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = bba4bac0-d260-4680-b0a5-4e9415e0c6bf resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
55672024-11-13T05:20:15.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = bba4bac0-d260-4680-b0a5-4e9415e0c6bf response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
55682024-11-13T05:20:16.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad2627cc-8540-47e5-91b8-f4afc24a8385 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55692024-11-13T05:20:16.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad2627cc-8540-47e5-91b8-f4afc24a8385 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55702024-11-13T05:20:16.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ad2627cc-8540-47e5-91b8-f4afc24a8385 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55712024-11-13T05:20:17.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0bc6a22f-cbac-453d-ad4f-4827b4134b0b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55722024-11-13T05:20:17.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0bc6a22f-cbac-453d-ad4f-4827b4134b0b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55732024-11-13T05:20:17.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0bc6a22f-cbac-453d-ad4f-4827b4134b0b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55742024-11-13T05:20:18.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b6b9262c-d1aa-4c68-b5cb-606209a18d22 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55752024-11-13T05:20:18.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b6b9262c-d1aa-4c68-b5cb-606209a18d22 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55762024-11-13T05:20:18.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b6b9262c-d1aa-4c68-b5cb-606209a18d22 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55772024-11-13T05:20:19.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6bb623bc-9486-4a32-9f74-5dc1cd2f28b8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55782024-11-13T05:20:19.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6bb623bc-9486-4a32-9f74-5dc1cd2f28b8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55792024-11-13T05:20:19.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6bb623bc-9486-4a32-9f74-5dc1cd2f28b8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
55802024-11-13T05:20:19.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
55812024-11-13T05:20:19.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
55822024-11-13T05:20:19.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55832024-11-13T05:20:19.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55842024-11-13T05:20:19.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55852024-11-13T05:20:19.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55862024-11-13T05:20:19.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55872024-11-13T05:20:19.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55882024-11-13T05:20:19.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55892024-11-13T05:20:19.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55902024-11-13T05:20:19.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55912024-11-13T05:20:19.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55922024-11-13T05:20:19.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55932024-11-13T05:20:19.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55942024-11-13T05:20:19.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55952024-11-13T05:20:19.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
55962024-11-13T05:20:19.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55972024-11-13T05:20:19.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55982024-11-13T05:20:19.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
55992024-11-13T05:20:19.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.847067ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
56002024-11-13T05:20:19.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.204182ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56012024-11-13T05:20:20.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f7bbc689-4fc4-41ac-823e-c0895b5c8c9e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56022024-11-13T05:20:20.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f7bbc689-4fc4-41ac-823e-c0895b5c8c9e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56032024-11-13T05:20:20.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f7bbc689-4fc4-41ac-823e-c0895b5c8c9e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56042024-11-13T05:20:21.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d6b2eb9-322e-4e7f-af8b-6dd22815e71c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56052024-11-13T05:20:21.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d6b2eb9-322e-4e7f-af8b-6dd22815e71c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56062024-11-13T05:20:21.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d6b2eb9-322e-4e7f-af8b-6dd22815e71c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56072024-11-13T05:20:22.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 596010cb-c495-4026-b07c-ce2187ab81f8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56082024-11-13T05:20:22.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 596010cb-c495-4026-b07c-ce2187ab81f8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56092024-11-13T05:20:22.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 596010cb-c495-4026-b07c-ce2187ab81f8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56102024-11-13T05:20:23.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e36cfbee-6b09-4c5e-9b5f-5cddf779c0a0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56112024-11-13T05:20:23.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e36cfbee-6b09-4c5e-9b5f-5cddf779c0a0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56122024-11-13T05:20:23.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e36cfbee-6b09-4c5e-9b5f-5cddf779c0a0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56132024-11-13T05:20:24.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a25d33c3-4392-4a9e-81bf-dc93ff8ad761 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56142024-11-13T05:20:24.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a25d33c3-4392-4a9e-81bf-dc93ff8ad761 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56152024-11-13T05:20:24.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a25d33c3-4392-4a9e-81bf-dc93ff8ad761 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56162024-11-13T05:20:25.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 741a9f5c-15bb-4c4e-804e-3bc4b4e5e984 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56172024-11-13T05:20:25.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 741a9f5c-15bb-4c4e-804e-3bc4b4e5e984 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56182024-11-13T05:20:25.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 741a9f5c-15bb-4c4e-804e-3bc4b4e5e984 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56192024-11-13T05:20:25.580ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1295 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = d666fd86-739b-42f7-9703-23b5b5f82451 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
56202024-11-13T05:20:26.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 103085ee-3a15-4626-9a7e-b2dca89c2be4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56212024-11-13T05:20:26.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 103085ee-3a15-4626-9a7e-b2dca89c2be4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56222024-11-13T05:20:26.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 103085ee-3a15-4626-9a7e-b2dca89c2be4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56232024-11-13T05:20:27.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 52c65bd7-f45e-476e-82a1-dbbede9b936c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56242024-11-13T05:20:27.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 52c65bd7-f45e-476e-82a1-dbbede9b936c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56252024-11-13T05:20:27.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 52c65bd7-f45e-476e-82a1-dbbede9b936c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56262024-11-13T05:20:28.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4dcdce4e-da19-42bf-9747-782a00b27ad9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56272024-11-13T05:20:28.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4dcdce4e-da19-42bf-9747-782a00b27ad9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56282024-11-13T05:20:28.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4dcdce4e-da19-42bf-9747-782a00b27ad9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56292024-11-13T05:20:29.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 62e56fab-3cc5-4984-aac8-a3eda0d12d69 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56302024-11-13T05:20:29.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 62e56fab-3cc5-4984-aac8-a3eda0d12d69 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56312024-11-13T05:20:29.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 62e56fab-3cc5-4984-aac8-a3eda0d12d69 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56322024-11-13T05:20:29.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
56332024-11-13T05:20:29.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
56342024-11-13T05:20:29.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56352024-11-13T05:20:29.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56362024-11-13T05:20:29.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56372024-11-13T05:20:29.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56382024-11-13T05:20:29.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56392024-11-13T05:20:29.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56402024-11-13T05:20:29.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56412024-11-13T05:20:29.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.725072ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56422024-11-13T05:20:29.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56432024-11-13T05:20:29.902ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56442024-11-13T05:20:29.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56452024-11-13T05:20:29.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56462024-11-13T05:20:29.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56472024-11-13T05:20:29.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56482024-11-13T05:20:29.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
56492024-11-13T05:20:29.909ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56502024-11-13T05:20:29.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56512024-11-13T05:20:29.918ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
56522024-11-13T05:20:29.918ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.216957ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
56532024-11-13T05:20:30.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 146fa4e4-4f1a-4427-8174-a13f72d4a931 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56542024-11-13T05:20:30.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 146fa4e4-4f1a-4427-8174-a13f72d4a931 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56552024-11-13T05:20:30.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 146fa4e4-4f1a-4427-8174-a13f72d4a931 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56562024-11-13T05:20:31.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 451c3796-e57a-4940-ad98-304ce23f18e2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56572024-11-13T05:20:31.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 451c3796-e57a-4940-ad98-304ce23f18e2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56582024-11-13T05:20:31.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 451c3796-e57a-4940-ad98-304ce23f18e2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56592024-11-13T05:20:32.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ce69bfaf-bb40-4294-857c-de0aa4b30053 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56602024-11-13T05:20:32.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ce69bfaf-bb40-4294-857c-de0aa4b30053 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56612024-11-13T05:20:32.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ce69bfaf-bb40-4294-857c-de0aa4b30053 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56622024-11-13T05:20:33.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 430d540e-ae81-4824-91ab-01988021c171 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56632024-11-13T05:20:33.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 430d540e-ae81-4824-91ab-01988021c171 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56642024-11-13T05:20:33.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 430d540e-ae81-4824-91ab-01988021c171 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56652024-11-13T05:20:34.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = efaa662c-e52f-458e-b8d9-925aa3a3ea61 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56662024-11-13T05:20:34.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = efaa662c-e52f-458e-b8d9-925aa3a3ea61 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56672024-11-13T05:20:34.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = efaa662c-e52f-458e-b8d9-925aa3a3ea61 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56682024-11-13T05:20:35.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 61daa0ce-8a77-4bc0-b56e-061247fc0a19 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56692024-11-13T05:20:35.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 61daa0ce-8a77-4bc0-b56e-061247fc0a19 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56702024-11-13T05:20:35.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 61daa0ce-8a77-4bc0-b56e-061247fc0a19 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56712024-11-13T05:20:36.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92dbcc06-5c3a-49e0-9d2b-22306340648c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56722024-11-13T05:20:36.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92dbcc06-5c3a-49e0-9d2b-22306340648c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56732024-11-13T05:20:36.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92dbcc06-5c3a-49e0-9d2b-22306340648c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56742024-11-13T05:20:37.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7223507-fb01-4f70-98e6-bc420aeeed84 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56752024-11-13T05:20:37.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7223507-fb01-4f70-98e6-bc420aeeed84 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56762024-11-13T05:20:37.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7223507-fb01-4f70-98e6-bc420aeeed84 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56772024-11-13T05:20:38.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 69f99551-d35b-4023-af12-13eebc8d1839 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56782024-11-13T05:20:38.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 69f99551-d35b-4023-af12-13eebc8d1839 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56792024-11-13T05:20:38.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 69f99551-d35b-4023-af12-13eebc8d1839 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56802024-11-13T05:20:39.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 316b6f5f-817f-4690-8d6f-8fae6c1ca818 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56812024-11-13T05:20:39.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 316b6f5f-817f-4690-8d6f-8fae6c1ca818 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56822024-11-13T05:20:39.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 316b6f5f-817f-4690-8d6f-8fae6c1ca818 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
56832024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
56842024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
56852024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
56862024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56872024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
56882024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
56892024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56902024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
56912024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
56922024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56932024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56942024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
56952024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56962024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
56972024-11-13T05:20:39.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56982024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
56992024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57002024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
57012024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57022024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57032024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
57042024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57052024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
57062024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57072024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
57082024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57092024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
57102024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57112024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
57122024-11-13T05:20:39.898ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57132024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
57142024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57152024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
57162024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57172024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57182024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57192024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57202024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57212024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57222024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57232024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57242024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57252024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57262024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57272024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57282024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57292024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57302024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57312024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57322024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57332024-11-13T05:20:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57342024-11-13T05:20:39.904ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.261135ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57352024-11-13T05:20:39.904ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.591277ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
57362024-11-13T05:20:39.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57372024-11-13T05:20:39.905ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57382024-11-13T05:20:39.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57392024-11-13T05:20:39.907ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57402024-11-13T05:20:39.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57412024-11-13T05:20:39.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57422024-11-13T05:20:39.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57432024-11-13T05:20:39.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57442024-11-13T05:20:39.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57452024-11-13T05:20:39.909ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57462024-11-13T05:20:39.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.754173ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
57472024-11-13T05:20:39.910ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57482024-11-13T05:20:39.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57492024-11-13T05:20:39.911ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5621, tv_nsec: 419047892 } })
57502024-11-13T05:20:39.911ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
57512024-11-13T05:20:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57522024-11-13T05:20:39.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57532024-11-13T05:20:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57542024-11-13T05:20:39.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57552024-11-13T05:20:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57562024-11-13T05:20:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57572024-11-13T05:20:39.914ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5621, tv_nsec: 422014747 } })
57582024-11-13T05:20:39.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57592024-11-13T05:20:39.914ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
57602024-11-13T05:20:39.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57612024-11-13T05:20:39.915ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57622024-11-13T05:20:39.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57632024-11-13T05:20:39.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57642024-11-13T05:20:39.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57652024-11-13T05:20:39.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57662024-11-13T05:20:39.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57672024-11-13T05:20:39.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57682024-11-13T05:20:39.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57692024-11-13T05:20:39.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57702024-11-13T05:20:39.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57712024-11-13T05:20:39.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57722024-11-13T05:20:39.920ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5621, tv_nsec: 427992950 } })
57732024-11-13T05:20:39.920ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
57742024-11-13T05:20:39.920ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57752024-11-13T05:20:39.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57762024-11-13T05:20:39.920ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57772024-11-13T05:20:39.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57782024-11-13T05:20:39.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
57792024-11-13T05:20:39.925ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57802024-11-13T05:20:39.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57812024-11-13T05:20:39.937ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822024-11-13T05:20:39.938ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57832024-11-13T05:20:39.938ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57842024-11-13T05:20:39.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57852024-11-13T05:20:39.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57862024-11-13T05:20:39.939ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
57872024-11-13T05:20:39.939ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.861376ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
57882024-11-13T05:20:39.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57892024-11-13T05:20:39.940ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57902024-11-13T05:20:39.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57912024-11-13T05:20:39.946ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57922024-11-13T05:20:39.946ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57932024-11-13T05:20:39.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57942024-11-13T05:20:39.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57952024-11-13T05:20:39.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57962024-11-13T05:20:39.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57972024-11-13T05:20:39.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.254179ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57982024-11-13T05:20:39.954ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57992024-11-13T05:20:39.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58002024-11-13T05:20:39.959ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58012024-11-13T05:20:39.959ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.84784ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58022024-11-13T05:20:39.998ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
58032024-11-13T05:20:39.998ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58042024-11-13T05:20:39.999ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12111a97-996d-42a1-9d88-699aae2a9d23", "content-length": "26", "date": "Wed, 13 Nov 2024 05:20:39 GMT"} })
58052024-11-13T05:20:39.999ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58062024-11-13T05:20:40.000ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
58072024-11-13T05:20:40.000ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58082024-11-13T05:20:40.001ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97c67283-aaaf-4a5e-aa27-babccd5862ea", "content-length": "26", "date": "Wed, 13 Nov 2024 05:20:39 GMT"} })
58092024-11-13T05:20:40.001ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58102024-11-13T05:20:40.001ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58112024-11-13T05:20:40.003ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58122024-11-13T05:20:40.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
58132024-11-13T05:20:40.008ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58142024-11-13T05:20:40.008ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccdb0b3b-3e68-4197-8e0e-c8369f4dd3d0", "content-length": "26", "date": "Wed, 13 Nov 2024 05:20:39 GMT"} })
58152024-11-13T05:20:40.008ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58162024-11-13T05:20:40.009ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
58172024-11-13T05:20:40.013ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58182024-11-13T05:20:40.013ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58192024-11-13T05:20:40.013ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9f63977-1a33-4fed-968c-2746ee975f45", "content-length": "372", "date": "Wed, 13 Nov 2024 05:20:40 GMT"} })
58202024-11-13T05:20:40.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58212024-11-13T05:20:40.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58222024-11-13T05:20:40.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.607119ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58232024-11-13T05:20:40.016ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.274934ms iteration = 30 status = {"physical_disks_added":0}
58242024-11-13T05:20:40.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58252024-11-13T05:20:40.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58262024-11-13T05:20:40.042ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58272024-11-13T05:20:40.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58282024-11-13T05:20:40.044ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58292024-11-13T05:20:40.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58302024-11-13T05:20:40.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58312024-11-13T05:20:40.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58322024-11-13T05:20:40.049ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 151.460044ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
58332024-11-13T05:20:40.055ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58342024-11-13T05:20:40.055ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58352024-11-13T05:20:40.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58362024-11-13T05:20:40.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58372024-11-13T05:20:40.067ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58382024-11-13T05:20:40.067ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58392024-11-13T05:20:40.067ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d22f5270-8e41-4549-b466-aeb1e06887e3", "date": "Wed, 13 Nov 2024 05:20:40 GMT"} })
58402024-11-13T05:20:40.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58412024-11-13T05:20:40.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58422024-11-13T05:20:40.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58432024-11-13T05:20:40.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58442024-11-13T05:20:40.073ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 175.633265ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
58452024-11-13T05:20:40.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58462024-11-13T05:20:40.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58472024-11-13T05:20:40.075ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58482024-11-13T05:20:40.076ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58492024-11-13T05:20:40.076ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58502024-11-13T05:20:40.077ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "31797305-92d6-44cb-b2f3-e46995c85db1", "date": "Wed, 13 Nov 2024 05:20:40 GMT"} })
58512024-11-13T05:20:40.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
58522024-11-13T05:20:40.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58532024-11-13T05:20:40.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58542024-11-13T05:20:40.078ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 180.812021ms iteration = 28 status = {}
58552024-11-13T05:20:40.080ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 182.689267ms iteration = 26 status = 0
58562024-11-13T05:20:40.086ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58572024-11-13T05:20:40.086ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58582024-11-13T05:20:40.086ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 188.818271ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58592024-11-13T05:20:40.119ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58602024-11-13T05:20:40.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58612024-11-13T05:20:40.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622024-11-13T05:20:40.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58632024-11-13T05:20:40.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58642024-11-13T05:20:40.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58652024-11-13T05:20:40.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58662024-11-13T05:20:40.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58672024-11-13T05:20:40.127ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58682024-11-13T05:20:40.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58692024-11-13T05:20:40.212ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58702024-11-13T05:20:40.212ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8bb5ad9-ff88-4306-a203-7b605f360610", "content-length": "2", "date": "Wed, 13 Nov 2024 05:20:39 GMT"} })
58712024-11-13T05:20:40.213ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58722024-11-13T05:20:40.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58732024-11-13T05:20:40.216ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 318.171331ms iteration = 26 status = null
58742024-11-13T05:20:40.221ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.195944ms iteration = 26 status = {}
58752024-11-13T05:20:40.259ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58762024-11-13T05:20:40.260ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed053188-d3dd-4ddc-a6b0-b6de8fbc5bf0", "content-length": "691", "date": "Wed, 13 Nov 2024 05:20:40 GMT"} })
58772024-11-13T05:20:40.260ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58782024-11-13T05:20:40.260ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
58792024-11-13T05:20:40.260ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
58802024-11-13T05:20:40.262ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 364.527846ms iteration = 27 status = {}
58812024-11-13T05:20:40.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58822024-11-13T05:20:40.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58832024-11-13T05:20:40.272ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
58842024-11-13T05:20:40.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58852024-11-13T05:20:40.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58862024-11-13T05:20:40.283ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58872024-11-13T05:20:40.283ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d680cbfb-cc4d-42f5-9dfd-792c8976860d", "content-length": "134", "date": "Wed, 13 Nov 2024 05:20:39 GMT"} })
58882024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
58892024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
58902024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58912024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58922024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58932024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58942024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58952024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58962024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58972024-11-13T05:20:40.283ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58982024-11-13T05:20:40.284ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
58992024-11-13T05:20:40.284ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59002024-11-13T05:20:40.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59012024-11-13T05:20:40.286ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
59022024-11-13T05:20:40.286ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "884377da-a7bb-4b44-a348-2219aa136d59", "content-length": "2", "date": "Wed, 13 Nov 2024 05:20:39 GMT"} })
59032024-11-13T05:20:40.286ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
59042024-11-13T05:20:40.286ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "849b47f3-7732-4b1c-a8b8-ced21a5135db", "content-length": "52", "date": "Wed, 13 Nov 2024 05:20:39 GMT"} })
59052024-11-13T05:20:40.286ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
59062024-11-13T05:20:40.286ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59072024-11-13T05:20:40.392ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7faa001a-796a-41aa-adeb-eb64e51c677b", "date": "Wed, 13 Nov 2024 05:20:40 GMT"} })
59082024-11-13T05:20:40.392ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
59092024-11-13T05:20:40.392ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59102024-11-13T05:20:40.392ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "823c9ba0-6b92-49f6-a99c-3d30ea8a6221", "content-length": "682", "date": "Wed, 13 Nov 2024 05:20:40 GMT"} })
59112024-11-13T05:20:40.392ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59122024-11-13T05:20:40.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59132024-11-13T05:20:40.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59142024-11-13T05:20:40.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59152024-11-13T05:20:40.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59162024-11-13T05:20:40.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59172024-11-13T05:20:40.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59182024-11-13T05:20:40.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59192024-11-13T05:20:40.409ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 511.802913ms iteration = 26 status = {}
59202024-11-13T05:20:40.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1457 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 0194435e-99d7-4e36-8749-e4c49fde1f74 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
59212024-11-13T05:20:40.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a86772fc-2be7-4d43-b592-34d806754d01 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59222024-11-13T05:20:40.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a86772fc-2be7-4d43-b592-34d806754d01 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59232024-11-13T05:20:40.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a86772fc-2be7-4d43-b592-34d806754d01 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59242024-11-13T05:20:41.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 83c08ba9-ad50-4620-818b-835e256c4b9e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59252024-11-13T05:20:41.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 83c08ba9-ad50-4620-818b-835e256c4b9e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59262024-11-13T05:20:41.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 83c08ba9-ad50-4620-818b-835e256c4b9e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59272024-11-13T05:20:42.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 888bea0a-fa2c-4357-9d4f-c11a8ab9b0a6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59282024-11-13T05:20:42.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 888bea0a-fa2c-4357-9d4f-c11a8ab9b0a6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59292024-11-13T05:20:42.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 888bea0a-fa2c-4357-9d4f-c11a8ab9b0a6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59302024-11-13T05:20:43.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f889b7ef-c9b3-4a1e-b615-28b1550d19bf roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59312024-11-13T05:20:43.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f889b7ef-c9b3-4a1e-b615-28b1550d19bf resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59322024-11-13T05:20:43.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2375 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f889b7ef-c9b3-4a1e-b615-28b1550d19bf response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59332024-11-13T05:20:44.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f8ee2c5a-7d4d-4902-b848-11a824036fe6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59342024-11-13T05:20:44.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f8ee2c5a-7d4d-4902-b848-11a824036fe6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59352024-11-13T05:20:44.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f8ee2c5a-7d4d-4902-b848-11a824036fe6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59362024-11-13T05:20:45.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c48dc3ff-9d0d-428c-b16a-5196916284fe roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
59372024-11-13T05:20:45.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c48dc3ff-9d0d-428c-b16a-5196916284fe resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
59382024-11-13T05:20:45.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = c48dc3ff-9d0d-428c-b16a-5196916284fe response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
59392024-11-13T05:20:45.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 253152f8-6f99-41bf-86cf-0ea53e4fc23e roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
59402024-11-13T05:20:45.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 253152f8-6f99-41bf-86cf-0ea53e4fc23e resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
59412024-11-13T05:20:45.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 253152f8-6f99-41bf-86cf-0ea53e4fc23e response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
59422024-11-13T05:20:45.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7a10b94c-3315-4384-890f-c860d3292472 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59432024-11-13T05:20:45.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7a10b94c-3315-4384-890f-c860d3292472 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59442024-11-13T05:20:45.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7a10b94c-3315-4384-890f-c860d3292472 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59452024-11-13T05:20:46.726ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50480
59462024-11-13T05:20:46.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50480 req_id = d4a8eab8-174c-4c3b-9165-c91abc36b790 roles = RoleSet { roles: {} } uri = /metrics/producers
59472024-11-13T05:20:46.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50480 req_id = d4a8eab8-174c-4c3b-9165-c91abc36b790 resource = Database result = Ok(()) uri = /metrics/producers
59482024-11-13T05:20:46.765ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 4d997277-f640-48d7-af56-6df261d5afe1
59492024-11-13T05:20:46.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38857 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50480 req_id = d4a8eab8-174c-4c3b-9165-c91abc36b790 response_code = 201 uri = /metrics/producers
59502024-11-13T05:20:46.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89228bb9-03de-4e31-800b-de68c4758a82 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59512024-11-13T05:20:46.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89228bb9-03de-4e31-800b-de68c4758a82 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59522024-11-13T05:20:46.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89228bb9-03de-4e31-800b-de68c4758a82 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59532024-11-13T05:20:47.022ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40057
59542024-11-13T05:20:47.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40057 req_id = ed53ff31-3881-403c-8dff-c8df54e4a1a6 roles = RoleSet { roles: {} } uri = /metrics/producers
59552024-11-13T05:20:47.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40057 req_id = ed53ff31-3881-403c-8dff-c8df54e4a1a6 resource = Database result = Ok(()) uri = /metrics/producers
59562024-11-13T05:20:47.058ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 10a586d4-9652-4a30-9058-49973290a890
59572024-11-13T05:20:47.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35669 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40057 req_id = ed53ff31-3881-403c-8dff-c8df54e4a1a6 response_code = 201 uri = /metrics/producers
59582024-11-13T05:20:47.692ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:32946
59592024-11-13T05:20:47.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32946 req_id = 9a55b98f-271f-47a4-aeaa-5b7b4a20ca33 roles = RoleSet { roles: {} } uri = /metrics/producers
59602024-11-13T05:20:47.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32946 req_id = 9a55b98f-271f-47a4-aeaa-5b7b4a20ca33 resource = Database result = Ok(()) uri = /metrics/producers
59612024-11-13T05:20:47.727ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = eb1311f8-6807-471a-a8f7-8fe643dea75d
59622024-11-13T05:20:47.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34515 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:32946 req_id = 9a55b98f-271f-47a4-aeaa-5b7b4a20ca33 response_code = 201 uri = /metrics/producers
59632024-11-13T05:20:47.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92b72efc-c51f-4073-88f5-db3e1823089d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59642024-11-13T05:20:47.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92b72efc-c51f-4073-88f5-db3e1823089d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59652024-11-13T05:20:47.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 92b72efc-c51f-4073-88f5-db3e1823089d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59662024-11-13T05:20:48.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 47476136-f391-4f7e-9bf9-d4190d42b22e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59672024-11-13T05:20:48.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 47476136-f391-4f7e-9bf9-d4190d42b22e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59682024-11-13T05:20:48.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 47476136-f391-4f7e-9bf9-d4190d42b22e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59692024-11-13T05:20:49.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
59702024-11-13T05:20:49.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59712024-11-13T05:20:49.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
59722024-11-13T05:20:49.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59732024-11-13T05:20:49.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59742024-11-13T05:20:49.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59752024-11-13T05:20:49.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59762024-11-13T05:20:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59772024-11-13T05:20:49.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59782024-11-13T05:20:49.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59792024-11-13T05:20:49.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59802024-11-13T05:20:49.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59812024-11-13T05:20:49.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59822024-11-13T05:20:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59832024-11-13T05:20:49.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59842024-11-13T05:20:49.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
59852024-11-13T05:20:49.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59862024-11-13T05:20:49.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59872024-11-13T05:20:49.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
59882024-11-13T05:20:49.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.746578ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
59892024-11-13T05:20:49.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.495195ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59902024-11-13T05:20:49.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d22fe631-83e1-48f5-b2ff-89ac4b41c04f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59912024-11-13T05:20:49.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d22fe631-83e1-48f5-b2ff-89ac4b41c04f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59922024-11-13T05:20:49.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1583 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d22fe631-83e1-48f5-b2ff-89ac4b41c04f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59932024-11-13T05:20:50.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cbafd48e-2e1c-409b-95f6-f21a588308eb roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59942024-11-13T05:20:50.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cbafd48e-2e1c-409b-95f6-f21a588308eb resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59952024-11-13T05:20:50.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cbafd48e-2e1c-409b-95f6-f21a588308eb response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59962024-11-13T05:20:51.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 11483e12-f083-4f68-84a6-53a26c32833b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59972024-11-13T05:20:51.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 11483e12-f083-4f68-84a6-53a26c32833b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59982024-11-13T05:20:51.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 11483e12-f083-4f68-84a6-53a26c32833b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
59992024-11-13T05:20:53.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ea377623-964b-43bf-aad4-26b7f5769311 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60002024-11-13T05:20:53.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ea377623-964b-43bf-aad4-26b7f5769311 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60012024-11-13T05:20:53.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ea377623-964b-43bf-aad4-26b7f5769311 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60022024-11-13T05:20:54.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c6f7baca-e9a7-4595-9ba0-4b694a74a04b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60032024-11-13T05:20:54.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c6f7baca-e9a7-4595-9ba0-4b694a74a04b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60042024-11-13T05:20:54.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c6f7baca-e9a7-4595-9ba0-4b694a74a04b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60052024-11-13T05:20:55.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 15e3d1bd-db37-4b08-82c5-419ab35a1a5a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60062024-11-13T05:20:55.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 15e3d1bd-db37-4b08-82c5-419ab35a1a5a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60072024-11-13T05:20:55.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 15e3d1bd-db37-4b08-82c5-419ab35a1a5a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60082024-11-13T05:20:55.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1688 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = a0ce62ba-878b-45ec-bc17-a217a3474d6b response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
60092024-11-13T05:20:56.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5ad0f483-a55d-4628-a766-b4806bdbec36 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60102024-11-13T05:20:56.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5ad0f483-a55d-4628-a766-b4806bdbec36 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60112024-11-13T05:20:56.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5ad0f483-a55d-4628-a766-b4806bdbec36 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60122024-11-13T05:20:57.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7d8b5161-932b-4310-afbf-01b3853d5054 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60132024-11-13T05:20:57.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7d8b5161-932b-4310-afbf-01b3853d5054 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60142024-11-13T05:20:57.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7d8b5161-932b-4310-afbf-01b3853d5054 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60152024-11-13T05:20:58.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d780fcf-4de0-4e87-b336-4d316c3b275e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60162024-11-13T05:20:58.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d780fcf-4de0-4e87-b336-4d316c3b275e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60172024-11-13T05:20:58.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8d780fcf-4de0-4e87-b336-4d316c3b275e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60182024-11-13T05:20:59.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 57d6acee-c93c-42a9-89ec-4b125a6208fa roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60192024-11-13T05:20:59.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 57d6acee-c93c-42a9-89ec-4b125a6208fa resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60202024-11-13T05:20:59.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2555 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 57d6acee-c93c-42a9-89ec-4b125a6208fa response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60212024-11-13T05:20:59.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
60222024-11-13T05:20:59.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
60232024-11-13T05:20:59.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60242024-11-13T05:20:59.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60252024-11-13T05:20:59.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60262024-11-13T05:20:59.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60272024-11-13T05:20:59.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60282024-11-13T05:20:59.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60292024-11-13T05:20:59.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60302024-11-13T05:20:59.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60312024-11-13T05:20:59.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60322024-11-13T05:20:59.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60332024-11-13T05:20:59.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60342024-11-13T05:20:59.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60352024-11-13T05:20:59.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60362024-11-13T05:20:59.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
60372024-11-13T05:20:59.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60382024-11-13T05:20:59.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60392024-11-13T05:20:59.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
60402024-11-13T05:20:59.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.528236ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
60412024-11-13T05:20:59.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.977372ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60422024-11-13T05:21:00.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4b10012-8460-42b2-b724-45a2c49e0ca3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60432024-11-13T05:21:00.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4b10012-8460-42b2-b724-45a2c49e0ca3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60442024-11-13T05:21:00.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4b10012-8460-42b2-b724-45a2c49e0ca3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60452024-11-13T05:21:00.898ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:43750
60462024-11-13T05:21:00.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43750 req_id = 84f5e9bb-d39f-4bc3-b2de-2982d71f1313 roles = RoleSet { roles: {} } uri = /metrics/producers
60472024-11-13T05:21:00.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43750 req_id = 84f5e9bb-d39f-4bc3-b2de-2982d71f1313 resource = Database result = Ok(()) uri = /metrics/producers
60482024-11-13T05:21:00.938ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 31913a62-fea3-4aea-8cf3-f0c6569df8d6
60492024-11-13T05:21:00.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39950 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43750 req_id = 84f5e9bb-d39f-4bc3-b2de-2982d71f1313 response_code = 201 uri = /metrics/producers
60502024-11-13T05:21:01.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dfa7099c-be34-47de-a560-e82296ebb7ec roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60512024-11-13T05:21:01.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dfa7099c-be34-47de-a560-e82296ebb7ec resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60522024-11-13T05:21:01.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dfa7099c-be34-47de-a560-e82296ebb7ec response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60532024-11-13T05:21:02.122ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:62896
60542024-11-13T05:21:02.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62896 req_id = 60a8a90b-1e76-44b5-a89f-292e925ba118 roles = RoleSet { roles: {} } uri = /metrics/producers
60552024-11-13T05:21:02.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62896 req_id = 60a8a90b-1e76-44b5-a89f-292e925ba118 resource = Database result = Ok(()) uri = /metrics/producers
60562024-11-13T05:21:02.159ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 059eb401-7fec-4da1-95e5-eea11ccf6ab1
60572024-11-13T05:21:02.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36750 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62896 req_id = 60a8a90b-1e76-44b5-a89f-292e925ba118 response_code = 201 uri = /metrics/producers
60582024-11-13T05:21:02.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23205b27-67af-4aa2-8896-b19731d63f40 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60592024-11-13T05:21:02.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23205b27-67af-4aa2-8896-b19731d63f40 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60602024-11-13T05:21:02.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23205b27-67af-4aa2-8896-b19731d63f40 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60612024-11-13T05:21:03.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e15fad36-22d7-48cf-a700-07c3998c70cf roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60622024-11-13T05:21:03.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e15fad36-22d7-48cf-a700-07c3998c70cf resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60632024-11-13T05:21:03.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e15fad36-22d7-48cf-a700-07c3998c70cf response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60642024-11-13T05:21:04.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e10ea146-403a-4a95-ae30-0fc0cb1bf63c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60652024-11-13T05:21:04.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e10ea146-403a-4a95-ae30-0fc0cb1bf63c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60662024-11-13T05:21:04.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e10ea146-403a-4a95-ae30-0fc0cb1bf63c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60672024-11-13T05:21:04.946ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38874
60682024-11-13T05:21:04.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38874 req_id = 2ddd07b8-5600-42f0-8979-dc8d6746c83c roles = RoleSet { roles: {} } uri = /metrics/producers
60692024-11-13T05:21:04.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38874 req_id = 2ddd07b8-5600-42f0-8979-dc8d6746c83c resource = Database result = Ok(()) uri = /metrics/producers
60702024-11-13T05:21:04.953ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 05102f67-14d0-4743-98e7-bdad704b43e5
60712024-11-13T05:21:04.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7721 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38874 req_id = 2ddd07b8-5600-42f0-8979-dc8d6746c83c response_code = 201 uri = /metrics/producers
60722024-11-13T05:21:05.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 162d2333-49c8-4201-848c-7edf76c554cf roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60732024-11-13T05:21:05.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 162d2333-49c8-4201-848c-7edf76c554cf resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60742024-11-13T05:21:05.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 162d2333-49c8-4201-848c-7edf76c554cf response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60752024-11-13T05:21:06.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1f643026-e592-48e7-b823-2b993f5b7faf roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60762024-11-13T05:21:06.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1f643026-e592-48e7-b823-2b993f5b7faf resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60772024-11-13T05:21:06.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 1f643026-e592-48e7-b823-2b993f5b7faf response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60782024-11-13T05:21:07.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dda228fc-33b7-49da-81d6-069d0e4c55d2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60792024-11-13T05:21:07.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dda228fc-33b7-49da-81d6-069d0e4c55d2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60802024-11-13T05:21:07.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dda228fc-33b7-49da-81d6-069d0e4c55d2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60812024-11-13T05:21:08.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d05d865c-f75d-422f-9698-a87e8062651c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60822024-11-13T05:21:08.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d05d865c-f75d-422f-9698-a87e8062651c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60832024-11-13T05:21:08.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d05d865c-f75d-422f-9698-a87e8062651c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60842024-11-13T05:21:09.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a6895155-d732-4a88-bf65-25dac7d06993 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60852024-11-13T05:21:09.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a6895155-d732-4a88-bf65-25dac7d06993 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60862024-11-13T05:21:09.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a6895155-d732-4a88-bf65-25dac7d06993 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
60872024-11-13T05:21:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
60882024-11-13T05:21:09.897ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60892024-11-13T05:21:09.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60902024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60912024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
60922024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60932024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
60942024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60952024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
60962024-11-13T05:21:09.898ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60972024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
60982024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60992024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
61002024-11-13T05:21:09.898ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-13 05:11:09.898430771 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61012024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
61022024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61032024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61042024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61052024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
61062024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
61072024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
61082024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61092024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61102024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
61112024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
61122024-11-13T05:21:09.898ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
61132024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61142024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61152024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
61162024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61172024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
61182024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61192024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
61202024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61212024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
61222024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
61232024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
61242024-11-13T05:21:09.898ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71
61252024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.11\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71"}
61262024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
61272024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61282024-11-13T05:21:09.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
61292024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
61302024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61312024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61322024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61332024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
61342024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
61352024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61362024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61372024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
61382024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61392024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
61402024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61412024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
61422024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61432024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
61442024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
61452024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
61462024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61472024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
61482024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61492024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61502024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61512024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61522024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61532024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61542024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61552024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61562024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61572024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61582024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61592024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61602024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61612024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61622024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61632024-11-13T05:21:09.899ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("038e4c2b-2408-42f1-b025-c88f1167faaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5651, tv_nsec: 407038977 } })
61642024-11-13T05:21:09.899ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("105858cb-d3d5-4677-95c0-079ffa1259be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b62b18b5-c7f6-48f0-ab56-4213f6de7d44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5651, tv_nsec: 407073537 } })
61652024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61662024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61672024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61682024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61692024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61702024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61712024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61722024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61732024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61742024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61752024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61762024-11-13T05:21:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61772024-11-13T05:21:09.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
61782024-11-13T05:21:09.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.604234ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
61792024-11-13T05:21:09.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
61802024-11-13T05:21:09.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.401722ms iteration = 15 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
61812024-11-13T05:21:09.901ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61822024-11-13T05:21:09.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61832024-11-13T05:21:09.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61842024-11-13T05:21:09.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61852024-11-13T05:21:09.903ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.54745ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61862024-11-13T05:21:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61872024-11-13T05:21:09.904ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61882024-11-13T05:21:09.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5651, tv_nsec: 412170802 } })
61892024-11-13T05:21:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61902024-11-13T05:21:09.904ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
61912024-11-13T05:21:09.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61922024-11-13T05:21:09.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61932024-11-13T05:21:09.904ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61942024-11-13T05:21:09.904ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61952024-11-13T05:21:09.904ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.450156ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61962024-11-13T05:21:09.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61972024-11-13T05:21:09.906ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-13 05:11:09.898430771 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61982024-11-13T05:21:09.906ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.424454ms iteration = 14 status = {"expiration":"2024-11-13T05:11:09.898430771Z","pruned":[]}
61992024-11-13T05:21:09.907ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5651, tv_nsec: 414975496 } })
62002024-11-13T05:21:09.907ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
62012024-11-13T05:21:09.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62022024-11-13T05:21:09.909ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62032024-11-13T05:21:09.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62042024-11-13T05:21:09.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62052024-11-13T05:21:09.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62062024-11-13T05:21:09.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62072024-11-13T05:21:09.911ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62082024-11-13T05:21:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62092024-11-13T05:21:09.914ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62102024-11-13T05:21:09.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62112024-11-13T05:21:09.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62122024-11-13T05:21:09.917ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62132024-11-13T05:21:09.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62142024-11-13T05:21:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62152024-11-13T05:21:09.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62162024-11-13T05:21:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62172024-11-13T05:21:09.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62182024-11-13T05:21:09.920ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.7832ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
62192024-11-13T05:21:09.921ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5651, tv_nsec: 429307591 } })
62202024-11-13T05:21:09.922ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
62212024-11-13T05:21:09.922ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62222024-11-13T05:21:09.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62232024-11-13T05:21:09.922ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62242024-11-13T05:21:09.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62252024-11-13T05:21:09.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62262024-11-13T05:21:09.926ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62272024-11-13T05:21:09.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62282024-11-13T05:21:09.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62292024-11-13T05:21:09.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
62302024-11-13T05:21:09.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62312024-11-13T05:21:09.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62322024-11-13T05:21:09.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62332024-11-13T05:21:09.936ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.622148ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
62342024-11-13T05:21:09.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
62352024-11-13T05:21:09.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62362024-11-13T05:21:09.937ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62372024-11-13T05:21:09.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62382024-11-13T05:21:09.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.952389ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
62392024-11-13T05:21:09.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62402024-11-13T05:21:09.940ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62412024-11-13T05:21:09.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62422024-11-13T05:21:09.941ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62432024-11-13T05:21:09.942ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62442024-11-13T05:21:09.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62452024-11-13T05:21:09.944ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62462024-11-13T05:21:09.944ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62472024-11-13T05:21:09.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62482024-11-13T05:21:09.944ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62492024-11-13T05:21:09.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62502024-11-13T05:21:09.949ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62512024-11-13T05:21:09.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62522024-11-13T05:21:09.952ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62532024-11-13T05:21:09.952ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62542024-11-13T05:21:09.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62552024-11-13T05:21:09.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62562024-11-13T05:21:09.955ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
62572024-11-13T05:21:09.955ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
62582024-11-13T05:21:09.955ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62592024-11-13T05:21:09.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62602024-11-13T05:21:09.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62612024-11-13T05:21:09.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62622024-11-13T05:21:09.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62632024-11-13T05:21:09.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62642024-11-13T05:21:09.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62652024-11-13T05:21:09.965ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62662024-11-13T05:21:09.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62672024-11-13T05:21:09.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62682024-11-13T05:21:09.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62692024-11-13T05:21:09.966ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62702024-11-13T05:21:09.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62712024-11-13T05:21:09.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62722024-11-13T05:21:09.967ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62732024-11-13T05:21:09.967ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62742024-11-13T05:21:09.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62752024-11-13T05:21:09.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62762024-11-13T05:21:09.968ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.82949ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62772024-11-13T05:21:09.969ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62782024-11-13T05:21:09.970ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
62792024-11-13T05:21:09.970ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.372224ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
62802024-11-13T05:21:09.970ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62812024-11-13T05:21:09.970ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62822024-11-13T05:21:09.970ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62832024-11-13T05:21:09.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62842024-11-13T05:21:09.982ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62852024-11-13T05:21:09.982ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.924574ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62862024-11-13T05:21:09.986ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62872024-11-13T05:21:09.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62882024-11-13T05:21:09.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 88.453583ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62892024-11-13T05:21:09.988ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62902024-11-13T05:21:09.988ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62912024-11-13T05:21:09.988ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.147808ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62922024-11-13T05:21:09.988ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62932024-11-13T05:21:09.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62942024-11-13T05:21:09.990ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62952024-11-13T05:21:09.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62962024-11-13T05:21:09.994ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62972024-11-13T05:21:09.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62982024-11-13T05:21:09.996ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62992024-11-13T05:21:09.998ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 99.591771ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63002024-11-13T05:21:09.999ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63012024-11-13T05:21:09.999ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63022024-11-13T05:21:09.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63032024-11-13T05:21:10.002ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
63042024-11-13T05:21:10.002ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 103.770847ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63052024-11-13T05:21:10.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63062024-11-13T05:21:10.002ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.188301ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63072024-11-13T05:21:10.004ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63082024-11-13T05:21:10.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63092024-11-13T05:21:10.005ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63102024-11-13T05:21:10.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63112024-11-13T05:21:10.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63122024-11-13T05:21:10.013ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63132024-11-13T05:21:10.014ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63142024-11-13T05:21:10.014ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63152024-11-13T05:21:10.014ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63162024-11-13T05:21:10.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63172024-11-13T05:21:10.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63182024-11-13T05:21:10.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63192024-11-13T05:21:10.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
63202024-11-13T05:21:10.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63212024-11-13T05:21:10.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63222024-11-13T05:21:10.018ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63232024-11-13T05:21:10.018ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63242024-11-13T05:21:10.018ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.532765ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63252024-11-13T05:21:10.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63262024-11-13T05:21:10.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63272024-11-13T05:21:10.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63282024-11-13T05:21:10.021ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.063906ms iteration = 27 status = 0
63292024-11-13T05:21:10.030ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-13T05:08:08.157062Z, time_modified: 2024-11-13T05:08:08.157062Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }) }
63302024-11-13T05:21:10.030ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 131.777882ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]}},"default_endpoint":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63312024-11-13T05:21:10.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63322024-11-13T05:21:10.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63332024-11-13T05:21:10.039ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63342024-11-13T05:21:10.039ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 0 version = 2
63352024-11-13T05:21:10.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63362024-11-13T05:21:10.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63372024-11-13T05:21:10.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63382024-11-13T05:21:10.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63392024-11-13T05:21:10.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63402024-11-13T05:21:10.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63412024-11-13T05:21:10.043ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
63422024-11-13T05:21:10.043ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63432024-11-13T05:21:10.043ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f32c25f-ad9d-4572-8819-725f9c7e7b66", "content-length": "26", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
63442024-11-13T05:21:10.043ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63452024-11-13T05:21:10.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63462024-11-13T05:21:10.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63472024-11-13T05:21:10.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63482024-11-13T05:21:10.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63492024-11-13T05:21:10.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63502024-11-13T05:21:10.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63512024-11-13T05:21:10.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63522024-11-13T05:21:10.045ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63532024-11-13T05:21:10.046ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 1 version = 2
63542024-11-13T05:21:10.046ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63552024-11-13T05:21:10.046ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-13 05:08:54.834359 UTC dns_group = external generation = 2
63562024-11-13T05:21:10.046ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 147.62256ms iteration = 15 status = {"generation":2}
63572024-11-13T05:21:10.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63582024-11-13T05:21:10.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63592024-11-13T05:21:10.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63602024-11-13T05:21:10.050ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63612024-11-13T05:21:10.050ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63622024-11-13T05:21:10.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63632024-11-13T05:21:10.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63642024-11-13T05:21:10.052ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63652024-11-13T05:21:10.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63662024-11-13T05:21:10.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63672024-11-13T05:21:10.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63682024-11-13T05:21:10.057ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
63692024-11-13T05:21:10.057ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63702024-11-13T05:21:10.057ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-13 05:08:54.008257 UTC dns_group = internal generation = 1
63712024-11-13T05:21:10.057ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 159.550065ms iteration = 15 status = {"generation":1}
63722024-11-13T05:21:10.059ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
63732024-11-13T05:21:10.059ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63742024-11-13T05:21:10.059ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23ce3726-3ddd-4ad9-a991-f0e287ea5bcf", "content-length": "26", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
63752024-11-13T05:21:10.059ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63762024-11-13T05:21:10.061ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63772024-11-13T05:21:10.076ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
63782024-11-13T05:21:10.076ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63792024-11-13T05:21:10.077ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f46ce7ee-152a-4716-986f-231d541f3f71", "content-length": "26", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
63802024-11-13T05:21:10.077ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63812024-11-13T05:21:10.082ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
63822024-11-13T05:21:10.102ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.882012ms iteration = 31 status = {"physical_disks_added":0}
63832024-11-13T05:21:10.198ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63842024-11-13T05:21:10.199ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "96661a65-93c9-4d9f-8d7e-1aaf1907f69f", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63852024-11-13T05:21:10.199ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63862024-11-13T05:21:10.200ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "01b1cf4f-ad85-41c7-8931-421b9ec4098b", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63872024-11-13T05:21:10.200ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63882024-11-13T05:21:10.202ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63892024-11-13T05:21:10.202ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 303.547863ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63902024-11-13T05:21:10.232ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 334.368292ms iteration = 27 status = {}
63912024-11-13T05:21:10.259ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63922024-11-13T05:21:10.259ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3b084b9-d23c-45ed-9448-7cbdfc830e62", "content-length": "2", "date": "Wed, 13 Nov 2024 05:21:09 GMT"} })
63932024-11-13T05:21:10.261ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63942024-11-13T05:21:10.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63952024-11-13T05:21:10.266ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63962024-11-13T05:21:10.266ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8373bff4-c730-4a0f-b107-0266434bc7f9", "content-length": "691", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
63972024-11-13T05:21:10.266ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63982024-11-13T05:21:10.266ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63992024-11-13T05:21:10.266ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64002024-11-13T05:21:10.267ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 369.423869ms iteration = 27 status = null
64012024-11-13T05:21:10.268ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 369.667601ms iteration = 28 status = {}
64022024-11-13T05:21:10.304ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64032024-11-13T05:21:10.341ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64042024-11-13T05:21:10.341ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64052024-11-13T05:21:10.341ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c40a82f-c539-49bb-906f-cc4c3a17503c", "content-length": "372", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
64062024-11-13T05:21:10.341ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64072024-11-13T05:21:10.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64082024-11-13T05:21:10.355ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64092024-11-13T05:21:10.355ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64102024-11-13T05:21:10.355ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cc1e12d7-90c4-4c42-b787-7a94595d33f2", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
64112024-11-13T05:21:10.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64122024-11-13T05:21:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64132024-11-13T05:21:10.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64142024-11-13T05:21:10.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64152024-11-13T05:21:10.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64162024-11-13T05:21:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64172024-11-13T05:21:10.364ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64182024-11-13T05:21:10.364ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64192024-11-13T05:21:10.364ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f0776018-c9cf-4357-80b6-718c8dd69075", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
64202024-11-13T05:21:10.365ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 467.570546ms iteration = 29 status = {}
64212024-11-13T05:21:10.389ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64222024-11-13T05:21:10.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d1452316-d0a6-45c5-a488-5b36e824aaee", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64232024-11-13T05:21:10.390ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64242024-11-13T05:21:10.392ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1bc92b0d-51f8-47e9-b70a-27cd3c40bc4a", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64252024-11-13T05:21:10.392ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64262024-11-13T05:21:10.394ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "19745e44-b580-4265-9e0b-9f446dcd0339", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64272024-11-13T05:21:10.394ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64282024-11-13T05:21:10.395ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
64292024-11-13T05:21:10.395ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 496.978473ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64302024-11-13T05:21:10.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64312024-11-13T05:21:10.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64322024-11-13T05:21:10.403ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
64332024-11-13T05:21:10.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64342024-11-13T05:21:10.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64352024-11-13T05:21:10.413ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64362024-11-13T05:21:10.413ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "afbdc4d0-ec6d-4d48-b739-823cd8daa096", "content-length": "134", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
64372024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64382024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
64392024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64402024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64412024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64422024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64432024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64442024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64452024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64462024-11-13T05:21:10.413ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64472024-11-13T05:21:10.414ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
64482024-11-13T05:21:10.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64492024-11-13T05:21:10.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64502024-11-13T05:21:10.416ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64512024-11-13T05:21:10.416ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2598c01b-84fc-40c4-995a-9bd3feadb818", "content-length": "2", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
64522024-11-13T05:21:10.416ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64532024-11-13T05:21:10.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ab98bf3-b603-4974-9f3c-a7297438a175", "content-length": "52", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
64542024-11-13T05:21:10.417ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
64552024-11-13T05:21:10.417ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64562024-11-13T05:21:10.522ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08eee4c0-56ed-414d-869c-ae47eaa394db", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
64572024-11-13T05:21:10.522ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
64582024-11-13T05:21:10.522ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64592024-11-13T05:21:10.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 59d72036-74bc-4f81-b2f4-2eb48e276380 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64602024-11-13T05:21:10.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 59d72036-74bc-4f81-b2f4-2eb48e276380 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64612024-11-13T05:21:10.522ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8315a31-4240-4c82-98e7-6c688793d83a", "content-length": "682", "date": "Wed, 13 Nov 2024 05:21:10 GMT"} })
64622024-11-13T05:21:10.522ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64632024-11-13T05:21:10.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64642024-11-13T05:21:10.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 59d72036-74bc-4f81-b2f4-2eb48e276380 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64652024-11-13T05:21:10.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64662024-11-13T05:21:10.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64672024-11-13T05:21:10.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64682024-11-13T05:21:10.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64692024-11-13T05:21:10.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64702024-11-13T05:21:10.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64712024-11-13T05:21:10.538ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 640.453088ms iteration = 27 status = {}
64722024-11-13T05:21:10.581ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1454 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = b7780351-0f18-475f-b0c9-56dff60ed0bb response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
64732024-11-13T05:21:11.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 02733c61-3b0b-4dbc-8ad1-b473cb8abbe1 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64742024-11-13T05:21:11.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 02733c61-3b0b-4dbc-8ad1-b473cb8abbe1 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64752024-11-13T05:21:11.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 02733c61-3b0b-4dbc-8ad1-b473cb8abbe1 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64762024-11-13T05:21:12.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f682900d-00ca-4026-b407-66778aab8325 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64772024-11-13T05:21:12.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f682900d-00ca-4026-b407-66778aab8325 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64782024-11-13T05:21:12.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f682900d-00ca-4026-b407-66778aab8325 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64792024-11-13T05:21:13.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 74104c61-96ed-47f5-85b5-7fd357d65364 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64802024-11-13T05:21:13.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 74104c61-96ed-47f5-85b5-7fd357d65364 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64812024-11-13T05:21:13.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 74104c61-96ed-47f5-85b5-7fd357d65364 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64822024-11-13T05:21:14.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7e79d1d-a5c3-49d4-b3e2-6af2b29d6e58 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64832024-11-13T05:21:14.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7e79d1d-a5c3-49d4-b3e2-6af2b29d6e58 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64842024-11-13T05:21:14.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b7e79d1d-a5c3-49d4-b3e2-6af2b29d6e58 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64852024-11-13T05:21:15.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5f3dffe7-cdcd-4da0-9731-004dfb001c67 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64862024-11-13T05:21:15.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5f3dffe7-cdcd-4da0-9731-004dfb001c67 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64872024-11-13T05:21:15.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2711 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5f3dffe7-cdcd-4da0-9731-004dfb001c67 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64882024-11-13T05:21:16.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7492ce6e-cec2-4dbf-b4cd-078d15e10390 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64892024-11-13T05:21:16.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7492ce6e-cec2-4dbf-b4cd-078d15e10390 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64902024-11-13T05:21:16.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7492ce6e-cec2-4dbf-b4cd-078d15e10390 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64912024-11-13T05:21:17.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9365339f-fd9e-4dd6-8672-daeb409f287c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64922024-11-13T05:21:17.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9365339f-fd9e-4dd6-8672-daeb409f287c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64932024-11-13T05:21:17.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9365339f-fd9e-4dd6-8672-daeb409f287c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64942024-11-13T05:21:18.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f4e00980-5111-409f-acf0-ad5cfe0b14f0 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64952024-11-13T05:21:18.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f4e00980-5111-409f-acf0-ad5cfe0b14f0 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64962024-11-13T05:21:18.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f4e00980-5111-409f-acf0-ad5cfe0b14f0 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64972024-11-13T05:21:19.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 18d3afe5-8fa3-445b-a395-12844dc4daeb roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64982024-11-13T05:21:19.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 18d3afe5-8fa3-445b-a395-12844dc4daeb resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
64992024-11-13T05:21:19.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 18d3afe5-8fa3-445b-a395-12844dc4daeb response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65002024-11-13T05:21:19.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
65012024-11-13T05:21:19.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
65022024-11-13T05:21:19.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65032024-11-13T05:21:19.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65042024-11-13T05:21:19.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65052024-11-13T05:21:19.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65062024-11-13T05:21:19.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65072024-11-13T05:21:19.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65082024-11-13T05:21:19.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65092024-11-13T05:21:19.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65102024-11-13T05:21:19.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65112024-11-13T05:21:19.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65122024-11-13T05:21:19.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65132024-11-13T05:21:19.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
65142024-11-13T05:21:19.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65152024-11-13T05:21:19.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65162024-11-13T05:21:19.922ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
65172024-11-13T05:21:19.922ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.457294ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
65182024-11-13T05:21:19.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65192024-11-13T05:21:19.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65202024-11-13T05:21:19.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.352443ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65212024-11-13T05:21:20.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b88273ae-07b6-429d-b0e2-a5ebc705479b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65222024-11-13T05:21:20.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b88273ae-07b6-429d-b0e2-a5ebc705479b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65232024-11-13T05:21:20.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b88273ae-07b6-429d-b0e2-a5ebc705479b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65242024-11-13T05:21:21.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f0f5750a-6cee-46c0-ac88-0543051edb9f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65252024-11-13T05:21:21.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f0f5750a-6cee-46c0-ac88-0543051edb9f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65262024-11-13T05:21:21.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f0f5750a-6cee-46c0-ac88-0543051edb9f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65272024-11-13T05:21:22.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 42bbc1c1-64d8-4926-84f2-013f700a01f7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65282024-11-13T05:21:22.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 42bbc1c1-64d8-4926-84f2-013f700a01f7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65292024-11-13T05:21:22.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 42bbc1c1-64d8-4926-84f2-013f700a01f7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65302024-11-13T05:21:23.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7d5b1500-e330-41b0-b775-bc12b94339a9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65312024-11-13T05:21:23.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7d5b1500-e330-41b0-b775-bc12b94339a9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65322024-11-13T05:21:23.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7d5b1500-e330-41b0-b775-bc12b94339a9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65332024-11-13T05:21:24.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51e3a68a-0950-445c-a24f-f232bfbcf23a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65342024-11-13T05:21:24.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51e3a68a-0950-445c-a24f-f232bfbcf23a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65352024-11-13T05:21:24.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51e3a68a-0950-445c-a24f-f232bfbcf23a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65362024-11-13T05:21:25.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1536 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 306186de-8a83-4596-8fa2-c130fb0a3213 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
65372024-11-13T05:21:25.855ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
65382024-11-13T05:21:25.855ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
65392024-11-13T05:21:25.885ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
65402024-11-13T05:21:25.885ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:48508
65412024-11-13T05:21:25.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48508 req_id = 991d0591-26ed-4132-aa79-546f3cdf2e5c roles = RoleSet { roles: {} } uri = /metrics/producers
65422024-11-13T05:21:25.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48508 req_id = 991d0591-26ed-4132-aa79-546f3cdf2e5c resource = Database result = Ok(()) uri = /metrics/producers
65432024-11-13T05:21:25.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bfe9fcb2-6028-4e78-97b5-7272b096c187 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65442024-11-13T05:21:25.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bfe9fcb2-6028-4e78-97b5-7272b096c187 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65452024-11-13T05:21:25.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bfe9fcb2-6028-4e78-97b5-7272b096c187 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65462024-11-13T05:21:25.895ZINFOnexus: assigned collector to new producer collector_id = 671c6402-97d6-48bd-9991-5554bd96a514 file = nexus/src/app/oximeter.rs:76 producer_id = 6c4893ca-1b18-4910-8b18-504e5fcb8dc5
65472024-11-13T05:21:25.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9027 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48508 req_id = 991d0591-26ed-4132-aa79-546f3cdf2e5c response_code = 201 uri = /metrics/producers
65482024-11-13T05:21:25.895ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "991d0591-26ed-4132-aa79-546f3cdf2e5c", "content-length": "41", "date": "Wed, 13 Nov 2024 05:21:25 GMT"} })
65492024-11-13T05:21:25.896ZDEBGnexus (producer-registration-task): registered with nexus successfully
65502024-11-13T05:21:25.896ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
65512024-11-13T05:21:26.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2f64413-d8bd-4318-a1ec-1bdd335f17ce roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65522024-11-13T05:21:26.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2f64413-d8bd-4318-a1ec-1bdd335f17ce resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65532024-11-13T05:21:26.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2f64413-d8bd-4318-a1ec-1bdd335f17ce response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65542024-11-13T05:21:27.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51cc0d63-749c-4ab4-89e6-408945f54d22 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65552024-11-13T05:21:27.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51cc0d63-749c-4ab4-89e6-408945f54d22 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65562024-11-13T05:21:27.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 51cc0d63-749c-4ab4-89e6-408945f54d22 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65572024-11-13T05:21:28.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2c2c1ac8-9293-4fce-aac3-075cbbbe680a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65582024-11-13T05:21:28.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2c2c1ac8-9293-4fce-aac3-075cbbbe680a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65592024-11-13T05:21:28.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2c2c1ac8-9293-4fce-aac3-075cbbbe680a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65602024-11-13T05:21:29.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
65612024-11-13T05:21:29.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
65622024-11-13T05:21:29.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65632024-11-13T05:21:29.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65642024-11-13T05:21:29.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65652024-11-13T05:21:29.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65662024-11-13T05:21:29.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65672024-11-13T05:21:29.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65682024-11-13T05:21:29.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65692024-11-13T05:21:29.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65702024-11-13T05:21:29.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65712024-11-13T05:21:29.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65722024-11-13T05:21:29.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65732024-11-13T05:21:29.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
65742024-11-13T05:21:29.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65752024-11-13T05:21:29.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65762024-11-13T05:21:29.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
65772024-11-13T05:21:29.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.077635ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
65782024-11-13T05:21:29.925ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65792024-11-13T05:21:29.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65802024-11-13T05:21:29.926ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.52369ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65812024-11-13T05:21:29.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4f62f4c5-6e2a-4fac-930a-f75022873752 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65822024-11-13T05:21:29.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4f62f4c5-6e2a-4fac-930a-f75022873752 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65832024-11-13T05:21:29.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2193 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4f62f4c5-6e2a-4fac-930a-f75022873752 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65842024-11-13T05:21:31.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bb48da6b-ab23-450a-86fb-0f390995da4f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65852024-11-13T05:21:31.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bb48da6b-ab23-450a-86fb-0f390995da4f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65862024-11-13T05:21:31.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = bb48da6b-ab23-450a-86fb-0f390995da4f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65872024-11-13T05:21:32.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c73a6c80-3d97-4a85-8fdd-7495d48105a9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65882024-11-13T05:21:32.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c73a6c80-3d97-4a85-8fdd-7495d48105a9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65892024-11-13T05:21:32.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2786 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c73a6c80-3d97-4a85-8fdd-7495d48105a9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65902024-11-13T05:21:33.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f1839e12-c63e-43d8-b5f4-bb4c92032ef7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65912024-11-13T05:21:33.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f1839e12-c63e-43d8-b5f4-bb4c92032ef7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65922024-11-13T05:21:33.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f1839e12-c63e-43d8-b5f4-bb4c92032ef7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65932024-11-13T05:21:34.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 301376a0-5e80-4469-9893-9d688f443e8f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65942024-11-13T05:21:34.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 301376a0-5e80-4469-9893-9d688f443e8f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65952024-11-13T05:21:34.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 301376a0-5e80-4469-9893-9d688f443e8f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65962024-11-13T05:21:35.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = aab698a3-ff62-4362-adc6-35ee2cdfcc73 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65972024-11-13T05:21:35.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = aab698a3-ff62-4362-adc6-35ee2cdfcc73 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65982024-11-13T05:21:35.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = aab698a3-ff62-4362-adc6-35ee2cdfcc73 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
65992024-11-13T05:21:36.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0d4bf3a9-9126-4266-942e-f70c1d3f3d67 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66002024-11-13T05:21:36.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0d4bf3a9-9126-4266-942e-f70c1d3f3d67 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66012024-11-13T05:21:36.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0d4bf3a9-9126-4266-942e-f70c1d3f3d67 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66022024-11-13T05:21:37.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eec41f83-9365-4245-8cb5-6ec564c278f3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66032024-11-13T05:21:37.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eec41f83-9365-4245-8cb5-6ec564c278f3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66042024-11-13T05:21:37.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = eec41f83-9365-4245-8cb5-6ec564c278f3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66052024-11-13T05:21:38.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2c28dec-b615-40d7-ab20-a46457ecfd1c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66062024-11-13T05:21:38.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2c28dec-b615-40d7-ab20-a46457ecfd1c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66072024-11-13T05:21:38.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d2c28dec-b615-40d7-ab20-a46457ecfd1c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66082024-11-13T05:21:39.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ab6a291c-204b-4267-b8dd-09d7937a29f2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66092024-11-13T05:21:39.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ab6a291c-204b-4267-b8dd-09d7937a29f2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66102024-11-13T05:21:39.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ab6a291c-204b-4267-b8dd-09d7937a29f2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
66112024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
66122024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
66132024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66142024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66152024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
66162024-11-13T05:21:39.898ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66172024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
66182024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66192024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
66202024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66212024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66222024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
66232024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
66242024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66252024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
66262024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66272024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
66282024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66292024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
66302024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
66312024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66322024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66332024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
66342024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66352024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66362024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
66372024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66382024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
66392024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66402024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
66412024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66422024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
66432024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
66442024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66452024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66462024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66472024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66482024-11-13T05:21:39.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66492024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66502024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66512024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66522024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66532024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66542024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66552024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66562024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66572024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66582024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66592024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66602024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66612024-11-13T05:21:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66622024-11-13T05:21:39.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66632024-11-13T05:21:39.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 2.976296ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
66642024-11-13T05:21:39.902ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.926464ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66652024-11-13T05:21:39.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66662024-11-13T05:21:39.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66672024-11-13T05:21:39.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66682024-11-13T05:21:39.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66692024-11-13T05:21:39.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66702024-11-13T05:21:39.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66712024-11-13T05:21:39.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66722024-11-13T05:21:39.905ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66732024-11-13T05:21:39.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66742024-11-13T05:21:39.905ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5681, tv_nsec: 412975708 } })
66752024-11-13T05:21:39.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
66762024-11-13T05:21:39.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66772024-11-13T05:21:39.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66782024-11-13T05:21:39.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66792024-11-13T05:21:39.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66802024-11-13T05:21:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66812024-11-13T05:21:39.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66822024-11-13T05:21:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66832024-11-13T05:21:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66842024-11-13T05:21:39.909ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66852024-11-13T05:21:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66862024-11-13T05:21:39.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.4351ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
66872024-11-13T05:21:39.912ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5681, tv_nsec: 419758968 } })
66882024-11-13T05:21:39.912ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
66892024-11-13T05:21:39.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66902024-11-13T05:21:39.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5681, tv_nsec: 421142310 } })
66912024-11-13T05:21:39.914ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
66922024-11-13T05:21:39.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66932024-11-13T05:21:39.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66942024-11-13T05:21:39.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66952024-11-13T05:21:39.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66962024-11-13T05:21:39.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66972024-11-13T05:21:39.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66982024-11-13T05:21:39.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66992024-11-13T05:21:39.924ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67002024-11-13T05:21:39.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67012024-11-13T05:21:39.926ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67022024-11-13T05:21:39.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67032024-11-13T05:21:39.935ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67042024-11-13T05:21:39.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67052024-11-13T05:21:39.936ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67062024-11-13T05:21:39.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67072024-11-13T05:21:39.937ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.9595ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67082024-11-13T05:21:39.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67092024-11-13T05:21:39.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67102024-11-13T05:21:39.945ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67112024-11-13T05:21:39.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67122024-11-13T05:21:39.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67132024-11-13T05:21:39.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67142024-11-13T05:21:39.947ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67152024-11-13T05:21:39.947ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67162024-11-13T05:21:39.947ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67172024-11-13T05:21:39.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67182024-11-13T05:21:39.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67192024-11-13T05:21:39.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67202024-11-13T05:21:39.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67212024-11-13T05:21:39.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67222024-11-13T05:21:39.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67232024-11-13T05:21:39.949ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67242024-11-13T05:21:39.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67252024-11-13T05:21:39.951ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67262024-11-13T05:21:39.951ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.887213ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67272024-11-13T05:21:39.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
67282024-11-13T05:21:39.952ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67292024-11-13T05:21:39.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67302024-11-13T05:21:39.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67312024-11-13T05:21:39.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67322024-11-13T05:21:39.954ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.253002ms iteration = 28 status = 0
67332024-11-13T05:21:39.966ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 67.896024ms iteration = 32 status = {"physical_disks_added":0}
67342024-11-13T05:21:39.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.967391ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67352024-11-13T05:21:39.977ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67362024-11-13T05:21:39.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67372024-11-13T05:21:39.979ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 81.153299ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67382024-11-13T05:21:39.982ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67392024-11-13T05:21:39.982ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67402024-11-13T05:21:39.982ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67412024-11-13T05:21:39.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67422024-11-13T05:21:39.985ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67432024-11-13T05:21:39.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
67442024-11-13T05:21:39.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67452024-11-13T05:21:39.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67462024-11-13T05:21:39.990ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.824732ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67472024-11-13T05:21:39.998ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
67482024-11-13T05:21:39.998ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 99.797322ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
67492024-11-13T05:21:40.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67502024-11-13T05:21:40.013ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67512024-11-13T05:21:40.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67522024-11-13T05:21:40.013ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67532024-11-13T05:21:40.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.472381ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67542024-11-13T05:21:40.017ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
67552024-11-13T05:21:40.017ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67562024-11-13T05:21:40.017ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c51648f-eac6-4bb6-b26b-8adc8ffee2e4", "content-length": "26", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
67572024-11-13T05:21:40.017ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67582024-11-13T05:21:40.020ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
67592024-11-13T05:21:40.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67602024-11-13T05:21:40.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67612024-11-13T05:21:40.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67622024-11-13T05:21:40.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67632024-11-13T05:21:40.103ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67642024-11-13T05:21:40.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67652024-11-13T05:21:40.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67662024-11-13T05:21:40.107ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67672024-11-13T05:21:40.107ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67682024-11-13T05:21:40.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67692024-11-13T05:21:40.115ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
67702024-11-13T05:21:40.115ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67712024-11-13T05:21:40.115ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d35ea9c4-78e2-46dd-9a2f-e0a4d449b7e3", "content-length": "26", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
67722024-11-13T05:21:40.115ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67732024-11-13T05:21:40.116ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67742024-11-13T05:21:40.214ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
67752024-11-13T05:21:40.214ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67762024-11-13T05:21:40.214ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5f46ed5-ae12-4086-b8d0-fe8fd2ed4e72", "content-length": "26", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
67772024-11-13T05:21:40.214ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67782024-11-13T05:21:40.216ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67792024-11-13T05:21:40.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6699d721-d937-464b-91ee-8f881a1addab roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
67802024-11-13T05:21:40.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6699d721-d937-464b-91ee-8f881a1addab resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
67812024-11-13T05:21:40.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6699d721-d937-464b-91ee-8f881a1addab response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
67822024-11-13T05:21:40.274ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67832024-11-13T05:21:40.275ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e23239f-3a71-4e89-9862-7d6ac360538e", "content-length": "691", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
67842024-11-13T05:21:40.275ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
67852024-11-13T05:21:40.275ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
67862024-11-13T05:21:40.275ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
67872024-11-13T05:21:40.277ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 378.498068ms iteration = 29 status = {}
67882024-11-13T05:21:40.291ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67892024-11-13T05:21:40.291ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67902024-11-13T05:21:40.292ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc0f780-bc8d-4106-b063-fca34bc6780a", "content-length": "372", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
67912024-11-13T05:21:40.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67922024-11-13T05:21:40.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67932024-11-13T05:21:40.306ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67942024-11-13T05:21:40.306ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67952024-11-13T05:21:40.306ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bbc05009-1b3a-480d-b995-ff2e7e192c80", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
67962024-11-13T05:21:40.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67972024-11-13T05:21:40.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67982024-11-13T05:21:40.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67992024-11-13T05:21:40.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68002024-11-13T05:21:40.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68012024-11-13T05:21:40.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68022024-11-13T05:21:40.315ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68032024-11-13T05:21:40.315ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68042024-11-13T05:21:40.315ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "62902a92-b11c-4e14-84ed-104d66f2c082", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
68052024-11-13T05:21:40.317ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 419.265844ms iteration = 30 status = {}
68062024-11-13T05:21:40.359ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 460.768738ms iteration = 28 status = {}
68072024-11-13T05:21:40.363ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68082024-11-13T05:21:40.363ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0a717fe-1f1f-4ee9-984b-ea076ba096a3", "content-length": "2", "date": "Wed, 13 Nov 2024 05:21:39 GMT"} })
68092024-11-13T05:21:40.365ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68102024-11-13T05:21:40.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68112024-11-13T05:21:40.368ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 469.783266ms iteration = 28 status = null
68122024-11-13T05:21:40.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68132024-11-13T05:21:40.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68142024-11-13T05:21:40.405ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
68152024-11-13T05:21:40.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68162024-11-13T05:21:40.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68172024-11-13T05:21:40.414ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68182024-11-13T05:21:40.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bf7b387-09f7-4d12-89a5-4b5cd39e54cb", "content-length": "134", "date": "Wed, 13 Nov 2024 05:21:39 GMT"} })
68192024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68202024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
68212024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68222024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68232024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68242024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68252024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68262024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68272024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68282024-11-13T05:21:40.414ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68292024-11-13T05:21:40.415ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
68302024-11-13T05:21:40.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68312024-11-13T05:21:40.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68322024-11-13T05:21:40.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68332024-11-13T05:21:40.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ceb9592-6146-43ec-818c-54224c0913d1", "content-length": "2", "date": "Wed, 13 Nov 2024 05:21:39 GMT"} })
68342024-11-13T05:21:40.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68352024-11-13T05:21:40.417ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb99669e-5775-41d3-8f48-dee30b465186", "content-length": "52", "date": "Wed, 13 Nov 2024 05:21:39 GMT"} })
68362024-11-13T05:21:40.417ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
68372024-11-13T05:21:40.417ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68382024-11-13T05:21:40.524ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "800afbc2-4397-4247-959c-ca6b6b476ad2", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
68392024-11-13T05:21:40.524ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
68402024-11-13T05:21:40.524ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68412024-11-13T05:21:40.524ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdba625c-0792-4ee0-a7ce-8fd3e7bf0376", "content-length": "682", "date": "Wed, 13 Nov 2024 05:21:40 GMT"} })
68422024-11-13T05:21:40.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68432024-11-13T05:21:40.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68442024-11-13T05:21:40.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68452024-11-13T05:21:40.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68462024-11-13T05:21:40.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68472024-11-13T05:21:40.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68482024-11-13T05:21:40.535ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68492024-11-13T05:21:40.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68502024-11-13T05:21:40.542ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 644.570514ms iteration = 28 status = {}
68512024-11-13T05:21:40.585ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1279 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = af574630-b8a3-4a3b-93bc-cac3a010a720 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
68522024-11-13T05:21:41.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3feec331-0e48-4a09-861e-cece257ab8c6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68532024-11-13T05:21:41.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3feec331-0e48-4a09-861e-cece257ab8c6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68542024-11-13T05:21:41.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3feec331-0e48-4a09-861e-cece257ab8c6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68552024-11-13T05:21:42.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dd92a0ab-a69e-4d9a-a520-1c7a3f47e4c6 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68562024-11-13T05:21:42.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dd92a0ab-a69e-4d9a-a520-1c7a3f47e4c6 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68572024-11-13T05:21:42.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dd92a0ab-a69e-4d9a-a520-1c7a3f47e4c6 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68582024-11-13T05:21:43.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 557e953c-6549-4532-858a-eb1a685a2eeb roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68592024-11-13T05:21:43.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 557e953c-6549-4532-858a-eb1a685a2eeb resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68602024-11-13T05:21:43.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 557e953c-6549-4532-858a-eb1a685a2eeb response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68612024-11-13T05:21:44.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 803c9577-156b-4182-8a49-b39a33a6d09f roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68622024-11-13T05:21:44.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 803c9577-156b-4182-8a49-b39a33a6d09f resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68632024-11-13T05:21:44.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 803c9577-156b-4182-8a49-b39a33a6d09f response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68642024-11-13T05:21:45.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9f22f6a8-4ac6-4645-97e9-c4cc98e1048b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68652024-11-13T05:21:45.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9f22f6a8-4ac6-4645-97e9-c4cc98e1048b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68662024-11-13T05:21:45.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9f22f6a8-4ac6-4645-97e9-c4cc98e1048b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68672024-11-13T05:21:45.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 62db1962-d1ff-4e13-ab0b-0a78ff2c48a8 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
68682024-11-13T05:21:45.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 62db1962-d1ff-4e13-ab0b-0a78ff2c48a8 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
68692024-11-13T05:21:45.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 62db1962-d1ff-4e13-ab0b-0a78ff2c48a8 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
68702024-11-13T05:21:45.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ecf33cd3-6b25-4b9c-8db1-bec8aa1e7cb0 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
68712024-11-13T05:21:45.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ecf33cd3-6b25-4b9c-8db1-bec8aa1e7cb0 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
68722024-11-13T05:21:45.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = ecf33cd3-6b25-4b9c-8db1-bec8aa1e7cb0 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
68732024-11-13T05:21:46.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f530aae8-c885-4e13-a3f7-df6ba9331b1b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68742024-11-13T05:21:46.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f530aae8-c885-4e13-a3f7-df6ba9331b1b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68752024-11-13T05:21:46.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = f530aae8-c885-4e13-a3f7-df6ba9331b1b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68762024-11-13T05:21:47.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = db5fe823-b4b1-46b7-9414-715bcc0c33ae roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68772024-11-13T05:21:47.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = db5fe823-b4b1-46b7-9414-715bcc0c33ae resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68782024-11-13T05:21:47.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = db5fe823-b4b1-46b7-9414-715bcc0c33ae response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68792024-11-13T05:21:48.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 16245d5e-cab9-49b6-bca9-ecf842c56eb2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68802024-11-13T05:21:48.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 16245d5e-cab9-49b6-bca9-ecf842c56eb2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68812024-11-13T05:21:48.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 16245d5e-cab9-49b6-bca9-ecf842c56eb2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68822024-11-13T05:21:49.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 40aca83a-52c1-4054-b2ff-cfd460ece629 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68832024-11-13T05:21:49.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 40aca83a-52c1-4054-b2ff-cfd460ece629 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68842024-11-13T05:21:49.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 40aca83a-52c1-4054-b2ff-cfd460ece629 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
68852024-11-13T05:21:49.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
68862024-11-13T05:21:49.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
68872024-11-13T05:21:49.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68882024-11-13T05:21:49.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68892024-11-13T05:21:49.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68902024-11-13T05:21:49.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68912024-11-13T05:21:49.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68922024-11-13T05:21:49.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68932024-11-13T05:21:49.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68942024-11-13T05:21:49.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.965414ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68952024-11-13T05:21:49.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68962024-11-13T05:21:49.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68972024-11-13T05:21:49.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68982024-11-13T05:21:49.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68992024-11-13T05:21:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69002024-11-13T05:21:49.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69012024-11-13T05:21:49.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
69022024-11-13T05:21:49.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69032024-11-13T05:21:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69042024-11-13T05:21:49.919ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
69052024-11-13T05:21:49.919ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.021624ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
69062024-11-13T05:21:50.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cc8c84e6-bfb0-4913-b56c-83b885ded126 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69072024-11-13T05:21:50.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cc8c84e6-bfb0-4913-b56c-83b885ded126 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69082024-11-13T05:21:50.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = cc8c84e6-bfb0-4913-b56c-83b885ded126 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69092024-11-13T05:21:51.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4d2ecdc-3f65-469d-ad5a-d206e17074f3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69102024-11-13T05:21:51.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4d2ecdc-3f65-469d-ad5a-d206e17074f3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69112024-11-13T05:21:51.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a4d2ecdc-3f65-469d-ad5a-d206e17074f3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69122024-11-13T05:21:52.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e58305dc-03b6-4538-9fd6-d953e5c8592b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69132024-11-13T05:21:52.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e58305dc-03b6-4538-9fd6-d953e5c8592b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69142024-11-13T05:21:52.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e58305dc-03b6-4538-9fd6-d953e5c8592b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69152024-11-13T05:21:53.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8c65b86e-14d8-4ca4-a082-2775aaab54e4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69162024-11-13T05:21:53.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8c65b86e-14d8-4ca4-a082-2775aaab54e4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69172024-11-13T05:21:53.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8c65b86e-14d8-4ca4-a082-2775aaab54e4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69182024-11-13T05:21:54.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3433f673-07d8-47d5-903a-422f9b14960d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69192024-11-13T05:21:54.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3433f673-07d8-47d5-903a-422f9b14960d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69202024-11-13T05:21:54.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 3433f673-07d8-47d5-903a-422f9b14960d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69212024-11-13T05:21:55.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1327 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = c3c46ed9-d479-46e3-8228-dc965589d3e9 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
69222024-11-13T05:21:55.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8bd9f3e0-365e-4a6a-9000-976e124cfbab roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69232024-11-13T05:21:55.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8bd9f3e0-365e-4a6a-9000-976e124cfbab resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69242024-11-13T05:21:55.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8bd9f3e0-365e-4a6a-9000-976e124cfbab response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69252024-11-13T05:21:56.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a154f86a-ea4f-498e-97e3-71386439353b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69262024-11-13T05:21:56.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a154f86a-ea4f-498e-97e3-71386439353b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69272024-11-13T05:21:56.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a154f86a-ea4f-498e-97e3-71386439353b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69282024-11-13T05:21:57.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 08d870b8-5676-4364-b02e-2b44e3d2c3d3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69292024-11-13T05:21:57.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 08d870b8-5676-4364-b02e-2b44e3d2c3d3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69302024-11-13T05:21:57.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 08d870b8-5676-4364-b02e-2b44e3d2c3d3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69312024-11-13T05:21:58.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c3b313e6-df22-43ce-a991-0aa4120921c7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69322024-11-13T05:21:58.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c3b313e6-df22-43ce-a991-0aa4120921c7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69332024-11-13T05:21:58.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c3b313e6-df22-43ce-a991-0aa4120921c7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69342024-11-13T05:21:59.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2575004-7f48-41c9-ad7d-3bc54d352ccd roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69352024-11-13T05:21:59.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2575004-7f48-41c9-ad7d-3bc54d352ccd resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69362024-11-13T05:21:59.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e2575004-7f48-41c9-ad7d-3bc54d352ccd response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69372024-11-13T05:21:59.898ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
69382024-11-13T05:21:59.898ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
69392024-11-13T05:21:59.898ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69402024-11-13T05:21:59.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69412024-11-13T05:21:59.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69422024-11-13T05:21:59.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69432024-11-13T05:21:59.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69442024-11-13T05:21:59.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69452024-11-13T05:21:59.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.62641ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69462024-11-13T05:21:59.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69472024-11-13T05:21:59.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69482024-11-13T05:21:59.930ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69492024-11-13T05:21:59.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69502024-11-13T05:21:59.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69512024-11-13T05:21:59.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69522024-11-13T05:21:59.934ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69532024-11-13T05:21:59.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
69542024-11-13T05:21:59.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69552024-11-13T05:21:59.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69562024-11-13T05:21:59.946ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
69572024-11-13T05:21:59.946ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.424105ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
69582024-11-13T05:22:00.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7823e7ab-e43f-454e-bf7e-67c61e1177a7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69592024-11-13T05:22:00.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7823e7ab-e43f-454e-bf7e-67c61e1177a7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69602024-11-13T05:22:00.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7823e7ab-e43f-454e-bf7e-67c61e1177a7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69612024-11-13T05:22:01.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6b0e1f42-fe78-462c-a863-e021362bfaa4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69622024-11-13T05:22:01.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6b0e1f42-fe78-462c-a863-e021362bfaa4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69632024-11-13T05:22:01.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 6b0e1f42-fe78-462c-a863-e021362bfaa4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69642024-11-13T05:22:02.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4fcf144d-9991-4061-aa75-a5d0ff543c21 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69652024-11-13T05:22:02.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4fcf144d-9991-4061-aa75-a5d0ff543c21 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69662024-11-13T05:22:02.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4fcf144d-9991-4061-aa75-a5d0ff543c21 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69672024-11-13T05:22:03.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4dfc149-ced2-4684-bd70-855b34c63ac9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69682024-11-13T05:22:03.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4dfc149-ced2-4684-bd70-855b34c63ac9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69692024-11-13T05:22:03.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4dfc149-ced2-4684-bd70-855b34c63ac9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69702024-11-13T05:22:04.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 970238bc-8f1d-4ca6-bf09-6b41ddca44f5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69712024-11-13T05:22:04.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 970238bc-8f1d-4ca6-bf09-6b41ddca44f5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69722024-11-13T05:22:04.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 970238bc-8f1d-4ca6-bf09-6b41ddca44f5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69732024-11-13T05:22:05.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7417c585-ae6a-4b09-b198-e20377c91cc4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69742024-11-13T05:22:05.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7417c585-ae6a-4b09-b198-e20377c91cc4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69752024-11-13T05:22:05.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7417c585-ae6a-4b09-b198-e20377c91cc4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69762024-11-13T05:22:06.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7ae61b4c-b732-453f-96c9-85dd29bc5806 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69772024-11-13T05:22:06.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7ae61b4c-b732-453f-96c9-85dd29bc5806 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69782024-11-13T05:22:06.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7ae61b4c-b732-453f-96c9-85dd29bc5806 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69792024-11-13T05:22:07.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 989f834b-8ff2-4228-bb26-4f0e542ff4ab roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69802024-11-13T05:22:07.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 989f834b-8ff2-4228-bb26-4f0e542ff4ab resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69812024-11-13T05:22:07.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 989f834b-8ff2-4228-bb26-4f0e542ff4ab response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69822024-11-13T05:22:08.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4b235523-ac89-44c9-891c-500928c017fd roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69832024-11-13T05:22:08.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4b235523-ac89-44c9-891c-500928c017fd resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69842024-11-13T05:22:08.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4b235523-ac89-44c9-891c-500928c017fd response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
69852024-11-13T05:22:09.897ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
69862024-11-13T05:22:09.897ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
69872024-11-13T05:22:09.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69882024-11-13T05:22:09.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69892024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
69902024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69912024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
69922024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
69932024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69942024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
69952024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69962024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
69972024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69982024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69992024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
70002024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
70012024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
70022024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
70032024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
70042024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70052024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70062024-11-13T05:22:09.899ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
70072024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70082024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
70092024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70102024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
70112024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
70122024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70132024-11-13T05:22:09.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70142024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70152024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70162024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
70172024-11-13T05:22:09.899ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-13 05:12:09.899256482 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70182024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70192024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
70202024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
70212024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70222024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70232024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
70242024-11-13T05:22:09.899ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71
70252024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.58\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71"}
70262024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
70272024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
70282024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
70292024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70302024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70312024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
70322024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
70332024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
70342024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
70352024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70362024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70372024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
70382024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
70392024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70402024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
70412024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
70422024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70432024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70442024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
70452024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
70462024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
70472024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
70482024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
70492024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70502024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70512024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
70522024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70532024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70542024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70552024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70562024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70572024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
70582024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70592024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
70602024-11-13T05:22:09.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70612024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70622024-11-13T05:22:09.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("105858cb-d3d5-4677-95c0-079ffa1259be.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b62b18b5-c7f6-48f0-ab56-4213f6de7d44.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b7fab8bc-a491-4391-a446-e9d3c9193aca.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5711, tv_nsec: 406945736 } })
70632024-11-13T05:22:09.900ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("038e4c2b-2408-42f1-b025-c88f1167faaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("eb4a98a4-3147-445f-9881-33f4dffeca66.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5711, tv_nsec: 406953026 } })
70642024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70652024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70662024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
70672024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70682024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70692024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70702024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70712024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70722024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70732024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70742024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70752024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
70762024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.353112ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
70772024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
70782024-11-13T05:22:09.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.267641ms iteration = 16 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353"]}
70792024-11-13T05:22:09.902ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70802024-11-13T05:22:09.903ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.446119ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70812024-11-13T05:22:09.903ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70822024-11-13T05:22:09.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70832024-11-13T05:22:09.904ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
70842024-11-13T05:22:09.904ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
70852024-11-13T05:22:09.904ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.348106ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
70862024-11-13T05:22:09.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70872024-11-13T05:22:09.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70882024-11-13T05:22:09.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70892024-11-13T05:22:09.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70902024-11-13T05:22:09.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70912024-11-13T05:22:09.906ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70922024-11-13T05:22:09.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70932024-11-13T05:22:09.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70942024-11-13T05:22:09.908ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-13 05:12:09.899256482 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70952024-11-13T05:22:09.908ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.869297ms iteration = 15 status = {"expiration":"2024-11-13T05:12:09.899256482Z","pruned":[]}
70962024-11-13T05:22:09.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70972024-11-13T05:22:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70982024-11-13T05:22:09.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70992024-11-13T05:22:09.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71002024-11-13T05:22:09.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
71012024-11-13T05:22:09.909ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71022024-11-13T05:22:09.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71032024-11-13T05:22:09.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71042024-11-13T05:22:09.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71052024-11-13T05:22:09.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71062024-11-13T05:22:09.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71072024-11-13T05:22:09.911ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71082024-11-13T05:22:09.911ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71092024-11-13T05:22:09.911ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71102024-11-13T05:22:09.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71112024-11-13T05:22:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71122024-11-13T05:22:09.912ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71132024-11-13T05:22:09.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71142024-11-13T05:22:09.913ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5711, tv_nsec: 420533945 } })
71152024-11-13T05:22:09.913ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.340365ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
71162024-11-13T05:22:09.913ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
71172024-11-13T05:22:09.914ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5711, tv_nsec: 421179720 } })
71182024-11-13T05:22:09.914ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
71192024-11-13T05:22:09.914ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71202024-11-13T05:22:09.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71212024-11-13T05:22:09.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71222024-11-13T05:22:09.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71232024-11-13T05:22:09.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71242024-11-13T05:22:09.916ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71252024-11-13T05:22:09.916ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71262024-11-13T05:22:09.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71272024-11-13T05:22:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71282024-11-13T05:22:09.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71292024-11-13T05:22:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71302024-11-13T05:22:09.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71312024-11-13T05:22:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71322024-11-13T05:22:09.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71332024-11-13T05:22:09.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71342024-11-13T05:22:09.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71352024-11-13T05:22:09.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71362024-11-13T05:22:09.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71372024-11-13T05:22:09.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71382024-11-13T05:22:09.922ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5711, tv_nsec: 429185060 } })
71392024-11-13T05:22:09.922ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
71402024-11-13T05:22:09.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71412024-11-13T05:22:09.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71422024-11-13T05:22:09.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71432024-11-13T05:22:09.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71442024-11-13T05:22:09.926ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71452024-11-13T05:22:09.929ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71462024-11-13T05:22:09.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71472024-11-13T05:22:09.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71482024-11-13T05:22:09.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71492024-11-13T05:22:09.933ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71502024-11-13T05:22:09.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71512024-11-13T05:22:09.934ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 35.424669ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
71522024-11-13T05:22:09.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71532024-11-13T05:22:09.940ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
71542024-11-13T05:22:09.940ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71552024-11-13T05:22:09.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71562024-11-13T05:22:09.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 22ac9cff-b336-44b2-a5cd-e8321c069fdc roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
71572024-11-13T05:22:09.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 22ac9cff-b336-44b2-a5cd-e8321c069fdc resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
71582024-11-13T05:22:09.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 22ac9cff-b336-44b2-a5cd-e8321c069fdc response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
71592024-11-13T05:22:09.953ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71602024-11-13T05:22:09.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71612024-11-13T05:22:09.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.930319ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71622024-11-13T05:22:09.955ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
71632024-11-13T05:22:09.955ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.471224ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
71642024-11-13T05:22:09.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.894267ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71652024-11-13T05:22:09.957ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71662024-11-13T05:22:09.957ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71672024-11-13T05:22:09.957ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71682024-11-13T05:22:09.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71692024-11-13T05:22:09.958ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71702024-11-13T05:22:09.959ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71712024-11-13T05:22:09.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71722024-11-13T05:22:09.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.290597ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
71732024-11-13T05:22:09.960ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71742024-11-13T05:22:09.960ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71752024-11-13T05:22:09.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71762024-11-13T05:22:09.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71772024-11-13T05:22:09.961ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71782024-11-13T05:22:09.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71792024-11-13T05:22:09.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71802024-11-13T05:22:09.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71812024-11-13T05:22:09.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71822024-11-13T05:22:09.964ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 65.161159ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
71832024-11-13T05:22:09.965ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71842024-11-13T05:22:09.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71852024-11-13T05:22:09.965ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71862024-11-13T05:22:09.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71872024-11-13T05:22:09.966ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71882024-11-13T05:22:09.966ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71892024-11-13T05:22:09.966ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71902024-11-13T05:22:09.966ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71912024-11-13T05:22:09.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71922024-11-13T05:22:09.966ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71932024-11-13T05:22:09.966ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71942024-11-13T05:22:09.969ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71952024-11-13T05:22:09.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.975452ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71962024-11-13T05:22:09.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
71972024-11-13T05:22:09.970ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71982024-11-13T05:22:09.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71992024-11-13T05:22:09.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.070611ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
72002024-11-13T05:22:09.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72012024-11-13T05:22:09.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72022024-11-13T05:22:09.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72032024-11-13T05:22:09.972ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 73.034379ms iteration = 29 status = 0
72042024-11-13T05:22:09.973ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
72052024-11-13T05:22:09.973ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
72062024-11-13T05:22:09.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72072024-11-13T05:22:09.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72082024-11-13T05:22:09.974ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72092024-11-13T05:22:09.974ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72102024-11-13T05:22:09.974ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.265458ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72112024-11-13T05:22:09.975ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72122024-11-13T05:22:09.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72132024-11-13T05:22:09.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72142024-11-13T05:22:09.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72152024-11-13T05:22:09.983ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72162024-11-13T05:22:09.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72172024-11-13T05:22:09.988ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1393ae49-9238-4227-92d3-686402841b40 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
72182024-11-13T05:22:09.988ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
72192024-11-13T05:22:09.988ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-13 05:08:54.008257 UTC dns_group = internal generation = 1
72202024-11-13T05:22:09.988ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 90.850434ms iteration = 16 status = {"generation":1}
72212024-11-13T05:22:09.989ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72222024-11-13T05:22:09.989ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72232024-11-13T05:22:09.989ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72242024-11-13T05:22:09.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72252024-11-13T05:22:10.004ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72262024-11-13T05:22:10.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72272024-11-13T05:22:10.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72282024-11-13T05:22:10.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72292024-11-13T05:22:10.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72302024-11-13T05:22:10.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72312024-11-13T05:22:10.031ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72322024-11-13T05:22:10.031ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72332024-11-13T05:22:10.031ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.331387ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72342024-11-13T05:22:10.034ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72352024-11-13T05:22:10.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72362024-11-13T05:22:10.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72372024-11-13T05:22:10.042ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
72382024-11-13T05:22:10.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72392024-11-13T05:22:10.044ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
72402024-11-13T05:22:10.044ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 0 version = 2
72412024-11-13T05:22:10.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72422024-11-13T05:22:10.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72432024-11-13T05:22:10.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72442024-11-13T05:22:10.045ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72452024-11-13T05:22:10.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72462024-11-13T05:22:10.058ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.360143ms iteration = 33 status = {"physical_disks_added":0}
72472024-11-13T05:22:10.067ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72482024-11-13T05:22:10.067ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72492024-11-13T05:22:10.067ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f640d7d1-93a7-47c8-babd-f145c58efa8f", "content-length": "26", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
72502024-11-13T05:22:10.067ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72512024-11-13T05:22:10.069ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72522024-11-13T05:22:10.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72532024-11-13T05:22:10.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72542024-11-13T05:22:10.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
72552024-11-13T05:22:10.074ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72562024-11-13T05:22:10.074ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5004052c-4f85-4e52-90db-f23d233dca43", "content-length": "26", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
72572024-11-13T05:22:10.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
72582024-11-13T05:22:10.074ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72592024-11-13T05:22:10.074ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72602024-11-13T05:22:10.074ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e166c20e-c8b4-4d66-bbef-6ba8e8c794dd", "content-length": "26", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
72612024-11-13T05:22:10.074ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72622024-11-13T05:22:10.078ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
72632024-11-13T05:22:10.078ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 179.112765ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72642024-11-13T05:22:10.079ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72652024-11-13T05:22:10.080ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
72662024-11-13T05:22:10.224ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72672024-11-13T05:22:10.224ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8ce29484-0d10-4ac2-aa84-ed53401b654e", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72682024-11-13T05:22:10.224ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72692024-11-13T05:22:10.227ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9dce73fe-03a6-4ade-bcb4-1601483ed72f", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72702024-11-13T05:22:10.227ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72712024-11-13T05:22:10.231ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 331.92659ms iteration = 29 status = {}
72722024-11-13T05:22:10.231ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72732024-11-13T05:22:10.231ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 331.957161ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72742024-11-13T05:22:10.250ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72752024-11-13T05:22:10.250ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfc879dd-b766-47c7-b13b-fed20add291f", "content-length": "2", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
72762024-11-13T05:22:10.252ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72772024-11-13T05:22:10.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72782024-11-13T05:22:10.313ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72792024-11-13T05:22:10.313ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72802024-11-13T05:22:10.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5321d2c-f190-478f-85b6-be4c5e6f8e9f", "content-length": "372", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
72812024-11-13T05:22:10.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72822024-11-13T05:22:10.313ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72832024-11-13T05:22:10.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72842024-11-13T05:22:10.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72852024-11-13T05:22:10.317ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 417.59819ms iteration = 29 status = null
72862024-11-13T05:22:10.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72872024-11-13T05:22:10.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72882024-11-13T05:22:10.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72892024-11-13T05:22:10.320ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = b0aa904e-aba2-421d-90f9-ffe94fbbdba2 dns_zone_name = oxide.test found_so_far = 1 version = 2
72902024-11-13T05:22:10.320ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72912024-11-13T05:22:10.320ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-13 05:08:54.834359 UTC dns_group = external generation = 2
72922024-11-13T05:22:10.320ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 421.363383ms iteration = 16 status = {"generation":2}
72932024-11-13T05:22:10.328ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72942024-11-13T05:22:10.328ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72952024-11-13T05:22:10.328ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3f459233-a4f4-4169-a557-d23ffade5c8c", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
72962024-11-13T05:22:10.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72972024-11-13T05:22:10.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72982024-11-13T05:22:10.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72992024-11-13T05:22:10.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73002024-11-13T05:22:10.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73012024-11-13T05:22:10.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73022024-11-13T05:22:10.336ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73032024-11-13T05:22:10.337ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73042024-11-13T05:22:10.337ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "13c956fd-30a6-4e63-bc46-870c8630e6ca", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
73052024-11-13T05:22:10.342ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.74914ms iteration = 31 status = {}
73062024-11-13T05:22:10.344ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73072024-11-13T05:22:10.346ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73082024-11-13T05:22:10.346ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73092024-11-13T05:22:10.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73102024-11-13T05:22:10.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73112024-11-13T05:22:10.349ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-13T05:08:08.157062Z, time_modified: 2024-11-13T05:08:08.157062Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, db_silo: Silo { identity: SiloIdentity { id: 26cfece8-d05c-41eb-b6a0-db2c20fff7a5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-13T05:08:54.779936Z, time_modified: 2024-11-13T05:08:54.779936Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0" }] }) }
73122024-11-13T05:22:10.350ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 450.717529ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]}},"default_endpoint":{"silo_id":"26cfece8-d05c-41eb-b6a0-db2c20fff7a5","tls_certs":["863f75b5ee3ca48a4ed2624e568f7a0d8a50aac59cd3a5ca676f1b8e71ddc4e0"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
73132024-11-13T05:22:10.350ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73142024-11-13T05:22:10.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73152024-11-13T05:22:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73162024-11-13T05:22:10.386ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
73172024-11-13T05:22:10.386ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f68e5032-82aa-421e-bd99-5b2209ab655a", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73182024-11-13T05:22:10.387ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73192024-11-13T05:22:10.388ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e0ecb825-a321-43e5-9929-20dff36cd13f", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73202024-11-13T05:22:10.388ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73212024-11-13T05:22:10.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4ce0d7c5-e159-463d-a746-34dd20c79a41", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73222024-11-13T05:22:10.390ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73232024-11-13T05:22:10.392ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353] }
73242024-11-13T05:22:10.392ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 493.18827ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
73252024-11-13T05:22:10.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73262024-11-13T05:22:10.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73272024-11-13T05:22:10.402ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
73282024-11-13T05:22:10.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73292024-11-13T05:22:10.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73302024-11-13T05:22:10.405ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73312024-11-13T05:22:10.405ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3960d291-32c1-4416-ba98-d74486f4e032", "content-length": "691", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
73322024-11-13T05:22:10.405ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
73332024-11-13T05:22:10.405ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73342024-11-13T05:22:10.405ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73352024-11-13T05:22:10.407ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 508.735627ms iteration = 30 status = {}
73362024-11-13T05:22:10.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73372024-11-13T05:22:10.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6ed0f6b-2f40-4968-a0cf-96546acf999a", "content-length": "134", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
73382024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73392024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
73402024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73412024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73422024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73432024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73442024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73452024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73462024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73472024-11-13T05:22:10.412ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73482024-11-13T05:22:10.413ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
73492024-11-13T05:22:10.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73502024-11-13T05:22:10.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73512024-11-13T05:22:10.414ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73522024-11-13T05:22:10.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5f12226-8fc1-4926-9234-986bce5fd570", "content-length": "2", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
73532024-11-13T05:22:10.414ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73542024-11-13T05:22:10.415ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d971284-7399-47c8-b348-e084c4275c24", "content-length": "52", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
73552024-11-13T05:22:10.415ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
73562024-11-13T05:22:10.415ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73572024-11-13T05:22:10.522ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0a1ba00d-8628-46d1-ba1c-b7ac4fc558ee", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
73582024-11-13T05:22:10.522ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
73592024-11-13T05:22:10.522ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73602024-11-13T05:22:10.522ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "030026a0-bc51-48c4-94f5-1131e8955cee", "content-length": "682", "date": "Wed, 13 Nov 2024 05:22:10 GMT"} })
73612024-11-13T05:22:10.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73622024-11-13T05:22:10.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73632024-11-13T05:22:10.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73642024-11-13T05:22:10.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73652024-11-13T05:22:10.530ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73662024-11-13T05:22:10.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73672024-11-13T05:22:10.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73682024-11-13T05:22:10.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73692024-11-13T05:22:10.540ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.228835ms iteration = 29 status = {}
73702024-11-13T05:22:10.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1342 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = 059c604e-7298-46a9-99ae-e29f2bd27302 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
73712024-11-13T05:22:10.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0a220b8d-6ab9-4397-9cc4-68a77467ed8a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73722024-11-13T05:22:10.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0a220b8d-6ab9-4397-9cc4-68a77467ed8a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73732024-11-13T05:22:10.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0a220b8d-6ab9-4397-9cc4-68a77467ed8a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73742024-11-13T05:22:12.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0b4b26c9-dcb0-408b-9e2e-efe0ef15818e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73752024-11-13T05:22:12.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0b4b26c9-dcb0-408b-9e2e-efe0ef15818e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73762024-11-13T05:22:12.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0b4b26c9-dcb0-408b-9e2e-efe0ef15818e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73772024-11-13T05:22:13.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fdfb742a-819a-400e-a697-f6030451cb59 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73782024-11-13T05:22:13.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fdfb742a-819a-400e-a697-f6030451cb59 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73792024-11-13T05:22:13.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = fdfb742a-819a-400e-a697-f6030451cb59 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73802024-11-13T05:22:14.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 121eaf83-fc4e-4f3f-a383-5ea93f3d6b4c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73812024-11-13T05:22:14.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 121eaf83-fc4e-4f3f-a383-5ea93f3d6b4c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73822024-11-13T05:22:14.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 121eaf83-fc4e-4f3f-a383-5ea93f3d6b4c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73832024-11-13T05:22:15.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 95d52d47-e057-43e8-9574-78d3e0a28b68 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73842024-11-13T05:22:15.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 95d52d47-e057-43e8-9574-78d3e0a28b68 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73852024-11-13T05:22:15.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 95d52d47-e057-43e8-9574-78d3e0a28b68 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73862024-11-13T05:22:16.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 61a20e99-5f9a-4f10-81d5-580285ef4bf7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73872024-11-13T05:22:16.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 61a20e99-5f9a-4f10-81d5-580285ef4bf7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73882024-11-13T05:22:16.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 61a20e99-5f9a-4f10-81d5-580285ef4bf7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73892024-11-13T05:22:17.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8df08fa4-0e0f-4855-8740-6cbf48e3e583 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73902024-11-13T05:22:17.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8df08fa4-0e0f-4855-8740-6cbf48e3e583 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73912024-11-13T05:22:17.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8df08fa4-0e0f-4855-8740-6cbf48e3e583 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73922024-11-13T05:22:18.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e62f51d6-3edc-44e1-94a7-2a374acceefd roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73932024-11-13T05:22:18.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e62f51d6-3edc-44e1-94a7-2a374acceefd resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73942024-11-13T05:22:18.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e62f51d6-3edc-44e1-94a7-2a374acceefd response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73952024-11-13T05:22:19.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7bef0058-bdf6-431f-96d2-ef5bd21a5208 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73962024-11-13T05:22:19.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7bef0058-bdf6-431f-96d2-ef5bd21a5208 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73972024-11-13T05:22:19.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7bef0058-bdf6-431f-96d2-ef5bd21a5208 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
73982024-11-13T05:22:19.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
73992024-11-13T05:22:19.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
74002024-11-13T05:22:19.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74012024-11-13T05:22:19.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74022024-11-13T05:22:19.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74032024-11-13T05:22:19.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74042024-11-13T05:22:19.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74052024-11-13T05:22:19.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74062024-11-13T05:22:19.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74072024-11-13T05:22:19.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74082024-11-13T05:22:19.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74092024-11-13T05:22:19.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74102024-11-13T05:22:19.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74112024-11-13T05:22:19.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
74122024-11-13T05:22:19.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74132024-11-13T05:22:19.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74142024-11-13T05:22:19.923ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
74152024-11-13T05:22:19.923ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.95507ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
74162024-11-13T05:22:19.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74172024-11-13T05:22:19.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74182024-11-13T05:22:19.958ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.371699ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74192024-11-13T05:22:20.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d7d6ede1-de6a-4a58-9576-1b4c12aee9ce roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74202024-11-13T05:22:20.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d7d6ede1-de6a-4a58-9576-1b4c12aee9ce resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74212024-11-13T05:22:20.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d7d6ede1-de6a-4a58-9576-1b4c12aee9ce response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74222024-11-13T05:22:21.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 10aa96ed-082e-484a-822b-dae2d2e32c9a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74232024-11-13T05:22:21.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 10aa96ed-082e-484a-822b-dae2d2e32c9a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74242024-11-13T05:22:21.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 10aa96ed-082e-484a-822b-dae2d2e32c9a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74252024-11-13T05:22:22.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e6e9732-6cf6-4122-b76a-3049d91ca41a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74262024-11-13T05:22:22.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e6e9732-6cf6-4122-b76a-3049d91ca41a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74272024-11-13T05:22:22.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 4e6e9732-6cf6-4122-b76a-3049d91ca41a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74282024-11-13T05:22:23.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 68895e7e-7365-46e7-b756-bc27540d3cf8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74292024-11-13T05:22:23.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 68895e7e-7365-46e7-b756-bc27540d3cf8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74302024-11-13T05:22:23.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 68895e7e-7365-46e7-b756-bc27540d3cf8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74312024-11-13T05:22:24.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5a504fd-5495-4031-9dbf-802a387f9b82 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74322024-11-13T05:22:24.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5a504fd-5495-4031-9dbf-802a387f9b82 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74332024-11-13T05:22:24.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a5a504fd-5495-4031-9dbf-802a387f9b82 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74342024-11-13T05:22:25.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0614567e-7f46-41fb-a276-c6c8f9ddc7c3 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74352024-11-13T05:22:25.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0614567e-7f46-41fb-a276-c6c8f9ddc7c3 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74362024-11-13T05:22:25.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 0614567e-7f46-41fb-a276-c6c8f9ddc7c3 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74372024-11-13T05:22:25.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1425 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = ff9f9ee3-518e-4867-a379-7ab70ba1a066 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
74382024-11-13T05:22:26.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7786bb22-846c-48b5-8b6f-8aaccb0dd8e5 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74392024-11-13T05:22:26.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7786bb22-846c-48b5-8b6f-8aaccb0dd8e5 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74402024-11-13T05:22:26.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7786bb22-846c-48b5-8b6f-8aaccb0dd8e5 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74412024-11-13T05:22:27.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 87d2b286-7072-44de-9c82-b0feeeda5b10 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74422024-11-13T05:22:27.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 87d2b286-7072-44de-9c82-b0feeeda5b10 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74432024-11-13T05:22:27.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 87d2b286-7072-44de-9c82-b0feeeda5b10 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74442024-11-13T05:22:28.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8a66870b-9e14-46f7-8334-75506c59983b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74452024-11-13T05:22:28.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8a66870b-9e14-46f7-8334-75506c59983b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74462024-11-13T05:22:28.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8a66870b-9e14-46f7-8334-75506c59983b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74472024-11-13T05:22:29.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2d845f2a-a92c-47e6-99d9-ac95ac92ee2e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74482024-11-13T05:22:29.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2d845f2a-a92c-47e6-99d9-ac95ac92ee2e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74492024-11-13T05:22:29.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2d845f2a-a92c-47e6-99d9-ac95ac92ee2e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74502024-11-13T05:22:29.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
74512024-11-13T05:22:29.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
74522024-11-13T05:22:29.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74532024-11-13T05:22:29.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74542024-11-13T05:22:29.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74552024-11-13T05:22:29.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74562024-11-13T05:22:29.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74572024-11-13T05:22:29.901ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74582024-11-13T05:22:29.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74592024-11-13T05:22:29.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.660071ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74602024-11-13T05:22:29.904ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74612024-11-13T05:22:29.904ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74622024-11-13T05:22:29.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74632024-11-13T05:22:29.906ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74642024-11-13T05:22:29.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74652024-11-13T05:22:29.908ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74662024-11-13T05:22:29.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
74672024-11-13T05:22:29.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74682024-11-13T05:22:29.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74692024-11-13T05:22:29.921ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
74702024-11-13T05:22:29.921ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.524957ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
74712024-11-13T05:22:30.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7990fea9-77a6-474b-98a9-90b0f178ba71 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74722024-11-13T05:22:30.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7990fea9-77a6-474b-98a9-90b0f178ba71 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74732024-11-13T05:22:30.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7990fea9-77a6-474b-98a9-90b0f178ba71 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74742024-11-13T05:22:30.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 2a6638ca-4a21-4f1d-a8fc-f046b1fc25c2 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
74752024-11-13T05:22:30.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 2a6638ca-4a21-4f1d-a8fc-f046b1fc25c2 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
74762024-11-13T05:22:30.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = 2a6638ca-4a21-4f1d-a8fc-f046b1fc25c2 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?sort_by=id_ascending
74772024-11-13T05:22:30.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = a4913074-2820-4ebc-9ab6-99922d7900e3 roles = RoleSet { roles: {} } uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
74782024-11-13T05:22:30.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = a4913074-2820-4ebc-9ab6-99922d7900e3 resource = Database result = Ok(()) uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
74792024-11-13T05:22:30.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40807 req_id = a4913074-2820-4ebc-9ab6-99922d7900e3 response_code = 200 uri = /metrics/collectors/671c6402-97d6-48bd-9991-5554bd96a514/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlYjEzMTFmOC02ODA3LTQ3MWEtYThmNy04ZmU2NDNkZWE3NWQifX0%3D
74802024-11-13T05:22:31.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 879870cb-d79f-4804-b901-ec075d45eb41 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74812024-11-13T05:22:31.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 879870cb-d79f-4804-b901-ec075d45eb41 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74822024-11-13T05:22:31.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 879870cb-d79f-4804-b901-ec075d45eb41 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74832024-11-13T05:22:32.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d0aed83d-4982-4025-a727-94d3fd22b7fc roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74842024-11-13T05:22:32.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d0aed83d-4982-4025-a727-94d3fd22b7fc resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74852024-11-13T05:22:32.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d0aed83d-4982-4025-a727-94d3fd22b7fc response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74862024-11-13T05:22:33.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 48ec399a-de9f-488c-8ea2-da2401136559 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74872024-11-13T05:22:33.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 48ec399a-de9f-488c-8ea2-da2401136559 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74882024-11-13T05:22:33.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 48ec399a-de9f-488c-8ea2-da2401136559 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74892024-11-13T05:22:34.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b6df0b9-ebf6-4516-887a-d617521efa7d roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74902024-11-13T05:22:34.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b6df0b9-ebf6-4516-887a-d617521efa7d resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74912024-11-13T05:22:34.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 7b6df0b9-ebf6-4516-887a-d617521efa7d response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74922024-11-13T05:22:35.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 43509f88-912d-4a95-9aa3-9cf871f524cb roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74932024-11-13T05:22:35.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 43509f88-912d-4a95-9aa3-9cf871f524cb resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74942024-11-13T05:22:35.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 43509f88-912d-4a95-9aa3-9cf871f524cb response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74952024-11-13T05:22:36.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2a79dc4c-58fd-4677-a6dc-f2f3f9c7381e roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74962024-11-13T05:22:36.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2a79dc4c-58fd-4677-a6dc-f2f3f9c7381e resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74972024-11-13T05:22:36.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 2a79dc4c-58fd-4677-a6dc-f2f3f9c7381e response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74982024-11-13T05:22:37.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5c0f5a00-0e91-483f-80f6-c8b3fa87affd roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
74992024-11-13T05:22:37.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5c0f5a00-0e91-483f-80f6-c8b3fa87affd resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
75002024-11-13T05:22:37.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 5c0f5a00-0e91-483f-80f6-c8b3fa87affd response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
75012024-11-13T05:22:38.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec1b222e-6066-40b3-bee6-f16a76e923c9 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
75022024-11-13T05:22:38.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec1b222e-6066-40b3-bee6-f16a76e923c9 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
75032024-11-13T05:22:38.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec1b222e-6066-40b3-bee6-f16a76e923c9 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
75042024-11-13T05:22:39.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b22af702-4f96-4f08-b4a1-16b552853ff8 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
75052024-11-13T05:22:39.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b22af702-4f96-4f08-b4a1-16b552853ff8 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
75062024-11-13T05:22:39.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = b22af702-4f96-4f08-b4a1-16b552853ff8 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
75072024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
75082024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
75092024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75102024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75112024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
75122024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75132024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75142024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
75152024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75162024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
75172024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
75182024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75192024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75202024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
75212024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
75222024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75232024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
75242024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
75252024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75262024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
75272024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75282024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75292024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
75302024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75312024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
75322024-11-13T05:22:39.899ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75332024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75342024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
75352024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
75362024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
75372024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75382024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
75392024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75402024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
75412024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
75422024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75432024-11-13T05:22:39.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75442024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75452024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75462024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75472024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75482024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75492024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75502024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75512024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75522024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75532024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75542024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75552024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75562024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75572024-11-13T05:22:39.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75582024-11-13T05:22:39.902ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.917256ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75592024-11-13T05:22:39.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.312459ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
75602024-11-13T05:22:39.902ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75612024-11-13T05:22:39.902ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75622024-11-13T05:22:39.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75632024-11-13T05:22:39.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75642024-11-13T05:22:39.903ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75652024-11-13T05:22:39.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75662024-11-13T05:22:39.904ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75672024-11-13T05:22:39.904ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5741, tv_nsec: 411465445 } })
75682024-11-13T05:22:39.905ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
75692024-11-13T05:22:39.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.455868ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
75702024-11-13T05:22:39.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712024-11-13T05:22:39.906ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5741, tv_nsec: 412755037 } })
75722024-11-13T05:22:39.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75732024-11-13T05:22:39.906ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75742024-11-13T05:22:39.906ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
75752024-11-13T05:22:39.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75762024-11-13T05:22:39.907ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75772024-11-13T05:22:39.908ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75782024-11-13T05:22:39.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75792024-11-13T05:22:39.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75802024-11-13T05:22:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
75812024-11-13T05:22:39.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75822024-11-13T05:22:39.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75832024-11-13T05:22:39.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
75842024-11-13T05:22:39.910ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75852024-11-13T05:22:39.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75862024-11-13T05:22:39.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75872024-11-13T05:22:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75882024-11-13T05:22:39.912ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75892024-11-13T05:22:39.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75902024-11-13T05:22:39.913ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75912024-11-13T05:22:39.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75922024-11-13T05:22:39.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75932024-11-13T05:22:39.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75942024-11-13T05:22:39.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75952024-11-13T05:22:39.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75962024-11-13T05:22:39.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75972024-11-13T05:22:39.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75982024-11-13T05:22:39.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75992024-11-13T05:22:39.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76002024-11-13T05:22:39.918ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76012024-11-13T05:22:39.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76022024-11-13T05:22:39.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76032024-11-13T05:22:39.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76042024-11-13T05:22:39.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76052024-11-13T05:22:39.922ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76062024-11-13T05:22:39.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76072024-11-13T05:22:39.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 23.705867ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76082024-11-13T05:22:39.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76092024-11-13T05:22:39.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76102024-11-13T05:22:39.944ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76112024-11-13T05:22:39.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76122024-11-13T05:22:39.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76132024-11-13T05:22:39.946ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76142024-11-13T05:22:39.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76152024-11-13T05:22:39.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76162024-11-13T05:22:39.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76172024-11-13T05:22:39.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76182024-11-13T05:22:39.949ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76192024-11-13T05:22:39.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76202024-11-13T05:22:39.955ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.894788ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76212024-11-13T05:22:39.957ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76222024-11-13T05:22:39.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76232024-11-13T05:22:39.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76242024-11-13T05:22:39.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76252024-11-13T05:22:39.960ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76262024-11-13T05:22:39.961ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76272024-11-13T05:22:39.961ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76282024-11-13T05:22:39.961ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76292024-11-13T05:22:39.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76302024-11-13T05:22:39.961ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76312024-11-13T05:22:39.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.070953ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76322024-11-13T05:22:39.962ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 62.694078ms iteration = 34 status = {"physical_disks_added":0}
76332024-11-13T05:22:39.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
76342024-11-13T05:22:39.963ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76352024-11-13T05:22:39.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76362024-11-13T05:22:39.969ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
76372024-11-13T05:22:39.969ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76382024-11-13T05:22:39.969ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
76392024-11-13T05:22:39.969ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76402024-11-13T05:22:39.969ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8213b65b-509b-4ab1-bfe2-926844408a15", "content-length": "26", "date": "Wed, 13 Nov 2024 05:22:39 GMT"} })
76412024-11-13T05:22:39.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76422024-11-13T05:22:39.969ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b27098c1-b386-43b8-bbb5-d0788f7b6a3b", "content-length": "26", "date": "Wed, 13 Nov 2024 05:22:39 GMT"} })
76432024-11-13T05:22:39.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76442024-11-13T05:22:39.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76452024-11-13T05:22:39.971ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76462024-11-13T05:22:40.005ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
76472024-11-13T05:22:40.005ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76482024-11-13T05:22:40.006ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9127a0f8-83fc-44d9-99a5-cca4a08d9262", "content-length": "372", "date": "Wed, 13 Nov 2024 05:22:40 GMT"} })
76492024-11-13T05:22:40.006ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76502024-11-13T05:22:40.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76512024-11-13T05:22:40.008ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4d997277-f640-48d7-af56-6df261d5afe1.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5741, tv_nsec: 515543865 } })
76522024-11-13T05:22:40.009ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76532024-11-13T05:22:40.009ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
76542024-11-13T05:22:40.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76552024-11-13T05:22:40.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76562024-11-13T05:22:40.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76572024-11-13T05:22:40.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76582024-11-13T05:22:40.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76592024-11-13T05:22:40.020ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
76602024-11-13T05:22:40.020ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.373361ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
76612024-11-13T05:22:40.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76622024-11-13T05:22:40.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4d997277-f640-48d7-af56-6df261d5afe1, lookup_type: ById(4d997277-f640-48d7-af56-6df261d5afe1) } result = Ok(())
76632024-11-13T05:22:40.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76642024-11-13T05:22:40.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.183018ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76652024-11-13T05:22:40.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76662024-11-13T05:22:40.038ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76672024-11-13T05:22:40.038ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76682024-11-13T05:22:40.038ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.276977ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76692024-11-13T05:22:40.040ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 140.849291ms iteration = 30 status = 0
76702024-11-13T05:22:40.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 142.557606ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76712024-11-13T05:22:40.048ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76722024-11-13T05:22:40.048ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3b0f767-691d-432b-940a-78638e764ed2", "content-length": "2", "date": "Wed, 13 Nov 2024 05:22:39 GMT"} })
76732024-11-13T05:22:40.049ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76742024-11-13T05:22:40.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76752024-11-13T05:22:40.050ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76762024-11-13T05:22:40.051ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 152.283222ms iteration = 30 status = null
76772024-11-13T05:22:40.052ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76782024-11-13T05:22:40.052ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76792024-11-13T05:22:40.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76802024-11-13T05:22:40.052ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 152.998278ms iteration = 30 status = {}
76812024-11-13T05:22:40.055ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
76822024-11-13T05:22:40.055ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76832024-11-13T05:22:40.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a866308b-dbd2-4f1e-a6fa-c4f7b0c97ac9", "date": "Wed, 13 Nov 2024 05:22:40 GMT"} })
76842024-11-13T05:22:40.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76852024-11-13T05:22:40.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76862024-11-13T05:22:40.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76872024-11-13T05:22:40.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76882024-11-13T05:22:40.060ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76892024-11-13T05:22:40.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76902024-11-13T05:22:40.063ZINFOnexus (BackgroundTasks): VPC route manager sled 4d997277-f640-48d7-af56-6df261d5afe1 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76912024-11-13T05:22:40.063ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76922024-11-13T05:22:40.064ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7e1e963e-64b2-4265-9cf7-2ddac9ca6868", "date": "Wed, 13 Nov 2024 05:22:40 GMT"} })
76932024-11-13T05:22:40.065ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b zone_address = fd00:1122:3344:101::2
76942024-11-13T05:22:40.065ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76952024-11-13T05:22:40.065ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "feb00988-ad04-48b5-974e-0f25f885856e", "content-length": "26", "date": "Wed, 13 Nov 2024 05:22:39 GMT"} })
76962024-11-13T05:22:40.065ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76972024-11-13T05:22:40.068ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
76982024-11-13T05:22:40.068ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 168.963508ms iteration = 32 status = {}
76992024-11-13T05:22:40.176ZDEBGnexus (BackgroundTasks): client request SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77002024-11-13T05:22:40.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 4d997277-f640-48d7-af56-6df261d5afe1 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a109c40-e6c9-45fd-ad3e-d14bcdee3ce6", "content-length": "691", "date": "Wed, 13 Nov 2024 05:22:40 GMT"} })
77012024-11-13T05:22:40.177ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
77022024-11-13T05:22:40.177ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
77032024-11-13T05:22:40.177ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
77042024-11-13T05:22:40.178ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 278.534634ms iteration = 31 status = {}
77052024-11-13T05:22:40.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77062024-11-13T05:22:40.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77072024-11-13T05:22:40.191ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: bc0e8488-8e13-4263-b05d-b6566baac1c1, rack_id: b7b41d81-f310-4949-894b-9f77b62a6c9b, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(56701aae-8a8b-4630-a247-082462a80bc8) } rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
77082024-11-13T05:22:40.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77092024-11-13T05:22:40.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77102024-11-13T05:22:40.201ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77112024-11-13T05:22:40.201ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7367e8bb-ff82-4d25-b537-be04048448c0", "content-length": "134", "date": "Wed, 13 Nov 2024 05:22:39 GMT"} })
77122024-11-13T05:22:40.201ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77132024-11-13T05:22:40.201ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 56701aae-8a8b-4630-a247-082462a80bc8
77142024-11-13T05:22:40.201ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77152024-11-13T05:22:40.201ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77162024-11-13T05:22:40.201ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77172024-11-13T05:22:40.201ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77182024-11-13T05:22:40.201ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77192024-11-13T05:22:40.201ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77202024-11-13T05:22:40.202ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77212024-11-13T05:22:40.202ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77222024-11-13T05:22:40.202ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b
77232024-11-13T05:22:40.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77242024-11-13T05:22:40.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77252024-11-13T05:22:40.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77262024-11-13T05:22:40.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3073b23-d4c5-4da2-98e1-33cb1bced4fc", "content-length": "2", "date": "Wed, 13 Nov 2024 05:22:39 GMT"} })
77272024-11-13T05:22:40.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77282024-11-13T05:22:40.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2a55bff-f352-49f2-a325-fef7561fb30d", "content-length": "52", "date": "Wed, 13 Nov 2024 05:22:39 GMT"} })
77292024-11-13T05:22:40.204ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch_location = Switch0
77302024-11-13T05:22:40.204ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77312024-11-13T05:22:40.315ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4b5ec9e8-e138-4b65-be60-108ea0b938bf", "date": "Wed, 13 Nov 2024 05:22:40 GMT"} })
77322024-11-13T05:22:40.315ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b switch = Switch0
77332024-11-13T05:22:40.315ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
77342024-11-13T05:22:40.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b7b41d81-f310-4949-894b-9f77b62a6c9b result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dceefc0-c9c2-4d68-8733-17ad2fce8bf9", "content-length": "682", "date": "Wed, 13 Nov 2024 05:22:40 GMT"} })
77352024-11-13T05:22:40.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77362024-11-13T05:22:40.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77372024-11-13T05:22:40.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77382024-11-13T05:22:40.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77392024-11-13T05:22:40.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77402024-11-13T05:22:40.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77412024-11-13T05:22:40.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77422024-11-13T05:22:40.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77432024-11-13T05:22:40.333ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.381498ms iteration = 30 status = {}
77442024-11-13T05:22:40.583ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1695 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = ea445a38-6da2-4e77-a25c-a8e3d3f9b337 response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
77452024-11-13T05:22:40.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4392815-b729-4061-9c74-e853316f2fe2 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77462024-11-13T05:22:40.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4392815-b729-4061-9c74-e853316f2fe2 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77472024-11-13T05:22:40.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = c4392815-b729-4061-9c74-e853316f2fe2 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77482024-11-13T05:22:41.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89d28980-f69b-4664-a59b-ec03136d40f4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77492024-11-13T05:22:41.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89d28980-f69b-4664-a59b-ec03136d40f4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77502024-11-13T05:22:41.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 89d28980-f69b-4664-a59b-ec03136d40f4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77512024-11-13T05:22:42.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 349d48d6-8cf1-472c-aea9-48d182e29682 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77522024-11-13T05:22:42.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 349d48d6-8cf1-472c-aea9-48d182e29682 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77532024-11-13T05:22:42.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 349d48d6-8cf1-472c-aea9-48d182e29682 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77542024-11-13T05:22:43.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9aa8821-5419-458f-89ad-3cd524738f37 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77552024-11-13T05:22:43.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9aa8821-5419-458f-89ad-3cd524738f37 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77562024-11-13T05:22:43.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = e9aa8821-5419-458f-89ad-3cd524738f37 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77572024-11-13T05:22:44.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14acbec9-a4f1-4c4f-913e-1adbb1000d5a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77582024-11-13T05:22:44.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14acbec9-a4f1-4c4f-913e-1adbb1000d5a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77592024-11-13T05:22:44.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 14acbec9-a4f1-4c4f-913e-1adbb1000d5a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77602024-11-13T05:22:45.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a7be5d67-9e64-4c51-8c05-9ea82a3b78ad roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77612024-11-13T05:22:45.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a7be5d67-9e64-4c51-8c05-9ea82a3b78ad resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77622024-11-13T05:22:45.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a7be5d67-9e64-4c51-8c05-9ea82a3b78ad response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77632024-11-13T05:22:46.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8c89c4a4-a167-4c91-8c70-feb56498947a roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77642024-11-13T05:22:46.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8c89c4a4-a167-4c91-8c70-feb56498947a resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77652024-11-13T05:22:46.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8c89c4a4-a167-4c91-8c70-feb56498947a response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77662024-11-13T05:22:47.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78a909cc-c2f0-4925-a3b8-b7ebc4afcc79 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77672024-11-13T05:22:47.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78a909cc-c2f0-4925-a3b8-b7ebc4afcc79 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77682024-11-13T05:22:47.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 78a909cc-c2f0-4925-a3b8-b7ebc4afcc79 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77692024-11-13T05:22:48.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec6c0770-4004-4112-baed-af15adb1a301 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77702024-11-13T05:22:48.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec6c0770-4004-4112-baed-af15adb1a301 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77712024-11-13T05:22:48.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = ec6c0770-4004-4112-baed-af15adb1a301 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77722024-11-13T05:22:49.899ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
77732024-11-13T05:22:49.900ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
77742024-11-13T05:22:49.900ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77752024-11-13T05:22:49.900ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77762024-11-13T05:22:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77772024-11-13T05:22:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77782024-11-13T05:22:49.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a1008fd0-db27-446e-8d5d-a04ca8f36432 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77792024-11-13T05:22:49.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a1008fd0-db27-446e-8d5d-a04ca8f36432 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77802024-11-13T05:22:49.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = a1008fd0-db27-446e-8d5d-a04ca8f36432 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77812024-11-13T05:22:49.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77822024-11-13T05:22:49.929ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77832024-11-13T05:22:49.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77842024-11-13T05:22:49.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77852024-11-13T05:22:49.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77862024-11-13T05:22:49.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77872024-11-13T05:22:49.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77882024-11-13T05:22:49.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77892024-11-13T05:22:49.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77902024-11-13T05:22:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 5af9449d-9880-4fd1-a73d-9b98b883fa71, lookup_type: ById(5af9449d-9880-4fd1-a73d-9b98b883fa71) } result = Ok(())
77912024-11-13T05:22:49.937ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77922024-11-13T05:22:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77932024-11-13T05:22:49.950ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 original_time_created = 2024-11-13 05:08:05.420048 UTC target_id = 5af9449d-9880-4fd1-a73d-9b98b883fa71 time_created = 2024-11-13 05:08:05.420048 UTC
77942024-11-13T05:22:49.950ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.116358ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"5af9449d-9880-4fd1-a73d-9b98b883fa71","time_created":"2024-11-13T05:08:05.420048Z"}
77952024-11-13T05:22:49.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.072043ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77962024-11-13T05:22:50.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 07213de1-62c1-4387-825a-1e0aa638eca7 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77972024-11-13T05:22:50.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 07213de1-62c1-4387-825a-1e0aa638eca7 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77982024-11-13T05:22:50.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1980 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 07213de1-62c1-4387-825a-1e0aa638eca7 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
77992024-11-13T05:22:51.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 33e69e00-d75f-41e2-9c5b-519c04fab44c roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78002024-11-13T05:22:51.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 33e69e00-d75f-41e2-9c5b-519c04fab44c resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78012024-11-13T05:22:51.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 33e69e00-d75f-41e2-9c5b-519c04fab44c response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78022024-11-13T05:22:52.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d87b7c05-8c89-45eb-b0ce-2af3ccbe615b roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78032024-11-13T05:22:52.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d87b7c05-8c89-45eb-b0ce-2af3ccbe615b resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78042024-11-13T05:22:52.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = d87b7c05-8c89-45eb-b0ce-2af3ccbe615b response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78052024-11-13T05:22:54.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9b4a1a0f-35bf-46e7-861b-cd7c2b6b95d4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78062024-11-13T05:22:54.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9b4a1a0f-35bf-46e7-861b-cd7c2b6b95d4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78072024-11-13T05:22:54.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 9b4a1a0f-35bf-46e7-861b-cd7c2b6b95d4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78082024-11-13T05:22:55.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dbe2d039-df08-4851-9f97-0e687fa897e4 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78092024-11-13T05:22:55.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dbe2d039-df08-4851-9f97-0e687fa897e4 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78102024-11-13T05:22:55.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = dbe2d039-df08-4851-9f97-0e687fa897e4 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78112024-11-13T05:22:55.582ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1385 local_addr = [fd00:1122:3344:101::c]:48801 method = GET remote_addr = [fd00:1122:3344:101::d]:45717 req_id = f16fc8a5-f09c-4978-b74e-580e91c2aeeb response_code = 200 uri = /6c4893ca-1b18-4910-8b18-504e5fcb8dc5
78122024-11-13T05:22:56.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 319b2429-6904-4b82-95a9-9cad5748bdfc roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78132024-11-13T05:22:56.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 319b2429-6904-4b82-95a9-9cad5748bdfc resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78142024-11-13T05:22:56.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 319b2429-6904-4b82-95a9-9cad5748bdfc response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78152024-11-13T05:22:57.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23720eab-edc9-4650-94a7-759d8419e116 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78162024-11-13T05:22:57.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23720eab-edc9-4650-94a7-759d8419e116 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78172024-11-13T05:22:57.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 23720eab-edc9-4650-94a7-759d8419e116 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78182024-11-13T05:22:58.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8b1c7798-f6f5-47b7-898f-d6f86d299a14 roles = RoleSet { roles: {} } uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78192024-11-13T05:22:58.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8b1c7798-f6f5-47b7-898f-d6f86d299a14 resource = Database result = Ok(()) uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1
78202024-11-13T05:22:58.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:62370 req_id = 8b1c7798-f6f5-47b7-898f-d6f86d299a14 response_code = 200 uri = /probes/4d997277-f640-48d7-af56-6df261d5afe1