Max level shown:
12024-10-04T22:15:00.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1329 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = ed0255c6-1045-433a-9666-488f7f846881 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
22024-10-04T22:15:01.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 57d5b37d-0312-4894-873e-7a45078b94c0 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
32024-10-04T22:15:01.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 57d5b37d-0312-4894-873e-7a45078b94c0 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
42024-10-04T22:15:01.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 57d5b37d-0312-4894-873e-7a45078b94c0 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52024-10-04T22:15:02.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 213c10a2-e000-47fb-a03d-7d96cc6b6479 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
62024-10-04T22:15:02.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 213c10a2-e000-47fb-a03d-7d96cc6b6479 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
72024-10-04T22:15:02.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 213c10a2-e000-47fb-a03d-7d96cc6b6479 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
82024-10-04T22:15:03.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8c2defbb-9fa2-47fc-bba0-97b67d5b70c7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
92024-10-04T22:15:03.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8c2defbb-9fa2-47fc-bba0-97b67d5b70c7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
102024-10-04T22:15:03.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8c2defbb-9fa2-47fc-bba0-97b67d5b70c7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
112024-10-04T22:15:04.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c3e413a9-f859-481b-a305-4aed726f979b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
122024-10-04T22:15:04.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c3e413a9-f859-481b-a305-4aed726f979b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
132024-10-04T22:15:04.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c3e413a9-f859-481b-a305-4aed726f979b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
142024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
152024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
162024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
172024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
182024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
192024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
202024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
212024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.801\u{b5}s iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
222024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
232024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
242024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
252024-10-04T22:15:04.580ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-04 22:05:04.580654881 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
262024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.03\u{b5}s iteration = 3 status = {"errors":[],"records_set_to_done":[]}
272024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
282024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
292024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
302024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
312024-10-04T22:15:04.580ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 568e0899-5775-47c6-8a59-2b161d236a0c
322024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 28.991\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"568e0899-5775-47c6-8a59-2b161d236a0c"}
332024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
342024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
352024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
362024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
372024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
382024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
392024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
402024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
412024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
422024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
432024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
442024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
452024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
462024-10-04T22:15:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.63\u{b5}s iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
472024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
482024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
492024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
502024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
512024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
522024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
532024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.801\u{b5}s iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
542024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
552024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
562024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
572024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
582024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
592024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
602024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
612024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
622024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
632024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
642024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
652024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
662024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
672024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
682024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
692024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
702024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
712024-10-04T22:15:04.581ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
722024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
732024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
742024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
752024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
762024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
772024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
782024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
792024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
802024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
812024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
822024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
832024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
842024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
852024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
862024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
872024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
882024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
892024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
902024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
912024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
922024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
932024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
942024-10-04T22:15:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
952024-10-04T22:15:04.583ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("173a8178-efd5-4ec1-9f4c-a05bc972d94c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cceb95f-37ad-478b-be36-e32fb96c3dd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 902, tv_nsec: 885131684 } })
962024-10-04T22:15:04.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
972024-10-04T22:15:04.585ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e5972f58-0215-4789-9de6-8c745fc8691c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 902, tv_nsec: 887163944 } })
982024-10-04T22:15:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
992024-10-04T22:15:04.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1002024-10-04T22:15:04.587ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1012024-10-04T22:15:04.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.780556ms iteration = 3 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1022024-10-04T22:15:04.587ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1032024-10-04T22:15:04.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.728024ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1042024-10-04T22:15:04.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1052024-10-04T22:15:04.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1062024-10-04T22:15:04.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1072024-10-04T22:15:04.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1082024-10-04T22:15:04.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1092024-10-04T22:15:04.590ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-04 22:05:04.580654881 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1102024-10-04T22:15:04.590ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.053811ms iteration = 2 status = {"expiration":"2024-10-04T22:05:04.580654881Z","pruned":[]}
1112024-10-04T22:15:04.593ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.52034ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
1122024-10-04T22:15:04.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1132024-10-04T22:15:04.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1142024-10-04T22:15:04.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1152024-10-04T22:15:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1162024-10-04T22:15:04.597ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1172024-10-04T22:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1182024-10-04T22:15:04.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1192024-10-04T22:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1202024-10-04T22:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1212024-10-04T22:15:04.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1222024-10-04T22:15:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1232024-10-04T22:15:04.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1242024-10-04T22:15:04.600ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1252024-10-04T22:15:04.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1262024-10-04T22:15:04.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1272024-10-04T22:15:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1282024-10-04T22:15:04.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1292024-10-04T22:15:04.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1302024-10-04T22:15:04.614ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 902, tv_nsec: 915720635 } })
1312024-10-04T22:15:04.614ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
1322024-10-04T22:15:04.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1332024-10-04T22:15:04.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1342024-10-04T22:15:04.616ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 902, tv_nsec: 918407919 } })
1352024-10-04T22:15:04.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1362024-10-04T22:15:04.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
1372024-10-04T22:15:04.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1382024-10-04T22:15:04.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 902, tv_nsec: 924619583 } })
1392024-10-04T22:15:04.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
1402024-10-04T22:15:04.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1412024-10-04T22:15:04.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1422024-10-04T22:15:04.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1432024-10-04T22:15:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
1442024-10-04T22:15:04.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1452024-10-04T22:15:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1462024-10-04T22:15:04.631ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1472024-10-04T22:15:04.631ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1482024-10-04T22:15:04.631ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1492024-10-04T22:15:04.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1502024-10-04T22:15:04.637ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 57.273604ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1512024-10-04T22:15:04.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1522024-10-04T22:15:04.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1532024-10-04T22:15:04.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1542024-10-04T22:15:04.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1552024-10-04T22:15:04.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1562024-10-04T22:15:04.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1572024-10-04T22:15:04.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1582024-10-04T22:15:04.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1592024-10-04T22:15:04.650ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
1602024-10-04T22:15:04.650ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
1612024-10-04T22:15:04.650ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.727683ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
1622024-10-04T22:15:04.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1632024-10-04T22:15:04.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1642024-10-04T22:15:04.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1652024-10-04T22:15:04.657ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1662024-10-04T22:15:04.657ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1672024-10-04T22:15:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1682024-10-04T22:15:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1692024-10-04T22:15:04.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1702024-10-04T22:15:04.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1712024-10-04T22:15:04.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1722024-10-04T22:15:04.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.025729ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
1732024-10-04T22:15:04.662ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1742024-10-04T22:15:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
1752024-10-04T22:15:04.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1762024-10-04T22:15:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1772024-10-04T22:15:04.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.1286ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1782024-10-04T22:15:04.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1792024-10-04T22:15:04.672ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1802024-10-04T22:15:04.675ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
1812024-10-04T22:15:04.675ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
1822024-10-04T22:15:04.675ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
1832024-10-04T22:15:04.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1842024-10-04T22:15:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1852024-10-04T22:15:04.678ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
1862024-10-04T22:15:04.678ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
1872024-10-04T22:15:04.678ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.11872ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
1882024-10-04T22:15:04.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1892024-10-04T22:15:04.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1902024-10-04T22:15:04.684ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
1912024-10-04T22:15:04.684ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
1922024-10-04T22:15:04.684ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
1932024-10-04T22:15:04.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1942024-10-04T22:15:04.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1952024-10-04T22:15:04.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1962024-10-04T22:15:04.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
1972024-10-04T22:15:04.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 104.274203ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
1982024-10-04T22:15:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1992024-10-04T22:15:04.685ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2002024-10-04T22:15:04.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2012024-10-04T22:15:04.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2022024-10-04T22:15:04.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2032024-10-04T22:15:04.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2042024-10-04T22:15:04.687ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2052024-10-04T22:15:04.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2062024-10-04T22:15:04.689ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2072024-10-04T22:15:04.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2082024-10-04T22:15:04.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2092024-10-04T22:15:04.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2102024-10-04T22:15:04.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2112024-10-04T22:15:04.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2122024-10-04T22:15:04.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2132024-10-04T22:15:04.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2142024-10-04T22:15:04.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2152024-10-04T22:15:04.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2162024-10-04T22:15:04.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2172024-10-04T22:15:04.692ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2182024-10-04T22:15:04.692ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.993557ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2192024-10-04T22:15:04.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2202024-10-04T22:15:04.695ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2212024-10-04T22:15:04.695ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2222024-10-04T22:15:04.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2232024-10-04T22:15:04.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2242024-10-04T22:15:04.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2252024-10-04T22:15:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
2262024-10-04T22:15:04.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2272024-10-04T22:15:04.697ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2282024-10-04T22:15:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2292024-10-04T22:15:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2302024-10-04T22:15:04.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2312024-10-04T22:15:04.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2322024-10-04T22:15:04.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2332024-10-04T22:15:04.700ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2342024-10-04T22:15:04.700ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2352024-10-04T22:15:04.700ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2362024-10-04T22:15:04.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2372024-10-04T22:15:04.702ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-04T22:14:02.806172Z, time_modified: 2024-10-04T22:14:02.806172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
2382024-10-04T22:15:04.702ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 121.955306ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]}},"default_endpoint":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
2392024-10-04T22:15:04.703ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.259962ms iteration = 3 status = 0
2402024-10-04T22:15:04.722ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
2412024-10-04T22:15:04.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422024-10-04T22:15:04.746ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2432024-10-04T22:15:04.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2442024-10-04T22:15:04.747ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
2452024-10-04T22:15:04.747ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 0 version = 2
2462024-10-04T22:15:04.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2472024-10-04T22:15:04.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2482024-10-04T22:15:04.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2492024-10-04T22:15:04.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2502024-10-04T22:15:04.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2512024-10-04T22:15:04.748ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2522024-10-04T22:15:04.748ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2532024-10-04T22:15:04.748ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 168.21964ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2542024-10-04T22:15:04.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2552024-10-04T22:15:04.752ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
2562024-10-04T22:15:04.752ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
2572024-10-04T22:15:04.752ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-04 22:14:36.136216 UTC dns_group = internal generation = 1
2582024-10-04T22:15:04.752ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 171.330342ms iteration = 3 status = {"generation":1}
2592024-10-04T22:15:04.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2602024-10-04T22:15:04.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2612024-10-04T22:15:04.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2622024-10-04T22:15:04.755ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 1 version = 2
2632024-10-04T22:15:04.755ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
2642024-10-04T22:15:04.755ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-04 22:14:38.170044 UTC dns_group = external generation = 2
2652024-10-04T22:15:04.755ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 174.856823ms iteration = 3 status = {"generation":2}
2662024-10-04T22:15:04.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
2672024-10-04T22:15:04.764ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2682024-10-04T22:15:04.765ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fbe8a7e-f27f-45c0-bd98-04f47fe13b03", "content-length": "26", "date": "Fri, 04 Oct 2024 22:15:03 GMT"} })
2692024-10-04T22:15:04.765ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2702024-10-04T22:15:04.767ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2712024-10-04T22:15:04.782ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
2722024-10-04T22:15:04.782ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2732024-10-04T22:15:04.782ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc61094d-1c13-4d9a-8e3e-dffc23b4c1f0", "content-length": "26", "date": "Fri, 04 Oct 2024 22:15:03 GMT"} })
2742024-10-04T22:15:04.782ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2752024-10-04T22:15:04.784ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2762024-10-04T22:15:04.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2772024-10-04T22:15:04.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2782024-10-04T22:15:04.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2792024-10-04T22:15:04.799ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
2802024-10-04T22:15:04.799ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 219.008735ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
2812024-10-04T22:15:04.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2822024-10-04T22:15:04.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2832024-10-04T22:15:04.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2842024-10-04T22:15:04.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2852024-10-04T22:15:04.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2862024-10-04T22:15:04.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2872024-10-04T22:15:04.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2882024-10-04T22:15:04.807ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2892024-10-04T22:15:04.837ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 256.782119ms iteration = 6 status = {"physical_disks_added":0}
2902024-10-04T22:15:04.897ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
2912024-10-04T22:15:04.903ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
2922024-10-04T22:15:04.903ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2932024-10-04T22:15:04.903ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2adf27c-9781-40ae-8d3c-810c2c644669", "content-length": "26", "date": "Fri, 04 Oct 2024 22:15:03 GMT"} })
2942024-10-04T22:15:04.903ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2952024-10-04T22:15:04.905ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
2962024-10-04T22:15:04.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2972024-10-04T22:15:04.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "802a7dca-b1ef-4521-b3c6-c7728bfada13", "content-length": "372", "date": "Fri, 04 Oct 2024 22:15:03 GMT"} })
2982024-10-04T22:15:04.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2992024-10-04T22:15:04.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3002024-10-04T22:15:04.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3012024-10-04T22:15:04.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3022024-10-04T22:15:04.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3032024-10-04T22:15:04.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3042024-10-04T22:15:04.971ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3052024-10-04T22:15:04.971ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "155292b5-2ddc-4e91-8e6b-15a453665f5c", "date": "Fri, 04 Oct 2024 22:15:03 GMT"} })
3062024-10-04T22:15:04.972ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.993101ms iteration = 4 status = {}
3072024-10-04T22:15:05.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3082024-10-04T22:15:05.054ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8cded60c-180e-419f-8b8c-e8235095421e", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3092024-10-04T22:15:05.054ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3102024-10-04T22:15:05.055ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3112024-10-04T22:15:05.056ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5c9c1901-918d-4171-ac45-a1277e7950a0", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3122024-10-04T22:15:05.056ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3132024-10-04T22:15:05.056ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a0de33d-4f60-4fc8-8f0b-e1f9ffb3ab51", "content-length": "1", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} })
3142024-10-04T22:15:05.060ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
3152024-10-04T22:15:05.060ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "177aa716-b3e9-426b-b2f1-ed058c7cd0f0", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3162024-10-04T22:15:05.060ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3172024-10-04T22:15:05.060ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3182024-10-04T22:15:05.060ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 480.177652ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3192024-10-04T22:15:05.061ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3202024-10-04T22:15:05.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3212024-10-04T22:15:05.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "14cc2973-e9a3-429e-b03d-c8187821629b", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3222024-10-04T22:15:05.062ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3232024-10-04T22:15:05.063ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 482.811064ms iteration = 3 status = null
3242024-10-04T22:15:05.064ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c72f20cc-b52a-4b0c-ace3-ab3d2dbcfb56", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3252024-10-04T22:15:05.064ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3262024-10-04T22:15:05.066ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
3272024-10-04T22:15:05.066ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 485.236093ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3282024-10-04T22:15:05.075ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 495.079449ms iteration = 3 status = {}
3292024-10-04T22:15:05.096ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3302024-10-04T22:15:05.097ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "201d83d4-fc7e-49c2-9eca-3dbe81c16a5b", "content-length": "691", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} })
3312024-10-04T22:15:05.097ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3322024-10-04T22:15:05.097ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3332024-10-04T22:15:05.097ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3342024-10-04T22:15:05.099ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 518.306574ms iteration = 3 status = {}
3352024-10-04T22:15:05.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3362024-10-04T22:15:05.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3372024-10-04T22:15:05.137ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
3382024-10-04T22:15:05.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3392024-10-04T22:15:05.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3402024-10-04T22:15:05.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 158f1f1a-ab48-45cd-9aa3-9ed36763c497 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
3412024-10-04T22:15:05.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 158f1f1a-ab48-45cd-9aa3-9ed36763c497 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
3422024-10-04T22:15:05.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 158f1f1a-ab48-45cd-9aa3-9ed36763c497 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
3432024-10-04T22:15:05.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = efc829c7-a0eb-4be5-bd65-74d6c2883adc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3442024-10-04T22:15:05.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = efc829c7-a0eb-4be5-bd65-74d6c2883adc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3452024-10-04T22:15:05.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = efc829c7-a0eb-4be5-bd65-74d6c2883adc response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3462024-10-04T22:15:05.219ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3472024-10-04T22:15:05.219ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7842183d-515f-4180-8c88-0b2ddae59ee1", "content-length": "121", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} })
3482024-10-04T22:15:05.219ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
3492024-10-04T22:15:05.219ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
3502024-10-04T22:15:05.220ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3512024-10-04T22:15:05.220ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3522024-10-04T22:15:05.220ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
3532024-10-04T22:15:05.220ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
3542024-10-04T22:15:05.220ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
3552024-10-04T22:15:05.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3562024-10-04T22:15:05.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3572024-10-04T22:15:05.222ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3582024-10-04T22:15:05.222ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f050b86-b4bc-40db-a8f0-310ebb4caf37", "content-length": "2", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} })
3592024-10-04T22:15:05.222ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3602024-10-04T22:15:05.222ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ec72c02-2722-4424-97c3-0a23ea8c83fd", "content-length": "52", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} })
3612024-10-04T22:15:05.222ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
3622024-10-04T22:15:05.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3632024-10-04T22:15:05.317ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "79939896-6ca4-42c8-9c12-02fa58cbed26", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} })
3642024-10-04T22:15:05.317ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
3652024-10-04T22:15:05.317ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3662024-10-04T22:15:05.416ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "613dfd86-4201-4138-848f-37fa56ac2cb4", "content-length": "667", "date": "Fri, 04 Oct 2024 22:15:04 GMT"} })
3672024-10-04T22:15:05.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3682024-10-04T22:15:05.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3692024-10-04T22:15:05.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3702024-10-04T22:15:05.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3712024-10-04T22:15:05.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3722024-10-04T22:15:05.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3732024-10-04T22:15:05.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3742024-10-04T22:15:05.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3752024-10-04T22:15:05.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = debabddd-e7e4-46fc-aa73-bf675d48b2fe roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3762024-10-04T22:15:05.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = debabddd-e7e4-46fc-aa73-bf675d48b2fe resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3772024-10-04T22:15:05.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = debabddd-e7e4-46fc-aa73-bf675d48b2fe response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3782024-10-04T22:15:05.432ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 851.286945ms iteration = 3 status = {}
3792024-10-04T22:15:06.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b8633512-ddf9-4455-869d-3d80429ba63f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3802024-10-04T22:15:06.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b8633512-ddf9-4455-869d-3d80429ba63f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3812024-10-04T22:15:06.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b8633512-ddf9-4455-869d-3d80429ba63f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3822024-10-04T22:15:07.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd9e023d-6c67-42e5-8f09-d8c112313e6e roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3832024-10-04T22:15:07.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd9e023d-6c67-42e5-8f09-d8c112313e6e resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3842024-10-04T22:15:07.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd9e023d-6c67-42e5-8f09-d8c112313e6e response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3852024-10-04T22:15:08.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 71b805a7-6566-41b9-ad71-a507dcc5cf24 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3862024-10-04T22:15:08.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 71b805a7-6566-41b9-ad71-a507dcc5cf24 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3872024-10-04T22:15:08.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 71b805a7-6566-41b9-ad71-a507dcc5cf24 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3882024-10-04T22:15:09.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 47d3735d-6e74-46fc-b1ee-42081f254c35 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3892024-10-04T22:15:09.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 47d3735d-6e74-46fc-b1ee-42081f254c35 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3902024-10-04T22:15:09.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 47d3735d-6e74-46fc-b1ee-42081f254c35 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3912024-10-04T22:15:10.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1983651a-5f84-45f1-bf04-22507ea5b5ac roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3922024-10-04T22:15:10.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1983651a-5f84-45f1-bf04-22507ea5b5ac resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3932024-10-04T22:15:10.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1983651a-5f84-45f1-bf04-22507ea5b5ac response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3942024-10-04T22:15:10.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 6751056e-fcc9-4d53-842b-e1b4f9710812 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
3952024-10-04T22:15:11.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 00271720-fbac-4a5d-aba4-1a7f70a35bb6 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3962024-10-04T22:15:11.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 00271720-fbac-4a5d-aba4-1a7f70a35bb6 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3972024-10-04T22:15:11.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 00271720-fbac-4a5d-aba4-1a7f70a35bb6 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3982024-10-04T22:15:12.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fcd6fc6e-b5ef-4b7d-92fe-dce051e4867a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
3992024-10-04T22:15:12.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fcd6fc6e-b5ef-4b7d-92fe-dce051e4867a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4002024-10-04T22:15:12.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fcd6fc6e-b5ef-4b7d-92fe-dce051e4867a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4012024-10-04T22:15:13.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ab985ef5-caf5-4055-8b44-17ac318a8f44 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4022024-10-04T22:15:13.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ab985ef5-caf5-4055-8b44-17ac318a8f44 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4032024-10-04T22:15:13.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ab985ef5-caf5-4055-8b44-17ac318a8f44 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4042024-10-04T22:15:14.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
4052024-10-04T22:15:14.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
4062024-10-04T22:15:14.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4072024-10-04T22:15:14.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4082024-10-04T22:15:14.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4092024-10-04T22:15:14.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4102024-10-04T22:15:14.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4112024-10-04T22:15:14.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4122024-10-04T22:15:14.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4132024-10-04T22:15:14.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4142024-10-04T22:15:14.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4152024-10-04T22:15:14.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4162024-10-04T22:15:14.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4172024-10-04T22:15:14.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4182024-10-04T22:15:14.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4192024-10-04T22:15:14.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
4202024-10-04T22:15:14.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4212024-10-04T22:15:14.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4222024-10-04T22:15:14.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
4232024-10-04T22:15:14.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.220164ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
4242024-10-04T22:15:14.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.893547ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4252024-10-04T22:15:14.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = dc12ec69-d357-4560-a422-4efa9d902d23 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4262024-10-04T22:15:14.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = dc12ec69-d357-4560-a422-4efa9d902d23 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4272024-10-04T22:15:14.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = dc12ec69-d357-4560-a422-4efa9d902d23 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4282024-10-04T22:15:15.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f65d28c7-8363-4a6e-a00b-1aa9b21c7f70 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4292024-10-04T22:15:15.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f65d28c7-8363-4a6e-a00b-1aa9b21c7f70 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4302024-10-04T22:15:15.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f65d28c7-8363-4a6e-a00b-1aa9b21c7f70 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4312024-10-04T22:15:16.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2c1bbffc-e774-4670-947a-84f91c84bac1 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4322024-10-04T22:15:16.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2c1bbffc-e774-4670-947a-84f91c84bac1 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4332024-10-04T22:15:16.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2c1bbffc-e774-4670-947a-84f91c84bac1 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4342024-10-04T22:15:17.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 242b5dbd-b1e9-421d-a5f0-f9a16787e090 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4352024-10-04T22:15:17.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 242b5dbd-b1e9-421d-a5f0-f9a16787e090 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4362024-10-04T22:15:17.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 242b5dbd-b1e9-421d-a5f0-f9a16787e090 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4372024-10-04T22:15:18.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a5832390-4725-454d-8680-744734ead029 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4382024-10-04T22:15:18.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a5832390-4725-454d-8680-744734ead029 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4392024-10-04T22:15:18.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a5832390-4725-454d-8680-744734ead029 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4402024-10-04T22:15:19.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 983fd003-069a-4af5-a564-f904bce9fd44 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4412024-10-04T22:15:19.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 983fd003-069a-4af5-a564-f904bce9fd44 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4422024-10-04T22:15:19.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 983fd003-069a-4af5-a564-f904bce9fd44 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4432024-10-04T22:15:20.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 84fba53a-121f-4580-9ac7-8091d13aee45 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4442024-10-04T22:15:20.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 84fba53a-121f-4580-9ac7-8091d13aee45 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4452024-10-04T22:15:20.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 84fba53a-121f-4580-9ac7-8091d13aee45 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4462024-10-04T22:15:20.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1325 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = b6dc757d-6275-40d3-baa8-cca436c23628 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
4472024-10-04T22:15:21.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e650f78d-7cdf-4371-8bc6-876cbe90e63f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4482024-10-04T22:15:21.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e650f78d-7cdf-4371-8bc6-876cbe90e63f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4492024-10-04T22:15:21.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e650f78d-7cdf-4371-8bc6-876cbe90e63f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4502024-10-04T22:15:22.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = aa8ae00f-46e7-43bb-8ddb-2c9a670f2095 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4512024-10-04T22:15:22.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = aa8ae00f-46e7-43bb-8ddb-2c9a670f2095 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4522024-10-04T22:15:22.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = aa8ae00f-46e7-43bb-8ddb-2c9a670f2095 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4532024-10-04T22:15:23.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2fe847e9-6fd5-4a4b-a55a-bd45555a67fb roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4542024-10-04T22:15:23.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2fe847e9-6fd5-4a4b-a55a-bd45555a67fb resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4552024-10-04T22:15:23.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2fe847e9-6fd5-4a4b-a55a-bd45555a67fb response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4562024-10-04T22:15:24.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
4572024-10-04T22:15:24.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4582024-10-04T22:15:24.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
4592024-10-04T22:15:24.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4602024-10-04T22:15:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4612024-10-04T22:15:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4622024-10-04T22:15:24.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4632024-10-04T22:15:24.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4642024-10-04T22:15:24.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4652024-10-04T22:15:24.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4662024-10-04T22:15:24.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4672024-10-04T22:15:24.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4682024-10-04T22:15:24.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4692024-10-04T22:15:24.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4702024-10-04T22:15:24.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4712024-10-04T22:15:24.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
4722024-10-04T22:15:24.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4732024-10-04T22:15:24.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4742024-10-04T22:15:24.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
4752024-10-04T22:15:24.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.662263ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
4762024-10-04T22:15:24.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.668432ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4772024-10-04T22:15:24.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 563aa046-3174-45f2-9326-4fd48d09cc46 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4782024-10-04T22:15:24.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 563aa046-3174-45f2-9326-4fd48d09cc46 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4792024-10-04T22:15:24.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 563aa046-3174-45f2-9326-4fd48d09cc46 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4802024-10-04T22:15:25.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4f4424c9-11ea-487c-b352-3ec302aa59c4 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4812024-10-04T22:15:25.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4f4424c9-11ea-487c-b352-3ec302aa59c4 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4822024-10-04T22:15:25.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4f4424c9-11ea-487c-b352-3ec302aa59c4 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4832024-10-04T22:15:26.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd148bca-ff86-47f2-9f70-f879662cf94c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4842024-10-04T22:15:26.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd148bca-ff86-47f2-9f70-f879662cf94c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4852024-10-04T22:15:26.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd148bca-ff86-47f2-9f70-f879662cf94c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4862024-10-04T22:15:27.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c927e5e7-0e44-4124-b83c-30f495854b69 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4872024-10-04T22:15:27.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c927e5e7-0e44-4124-b83c-30f495854b69 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4882024-10-04T22:15:27.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c927e5e7-0e44-4124-b83c-30f495854b69 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4892024-10-04T22:15:28.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ddeb6301-c873-45af-b994-b70e27bc0299 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4902024-10-04T22:15:28.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ddeb6301-c873-45af-b994-b70e27bc0299 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4912024-10-04T22:15:28.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ddeb6301-c873-45af-b994-b70e27bc0299 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4922024-10-04T22:15:29.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81317959-cbdd-4ec5-8b02-55d0041b2b7b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4932024-10-04T22:15:29.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81317959-cbdd-4ec5-8b02-55d0041b2b7b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4942024-10-04T22:15:29.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81317959-cbdd-4ec5-8b02-55d0041b2b7b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4952024-10-04T22:15:30.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1356 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = fca23c93-5189-4a79-89cd-2b57f83b9db4 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
4962024-10-04T22:15:30.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f13ea994-1554-4c87-b670-f3d8c0d23d27 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4972024-10-04T22:15:30.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f13ea994-1554-4c87-b670-f3d8c0d23d27 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4982024-10-04T22:15:30.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f13ea994-1554-4c87-b670-f3d8c0d23d27 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
4992024-10-04T22:15:31.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d47771f2-a3c2-48e0-8a38-f1cc3c38c34f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5002024-10-04T22:15:31.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d47771f2-a3c2-48e0-8a38-f1cc3c38c34f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5012024-10-04T22:15:31.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d47771f2-a3c2-48e0-8a38-f1cc3c38c34f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5022024-10-04T22:15:33.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c24894da-c626-4ff6-a167-a838a8571132 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5032024-10-04T22:15:33.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c24894da-c626-4ff6-a167-a838a8571132 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5042024-10-04T22:15:33.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c24894da-c626-4ff6-a167-a838a8571132 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5052024-10-04T22:15:34.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 693caf8e-f613-4a23-b535-2a4e3e6b4fe6 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5062024-10-04T22:15:34.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 693caf8e-f613-4a23-b535-2a4e3e6b4fe6 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5072024-10-04T22:15:34.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 693caf8e-f613-4a23-b535-2a4e3e6b4fe6 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
5082024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
5092024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5102024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
5112024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5122024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
5132024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5142024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5152024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
5162024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
5172024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.371\u{b5}s iteration = 4 status = {"errors":[],"records_set_to_done":[]}
5182024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
5192024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
5202024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
5212024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5222024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5232024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
5242024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5252024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5262024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
5272024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5282024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
5292024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.371\u{b5}s iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
5302024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
5312024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
5322024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.46\u{b5}s iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
5332024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
5342024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5352024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
5362024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.35\u{b5}s iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
5372024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
5382024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5392024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
5402024-10-04T22:15:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5412024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5422024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5432024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5442024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5452024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5462024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5472024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5482024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5492024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5502024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5512024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5522024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5532024-10-04T22:15:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5542024-10-04T22:15:34.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5552024-10-04T22:15:34.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5562024-10-04T22:15:34.584ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.666333ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5572024-10-04T22:15:34.584ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5582024-10-04T22:15:34.584ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5592024-10-04T22:15:34.584ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5602024-10-04T22:15:34.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5612024-10-04T22:15:34.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622024-10-04T22:15:34.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5632024-10-04T22:15:34.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642024-10-04T22:15:34.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652024-10-04T22:15:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5662024-10-04T22:15:34.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5672024-10-04T22:15:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5682024-10-04T22:15:34.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5692024-10-04T22:15:34.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5702024-10-04T22:15:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5712024-10-04T22:15:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5722024-10-04T22:15:34.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5732024-10-04T22:15:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5742024-10-04T22:15:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5752024-10-04T22:15:34.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5762024-10-04T22:15:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5772024-10-04T22:15:34.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 932, tv_nsec: 892529141 } })
5782024-10-04T22:15:34.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
5792024-10-04T22:15:34.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5802024-10-04T22:15:34.592ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 932, tv_nsec: 893809827 } })
5812024-10-04T22:15:34.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822024-10-04T22:15:34.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
5832024-10-04T22:15:34.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.194244ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5842024-10-04T22:15:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5852024-10-04T22:15:34.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5862024-10-04T22:15:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5872024-10-04T22:15:34.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5882024-10-04T22:15:34.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5892024-10-04T22:15:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5902024-10-04T22:15:34.594ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5912024-10-04T22:15:34.594ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
5922024-10-04T22:15:34.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5932024-10-04T22:15:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5942024-10-04T22:15:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5952024-10-04T22:15:34.595ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5962024-10-04T22:15:34.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5972024-10-04T22:15:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5982024-10-04T22:15:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5992024-10-04T22:15:34.595ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6002024-10-04T22:15:34.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6012024-10-04T22:15:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6022024-10-04T22:15:34.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6032024-10-04T22:15:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6042024-10-04T22:15:34.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 932, tv_nsec: 901687464 } })
6052024-10-04T22:15:34.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062024-10-04T22:15:34.601ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
6072024-10-04T22:15:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6082024-10-04T22:15:34.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6092024-10-04T22:15:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6102024-10-04T22:15:34.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6112024-10-04T22:15:34.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
6122024-10-04T22:15:34.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6132024-10-04T22:15:34.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6142024-10-04T22:15:34.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
6152024-10-04T22:15:34.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.018429ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
6162024-10-04T22:15:34.624ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6172024-10-04T22:15:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6182024-10-04T22:15:34.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 45.05699ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6192024-10-04T22:15:34.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6202024-10-04T22:15:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6212024-10-04T22:15:34.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6222024-10-04T22:15:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6232024-10-04T22:15:34.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6242024-10-04T22:15:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
6252024-10-04T22:15:34.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6262024-10-04T22:15:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6272024-10-04T22:15:34.639ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.56875ms iteration = 4 status = 0
6282024-10-04T22:15:34.648ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6292024-10-04T22:15:34.648ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6302024-10-04T22:15:34.648ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 67.820025ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6312024-10-04T22:15:34.653ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6322024-10-04T22:15:34.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.323565ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6332024-10-04T22:15:34.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
6342024-10-04T22:15:34.686ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6352024-10-04T22:15:34.686ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5d7fe28-6104-4101-a0fb-2461a96a7617", "content-length": "26", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
6362024-10-04T22:15:34.686ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6372024-10-04T22:15:34.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6382024-10-04T22:15:34.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6392024-10-04T22:15:34.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6402024-10-04T22:15:34.690ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
6412024-10-04T22:15:34.690ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6422024-10-04T22:15:34.690ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7050e9d-5d12-4e56-bf87-d82024720b5f", "content-length": "26", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
6432024-10-04T22:15:34.690ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6442024-10-04T22:15:34.692ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6452024-10-04T22:15:34.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
6462024-10-04T22:15:34.705ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6472024-10-04T22:15:34.705ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1aee5548-3ef9-4cd0-a148-12fa275fbce3", "content-length": "26", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
6482024-10-04T22:15:34.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6492024-10-04T22:15:34.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
6502024-10-04T22:15:34.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6512024-10-04T22:15:34.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6522024-10-04T22:15:34.776ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6532024-10-04T22:15:34.776ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb760b89-9528-46e6-b136-ece3c8151b88", "content-length": "1", "date": "Fri, 04 Oct 2024 22:15:33 GMT"} })
6542024-10-04T22:15:34.777ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6552024-10-04T22:15:34.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6562024-10-04T22:15:34.780ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6572024-10-04T22:15:34.780ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5279aea6-aa74-48dc-b91c-67f699b903d2", "content-length": "372", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
6582024-10-04T22:15:34.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6592024-10-04T22:15:34.780ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 200.015736ms iteration = 4 status = {}
6602024-10-04T22:15:34.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6612024-10-04T22:15:34.782ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6622024-10-04T22:15:34.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6632024-10-04T22:15:34.783ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.306812ms iteration = 4 status = null
6642024-10-04T22:15:34.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6652024-10-04T22:15:34.783ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6662024-10-04T22:15:34.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6672024-10-04T22:15:34.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6682024-10-04T22:15:34.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6692024-10-04T22:15:34.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6702024-10-04T22:15:34.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6712024-10-04T22:15:34.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6722024-10-04T22:15:34.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6732024-10-04T22:15:34.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6742024-10-04T22:15:34.789ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6752024-10-04T22:15:34.789ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cc72d0c6-8470-4931-bc1a-be1e43f4e50a", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
6762024-10-04T22:15:34.791ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 210.795131ms iteration = 5 status = {}
6772024-10-04T22:15:34.809ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.976364ms iteration = 7 status = {"physical_disks_added":0}
6782024-10-04T22:15:34.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6792024-10-04T22:15:34.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6802024-10-04T22:15:34.857ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
6812024-10-04T22:15:34.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6822024-10-04T22:15:34.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6832024-10-04T22:15:34.866ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
6842024-10-04T22:15:34.866ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1586c3d-4a84-4d97-b844-6f7453afe548", "content-length": "121", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
6852024-10-04T22:15:34.866ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
6862024-10-04T22:15:34.867ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
6872024-10-04T22:15:34.867ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
6882024-10-04T22:15:34.867ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
6892024-10-04T22:15:34.867ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
6902024-10-04T22:15:34.867ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
6912024-10-04T22:15:34.867ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
6922024-10-04T22:15:34.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6932024-10-04T22:15:34.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6942024-10-04T22:15:34.869ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
6952024-10-04T22:15:34.869ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a28485f-768b-43bc-b995-f024329fb703", "content-length": "2", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
6962024-10-04T22:15:34.869ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
6972024-10-04T22:15:34.869ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d47ca21-6aca-402f-81e4-e3bd063e03d3", "content-length": "52", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
6982024-10-04T22:15:34.869ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
6992024-10-04T22:15:34.869ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7002024-10-04T22:15:34.879ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7012024-10-04T22:15:34.966ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "251706be-e395-4e13-970b-8f66238ee574", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
7022024-10-04T22:15:34.966ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
7032024-10-04T22:15:34.966ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7042024-10-04T22:15:34.966ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7240834e-2901-441a-8280-5673868087de", "content-length": "667", "date": "Fri, 04 Oct 2024 22:15:34 GMT"} })
7052024-10-04T22:15:34.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7062024-10-04T22:15:34.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7072024-10-04T22:15:34.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "def4656d-d4ef-422c-ae03-937b70ec9f15", "content-length": "691", "date": "Fri, 04 Oct 2024 22:15:33 GMT"} })
7082024-10-04T22:15:34.967ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
7092024-10-04T22:15:34.967ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
7102024-10-04T22:15:34.967ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
7112024-10-04T22:15:34.968ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 388.091883ms iteration = 4 status = {}
7122024-10-04T22:15:34.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7132024-10-04T22:15:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7142024-10-04T22:15:34.971ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7152024-10-04T22:15:34.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7162024-10-04T22:15:34.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7172024-10-04T22:15:34.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7182024-10-04T22:15:34.981ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 401.080132ms iteration = 4 status = {}
7192024-10-04T22:15:35.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10cc12ce-4834-49cb-9711-cc6d99e8a630 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7202024-10-04T22:15:35.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10cc12ce-4834-49cb-9711-cc6d99e8a630 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7212024-10-04T22:15:35.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10cc12ce-4834-49cb-9711-cc6d99e8a630 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7222024-10-04T22:15:35.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 21dacadb-d889-4398-8fa9-6bb4a2e37cb2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
7232024-10-04T22:15:35.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 21dacadb-d889-4398-8fa9-6bb4a2e37cb2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
7242024-10-04T22:15:35.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 21dacadb-d889-4398-8fa9-6bb4a2e37cb2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
7252024-10-04T22:15:36.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = afe14a68-2f84-424a-a8ab-6ef5ba59224b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7262024-10-04T22:15:36.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = afe14a68-2f84-424a-a8ab-6ef5ba59224b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7272024-10-04T22:15:36.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = afe14a68-2f84-424a-a8ab-6ef5ba59224b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7282024-10-04T22:15:37.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d48eaeeb-e741-48bd-983a-7a7da9b3fc73 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7292024-10-04T22:15:37.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d48eaeeb-e741-48bd-983a-7a7da9b3fc73 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7302024-10-04T22:15:37.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d48eaeeb-e741-48bd-983a-7a7da9b3fc73 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7312024-10-04T22:15:38.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e555db4a-1c0a-45a1-a506-82685a00f71a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7322024-10-04T22:15:38.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e555db4a-1c0a-45a1-a506-82685a00f71a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7332024-10-04T22:15:38.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e555db4a-1c0a-45a1-a506-82685a00f71a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7342024-10-04T22:15:39.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0c8d6a6f-4e63-4e96-8554-0cb9deb5ab5b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7352024-10-04T22:15:39.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0c8d6a6f-4e63-4e96-8554-0cb9deb5ab5b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7362024-10-04T22:15:39.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0c8d6a6f-4e63-4e96-8554-0cb9deb5ab5b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7372024-10-04T22:15:40.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ea5ab714-711f-41e1-b797-b87d5182add4 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7382024-10-04T22:15:40.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ea5ab714-711f-41e1-b797-b87d5182add4 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7392024-10-04T22:15:40.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ea5ab714-711f-41e1-b797-b87d5182add4 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7402024-10-04T22:15:40.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1749 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 7bfa2e76-b5e7-4692-a03b-0ba65cfc56a7 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
7412024-10-04T22:15:41.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 23be939b-707f-40a1-99dc-b5c785311a68 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7422024-10-04T22:15:41.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 23be939b-707f-40a1-99dc-b5c785311a68 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7432024-10-04T22:15:41.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 23be939b-707f-40a1-99dc-b5c785311a68 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7442024-10-04T22:15:42.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7d924643-9279-46fb-8ec5-ea184be12d79 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7452024-10-04T22:15:42.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7d924643-9279-46fb-8ec5-ea184be12d79 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7462024-10-04T22:15:42.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7d924643-9279-46fb-8ec5-ea184be12d79 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7472024-10-04T22:15:43.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ee5ffdb9-86cf-432a-86fd-a7dbe9c674b1 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7482024-10-04T22:15:43.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ee5ffdb9-86cf-432a-86fd-a7dbe9c674b1 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7492024-10-04T22:15:43.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ee5ffdb9-86cf-432a-86fd-a7dbe9c674b1 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7502024-10-04T22:15:44.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f4bff7b0-6289-4664-93f5-fc6e7ac0770d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7512024-10-04T22:15:44.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f4bff7b0-6289-4664-93f5-fc6e7ac0770d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7522024-10-04T22:15:44.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f4bff7b0-6289-4664-93f5-fc6e7ac0770d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7532024-10-04T22:15:44.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
7542024-10-04T22:15:44.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
7552024-10-04T22:15:44.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7562024-10-04T22:15:44.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7572024-10-04T22:15:44.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7582024-10-04T22:15:44.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7592024-10-04T22:15:44.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602024-10-04T22:15:44.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7612024-10-04T22:15:44.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7622024-10-04T22:15:44.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.115352ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7632024-10-04T22:15:44.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7642024-10-04T22:15:44.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7652024-10-04T22:15:44.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7662024-10-04T22:15:44.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7672024-10-04T22:15:44.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7682024-10-04T22:15:44.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692024-10-04T22:15:44.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
7702024-10-04T22:15:44.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7712024-10-04T22:15:44.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7722024-10-04T22:15:44.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
7732024-10-04T22:15:44.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.370577ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
7742024-10-04T22:15:45.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9f15df33-09a8-47ce-850d-685fedd5f31b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7752024-10-04T22:15:45.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9f15df33-09a8-47ce-850d-685fedd5f31b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7762024-10-04T22:15:45.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9f15df33-09a8-47ce-850d-685fedd5f31b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7772024-10-04T22:15:46.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cc8c82e1-1939-4a05-b5a8-39a3f066eb8f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7782024-10-04T22:15:46.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cc8c82e1-1939-4a05-b5a8-39a3f066eb8f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7792024-10-04T22:15:46.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cc8c82e1-1939-4a05-b5a8-39a3f066eb8f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7802024-10-04T22:15:47.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 38d91bc3-6704-4c5a-906e-ae73538e5916 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7812024-10-04T22:15:47.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 38d91bc3-6704-4c5a-906e-ae73538e5916 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7822024-10-04T22:15:47.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 38d91bc3-6704-4c5a-906e-ae73538e5916 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7832024-10-04T22:15:48.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8283f385-0114-4b27-919c-9b25e4055b05 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7842024-10-04T22:15:48.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8283f385-0114-4b27-919c-9b25e4055b05 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7852024-10-04T22:15:48.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8283f385-0114-4b27-919c-9b25e4055b05 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7862024-10-04T22:15:49.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = db8657e1-79ac-43ea-9d13-b7135bc0ea98 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7872024-10-04T22:15:49.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = db8657e1-79ac-43ea-9d13-b7135bc0ea98 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7882024-10-04T22:15:49.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = db8657e1-79ac-43ea-9d13-b7135bc0ea98 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7892024-10-04T22:15:50.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c23edf6c-3812-4896-93b8-1a21a181c110 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7902024-10-04T22:15:50.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c23edf6c-3812-4896-93b8-1a21a181c110 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7912024-10-04T22:15:50.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c23edf6c-3812-4896-93b8-1a21a181c110 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7922024-10-04T22:15:50.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1363 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = d741851e-e6d1-4534-b0eb-0accb9e30cc7 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
7932024-10-04T22:15:51.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4058abbc-5bcd-45fa-a772-4bcc8289570b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7942024-10-04T22:15:51.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4058abbc-5bcd-45fa-a772-4bcc8289570b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7952024-10-04T22:15:51.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4058abbc-5bcd-45fa-a772-4bcc8289570b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7962024-10-04T22:15:52.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f891e6cc-9ba2-426f-81f8-e9d5056dabff roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7972024-10-04T22:15:52.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f891e6cc-9ba2-426f-81f8-e9d5056dabff resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7982024-10-04T22:15:52.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f891e6cc-9ba2-426f-81f8-e9d5056dabff response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
7992024-10-04T22:15:53.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b6e8b770-5506-4013-9cc7-cfc060a4be3d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8002024-10-04T22:15:53.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b6e8b770-5506-4013-9cc7-cfc060a4be3d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8012024-10-04T22:15:53.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b6e8b770-5506-4013-9cc7-cfc060a4be3d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8022024-10-04T22:15:54.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1ca8371b-c68c-4384-b0e2-eb598301d5f9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8032024-10-04T22:15:54.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1ca8371b-c68c-4384-b0e2-eb598301d5f9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8042024-10-04T22:15:54.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1ca8371b-c68c-4384-b0e2-eb598301d5f9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8052024-10-04T22:15:54.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
8062024-10-04T22:15:54.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
8072024-10-04T22:15:54.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8082024-10-04T22:15:54.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8092024-10-04T22:15:54.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8102024-10-04T22:15:54.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8112024-10-04T22:15:54.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8122024-10-04T22:15:54.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8132024-10-04T22:15:54.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8142024-10-04T22:15:54.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.730014ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8152024-10-04T22:15:54.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8162024-10-04T22:15:54.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8172024-10-04T22:15:54.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8182024-10-04T22:15:54.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8192024-10-04T22:15:54.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8202024-10-04T22:15:54.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8212024-10-04T22:15:54.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
8222024-10-04T22:15:54.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8232024-10-04T22:15:54.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8242024-10-04T22:15:54.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
8252024-10-04T22:15:54.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.594012ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
8262024-10-04T22:15:55.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10281dcb-24ff-4576-aec9-a3fb5f37d4b8 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8272024-10-04T22:15:55.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10281dcb-24ff-4576-aec9-a3fb5f37d4b8 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8282024-10-04T22:15:55.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10281dcb-24ff-4576-aec9-a3fb5f37d4b8 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8292024-10-04T22:15:56.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5682db6a-962a-468f-a909-453c23eeb84f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8302024-10-04T22:15:56.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5682db6a-962a-468f-a909-453c23eeb84f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8312024-10-04T22:15:56.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5682db6a-962a-468f-a909-453c23eeb84f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8322024-10-04T22:15:57.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 442b815f-8138-43be-8810-cf602953b2f3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8332024-10-04T22:15:57.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 442b815f-8138-43be-8810-cf602953b2f3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8342024-10-04T22:15:57.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 442b815f-8138-43be-8810-cf602953b2f3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8352024-10-04T22:15:58.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a37511df-c41b-47fa-a385-291dfac29e40 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8362024-10-04T22:15:58.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a37511df-c41b-47fa-a385-291dfac29e40 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8372024-10-04T22:15:58.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a37511df-c41b-47fa-a385-291dfac29e40 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8382024-10-04T22:15:59.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e1cc100b-d068-4fa3-b299-5b30a19e05c1 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8392024-10-04T22:15:59.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e1cc100b-d068-4fa3-b299-5b30a19e05c1 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8402024-10-04T22:15:59.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e1cc100b-d068-4fa3-b299-5b30a19e05c1 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8412024-10-04T22:16:00.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f6740342-1f6a-4256-b1a6-672b5ed4911a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8422024-10-04T22:16:00.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f6740342-1f6a-4256-b1a6-672b5ed4911a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8432024-10-04T22:16:00.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f6740342-1f6a-4256-b1a6-672b5ed4911a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8442024-10-04T22:16:00.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1529 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 546d69ac-1d62-47c6-a5ac-ec86c17170e3 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
8452024-10-04T22:16:01.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 788e9a9d-7b0c-44d9-aed3-07c9e55218c1 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8462024-10-04T22:16:01.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 788e9a9d-7b0c-44d9-aed3-07c9e55218c1 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8472024-10-04T22:16:01.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 788e9a9d-7b0c-44d9-aed3-07c9e55218c1 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8482024-10-04T22:16:02.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b78ad66d-1b63-4f14-8485-25fecc0902c3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8492024-10-04T22:16:02.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b78ad66d-1b63-4f14-8485-25fecc0902c3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8502024-10-04T22:16:02.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b78ad66d-1b63-4f14-8485-25fecc0902c3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8512024-10-04T22:16:03.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0927a5b9-ee71-4696-980e-bef55e9d4aad roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8522024-10-04T22:16:03.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0927a5b9-ee71-4696-980e-bef55e9d4aad resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8532024-10-04T22:16:03.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0927a5b9-ee71-4696-980e-bef55e9d4aad response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
8542024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
8552024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
8562024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8572024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.44\u{b5}s iteration = 5 status = {"errors":[],"records_set_to_done":[]}
8582024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
8592024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
8602024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
8612024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
8622024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8632024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
8642024-10-04T22:16:04.581ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-04 22:06:04.581066879 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
8652024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
8662024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
8672024-10-04T22:16:04.581ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
8682024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8692024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
8702024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
8712024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8722024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
8732024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
8742024-10-04T22:16:04.581ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 568e0899-5775-47c6-8a59-2b161d236a0c
8752024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.72\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"568e0899-5775-47c6-8a59-2b161d236a0c"}
8762024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
8772024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
8782024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8792024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
8802024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
8812024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8822024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
8832024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8842024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
8852024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
8862024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8872024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8882024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
8892024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.741\u{b5}s iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
8902024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
8912024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
8922024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
8932024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.41\u{b5}s iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
8942024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
8952024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
8962024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
8972024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8982024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
8992024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
9002024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9012024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
9022024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9032024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
9042024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9052024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
9062024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
9072024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 16.49\u{b5}s iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
9082024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9092024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
9102024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
9112024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9122024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9132024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
9142024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9152024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
9162024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9172024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9182024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
9192024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9202024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9212024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9222024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9232024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
9242024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9252024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9262024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9272024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9282024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9292024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9302024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
9312024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9322024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9332024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9342024-10-04T22:16:04.581ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e5972f58-0215-4789-9de6-8c745fc8691c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 962, tv_nsec: 883586273 } })
9352024-10-04T22:16:04.581ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("173a8178-efd5-4ec1-9f4c-a05bc972d94c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cceb95f-37ad-478b-be36-e32fb96c3dd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 962, tv_nsec: 883592703 } })
9362024-10-04T22:16:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9372024-10-04T22:16:04.583ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9382024-10-04T22:16:04.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9392024-10-04T22:16:04.584ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
9402024-10-04T22:16:04.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.662403ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
9412024-10-04T22:16:04.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9422024-10-04T22:16:04.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9432024-10-04T22:16:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9442024-10-04T22:16:04.586ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.203844ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9452024-10-04T22:16:04.586ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-04 22:06:04.581066879 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
9462024-10-04T22:16:04.586ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.361377ms iteration = 3 status = {"expiration":"2024-10-04T22:06:04.581066879Z","pruned":[]}
9472024-10-04T22:16:04.586ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
9482024-10-04T22:16:04.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.652513ms iteration = 4 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
9492024-10-04T22:16:04.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
9502024-10-04T22:16:04.587ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9512024-10-04T22:16:04.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
9522024-10-04T22:16:04.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9532024-10-04T22:16:04.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9542024-10-04T22:16:04.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
9552024-10-04T22:16:04.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9562024-10-04T22:16:04.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9572024-10-04T22:16:04.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9582024-10-04T22:16:04.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9592024-10-04T22:16:04.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 962, tv_nsec: 893623224 } })
9602024-10-04T22:16:04.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
9612024-10-04T22:16:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
9622024-10-04T22:16:04.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9632024-10-04T22:16:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9642024-10-04T22:16:04.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9652024-10-04T22:16:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9662024-10-04T22:16:04.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9672024-10-04T22:16:04.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9682024-10-04T22:16:04.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9692024-10-04T22:16:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9702024-10-04T22:16:04.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9712024-10-04T22:16:04.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 962, tv_nsec: 907372678 } })
9722024-10-04T22:16:04.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
9732024-10-04T22:16:04.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
9742024-10-04T22:16:04.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9752024-10-04T22:16:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9762024-10-04T22:16:04.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9772024-10-04T22:16:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9782024-10-04T22:16:04.617ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 36.362076ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
9792024-10-04T22:16:04.619ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
9802024-10-04T22:16:04.619ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
9812024-10-04T22:16:04.619ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 38.672883ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
9822024-10-04T22:16:04.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9832024-10-04T22:16:04.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9842024-10-04T22:16:04.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9852024-10-04T22:16:04.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9862024-10-04T22:16:04.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 962, tv_nsec: 924397328 } })
9872024-10-04T22:16:04.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
9882024-10-04T22:16:04.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9892024-10-04T22:16:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9902024-10-04T22:16:04.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9912024-10-04T22:16:04.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9922024-10-04T22:16:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
9932024-10-04T22:16:04.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9942024-10-04T22:16:04.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9952024-10-04T22:16:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9962024-10-04T22:16:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9972024-10-04T22:16:04.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9982024-10-04T22:16:04.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9992024-10-04T22:16:04.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
10002024-10-04T22:16:04.635ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10012024-10-04T22:16:04.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10022024-10-04T22:16:04.641ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
10032024-10-04T22:16:04.641ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.397026ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
10042024-10-04T22:16:04.653ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10052024-10-04T22:16:04.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10062024-10-04T22:16:04.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10072024-10-04T22:16:04.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10082024-10-04T22:16:04.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10092024-10-04T22:16:04.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10102024-10-04T22:16:04.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10112024-10-04T22:16:04.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10122024-10-04T22:16:04.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10132024-10-04T22:16:04.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10142024-10-04T22:16:04.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10152024-10-04T22:16:04.660ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10162024-10-04T22:16:04.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10172024-10-04T22:16:04.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10182024-10-04T22:16:04.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10192024-10-04T22:16:04.661ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
10202024-10-04T22:16:04.661ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
10212024-10-04T22:16:04.661ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.186572ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
10222024-10-04T22:16:04.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10232024-10-04T22:16:04.665ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10242024-10-04T22:16:04.665ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10252024-10-04T22:16:04.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10262024-10-04T22:16:04.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10272024-10-04T22:16:04.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10282024-10-04T22:16:04.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10292024-10-04T22:16:04.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10302024-10-04T22:16:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10312024-10-04T22:16:04.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10322024-10-04T22:16:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10332024-10-04T22:16:04.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10342024-10-04T22:16:04.670ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
10352024-10-04T22:16:04.670ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
10362024-10-04T22:16:04.670ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
10372024-10-04T22:16:04.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10382024-10-04T22:16:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10392024-10-04T22:16:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
10402024-10-04T22:16:04.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10412024-10-04T22:16:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10422024-10-04T22:16:04.672ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10432024-10-04T22:16:04.672ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10442024-10-04T22:16:04.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10452024-10-04T22:16:04.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10462024-10-04T22:16:04.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10472024-10-04T22:16:04.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10482024-10-04T22:16:04.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10492024-10-04T22:16:04.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10502024-10-04T22:16:04.688ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10512024-10-04T22:16:04.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10522024-10-04T22:16:04.693ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10532024-10-04T22:16:04.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10542024-10-04T22:16:04.710ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
10552024-10-04T22:16:04.710ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
10562024-10-04T22:16:04.710ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
10572024-10-04T22:16:04.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10582024-10-04T22:16:04.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10592024-10-04T22:16:04.710ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
10602024-10-04T22:16:04.711ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 130.100778ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10612024-10-04T22:16:04.715ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.920165ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10622024-10-04T22:16:04.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
10632024-10-04T22:16:04.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b2d1934c-c25a-4c89-8ee4-12e451c733c9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
10642024-10-04T22:16:04.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b2d1934c-c25a-4c89-8ee4-12e451c733c9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
10652024-10-04T22:16:04.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10662024-10-04T22:16:04.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10672024-10-04T22:16:04.767ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
10682024-10-04T22:16:04.767ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10692024-10-04T22:16:04.767ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2020c9e6-f2dd-4f35-9d07-674f08e07b0e", "content-length": "26", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
10702024-10-04T22:16:04.767ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10712024-10-04T22:16:04.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10722024-10-04T22:16:04.831ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
10732024-10-04T22:16:04.831ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10742024-10-04T22:16:04.832ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d78f62e8-daa4-4f32-9654-1af86dcf0937", "content-length": "26", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
10752024-10-04T22:16:04.832ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10762024-10-04T22:16:04.833ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10772024-10-04T22:16:04.849ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10782024-10-04T22:16:04.850ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "97def262-301a-4039-973b-9ded852ae0af", "content-length": "372", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
10792024-10-04T22:16:04.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10802024-10-04T22:16:04.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10812024-10-04T22:16:04.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822024-10-04T22:16:04.853ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 272.125676ms iteration = 5 status = 0
10832024-10-04T22:16:04.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10842024-10-04T22:16:04.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10852024-10-04T22:16:04.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10862024-10-04T22:16:04.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b2d1934c-c25a-4c89-8ee4-12e451c733c9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
10872024-10-04T22:16:04.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10882024-10-04T22:16:04.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10892024-10-04T22:16:04.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10902024-10-04T22:16:04.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
10912024-10-04T22:16:04.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10922024-10-04T22:16:04.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10932024-10-04T22:16:04.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10942024-10-04T22:16:04.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10952024-10-04T22:16:04.864ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
10962024-10-04T22:16:04.866ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "314700d6-71d5-4bb5-82ff-224646eb226b", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
10972024-10-04T22:16:04.867ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 286.314859ms iteration = 6 status = {}
10982024-10-04T22:16:04.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10992024-10-04T22:16:04.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11002024-10-04T22:16:04.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11012024-10-04T22:16:04.886ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11022024-10-04T22:16:04.886ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 305.585614ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11032024-10-04T22:16:04.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11042024-10-04T22:16:04.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11052024-10-04T22:16:04.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11062024-10-04T22:16:04.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11072024-10-04T22:16:04.887ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11082024-10-04T22:16:04.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11092024-10-04T22:16:04.888ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11102024-10-04T22:16:04.888ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11112024-10-04T22:16:04.888ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 306.808979ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11122024-10-04T22:16:04.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11132024-10-04T22:16:04.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11142024-10-04T22:16:04.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11152024-10-04T22:16:04.896ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
11162024-10-04T22:16:04.896ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
11172024-10-04T22:16:04.896ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11182024-10-04T22:16:04.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11192024-10-04T22:16:04.897ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
11202024-10-04T22:16:04.897ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11212024-10-04T22:16:04.897ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ec11ee7-1043-42b4-86ae-a3d29f6afbbb", "content-length": "26", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
11222024-10-04T22:16:04.897ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11232024-10-04T22:16:04.898ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11242024-10-04T22:16:04.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
11252024-10-04T22:16:04.899ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
11262024-10-04T22:16:04.899ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4cbe8910-86d7-453a-9388-76106799bb09", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11272024-10-04T22:16:04.900ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11282024-10-04T22:16:04.901ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8563ff59-44ec-4523-8d7b-8e25ce7e92cb", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11292024-10-04T22:16:04.901ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11302024-10-04T22:16:04.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11312024-10-04T22:16:04.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11322024-10-04T22:16:04.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11332024-10-04T22:16:04.905ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11342024-10-04T22:16:04.905ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 324.692086ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
11352024-10-04T22:16:04.918ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
11362024-10-04T22:16:04.918ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
11372024-10-04T22:16:04.918ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-04 22:14:36.136216 UTC dns_group = internal generation = 1
11382024-10-04T22:16:04.918ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 336.92633ms iteration = 4 status = {"generation":1}
11392024-10-04T22:16:04.936ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
11402024-10-04T22:16:04.936ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 0 version = 2
11412024-10-04T22:16:04.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11422024-10-04T22:16:04.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11432024-10-04T22:16:04.940ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-04T22:14:02.806172Z, time_modified: 2024-10-04T22:14:02.806172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
11442024-10-04T22:16:04.940ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 358.990821ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]}},"default_endpoint":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
11452024-10-04T22:16:04.949ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
11462024-10-04T22:16:04.952ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
11472024-10-04T22:16:04.952ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 371.646434ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
11482024-10-04T22:16:04.966ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 384.802396ms iteration = 8 status = {"physical_disks_added":0}
11492024-10-04T22:16:04.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11502024-10-04T22:16:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11512024-10-04T22:16:04.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11522024-10-04T22:16:04.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11532024-10-04T22:16:04.976ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 1 version = 2
11542024-10-04T22:16:04.976ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
11552024-10-04T22:16:04.976ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-04 22:14:38.170044 UTC dns_group = external generation = 2
11562024-10-04T22:16:04.976ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 394.718684ms iteration = 4 status = {"generation":2}
11572024-10-04T22:16:05.026ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 445.751954ms iteration = 5 status = {}
11582024-10-04T22:16:05.042ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11592024-10-04T22:16:05.043ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cc706a6-2de6-4395-8ed1-05d265be6137", "content-length": "1", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
11602024-10-04T22:16:05.044ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11612024-10-04T22:16:05.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11622024-10-04T22:16:05.046ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 465.150201ms iteration = 5 status = null
11632024-10-04T22:16:05.071ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11642024-10-04T22:16:05.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e69e5f2d-cf4b-42fa-ac2b-463ff57cfbfa", "content-length": "691", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
11652024-10-04T22:16:05.072ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11662024-10-04T22:16:05.072ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11672024-10-04T22:16:05.072ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11682024-10-04T22:16:05.073ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 492.182072ms iteration = 5 status = {}
11692024-10-04T22:16:05.089ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
11702024-10-04T22:16:05.089ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c918b0f0-8441-4f6d-b35f-27d5792fa95e", "date": "Fri, 04 Oct 2024 22:16:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
11712024-10-04T22:16:05.089ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
11722024-10-04T22:16:05.091ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "503bd559-3c94-4b47-90b1-e31a5c007c4a", "date": "Fri, 04 Oct 2024 22:16:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
11732024-10-04T22:16:05.091ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
11742024-10-04T22:16:05.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8851a246-6cc4-4920-a9d3-4d6935ef4ab0", "date": "Fri, 04 Oct 2024 22:16:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
11752024-10-04T22:16:05.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
11762024-10-04T22:16:05.094ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
11772024-10-04T22:16:05.094ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 513.263403ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
11782024-10-04T22:16:05.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11792024-10-04T22:16:05.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11802024-10-04T22:16:05.131ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
11812024-10-04T22:16:05.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11822024-10-04T22:16:05.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11832024-10-04T22:16:05.142ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11842024-10-04T22:16:05.142ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e6b8b58-06a8-47bf-96f6-7aa8f159f694", "content-length": "121", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
11852024-10-04T22:16:05.142ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
11862024-10-04T22:16:05.142ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
11872024-10-04T22:16:05.143ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11882024-10-04T22:16:05.143ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11892024-10-04T22:16:05.143ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
11902024-10-04T22:16:05.143ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
11912024-10-04T22:16:05.143ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
11922024-10-04T22:16:05.143ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11932024-10-04T22:16:05.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11942024-10-04T22:16:05.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11952024-10-04T22:16:05.145ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9905c0cd-51e6-4f61-890a-fb9ceb65549a", "content-length": "2", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
11962024-10-04T22:16:05.145ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11972024-10-04T22:16:05.145ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "08c24559-c85c-449f-b86c-45185edce291", "content-length": "52", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
11982024-10-04T22:16:05.145ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
11992024-10-04T22:16:05.145ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12002024-10-04T22:16:05.244ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dcb2ffd1-3d1d-44d2-b9ba-ff10ff4926a9", "date": "Fri, 04 Oct 2024 22:16:04 GMT"} })
12012024-10-04T22:16:05.244ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
12022024-10-04T22:16:05.244ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12032024-10-04T22:16:05.244ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e28aed46-8e1e-411c-ac0c-99e9a55de614", "content-length": "667", "date": "Fri, 04 Oct 2024 22:16:05 GMT"} })
12042024-10-04T22:16:05.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12052024-10-04T22:16:05.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12062024-10-04T22:16:05.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12072024-10-04T22:16:05.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12082024-10-04T22:16:05.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12092024-10-04T22:16:05.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12102024-10-04T22:16:05.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = fdcae5e8-8e08-4a7e-ad6c-0427f30a0444 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12112024-10-04T22:16:05.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = fdcae5e8-8e08-4a7e-ad6c-0427f30a0444 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12122024-10-04T22:16:05.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12132024-10-04T22:16:05.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12142024-10-04T22:16:05.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = fdcae5e8-8e08-4a7e-ad6c-0427f30a0444 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12152024-10-04T22:16:05.261ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 680.477523ms iteration = 5 status = {}
12162024-10-04T22:16:05.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7317497f-c5d9-4f52-b932-636e1cc2fae4 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12172024-10-04T22:16:05.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7317497f-c5d9-4f52-b932-636e1cc2fae4 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12182024-10-04T22:16:05.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7317497f-c5d9-4f52-b932-636e1cc2fae4 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12192024-10-04T22:16:06.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 14e3f216-5f5a-4506-ac74-ac3bbda9ab0d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12202024-10-04T22:16:06.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 14e3f216-5f5a-4506-ac74-ac3bbda9ab0d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12212024-10-04T22:16:06.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 14e3f216-5f5a-4506-ac74-ac3bbda9ab0d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12222024-10-04T22:16:07.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6e18bc7a-93a7-4b0c-9ee2-e728027fde32 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12232024-10-04T22:16:07.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6e18bc7a-93a7-4b0c-9ee2-e728027fde32 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12242024-10-04T22:16:07.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6e18bc7a-93a7-4b0c-9ee2-e728027fde32 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12252024-10-04T22:16:08.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 63e3886d-5c01-4c1a-8563-0dec24ec2849 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12262024-10-04T22:16:08.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 63e3886d-5c01-4c1a-8563-0dec24ec2849 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12272024-10-04T22:16:08.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 63e3886d-5c01-4c1a-8563-0dec24ec2849 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12282024-10-04T22:16:09.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5fb13358-63e8-47b7-a090-fce1b9061e5a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12292024-10-04T22:16:09.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5fb13358-63e8-47b7-a090-fce1b9061e5a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12302024-10-04T22:16:09.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5fb13358-63e8-47b7-a090-fce1b9061e5a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12312024-10-04T22:16:10.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1603 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 0a4fc2c1-d287-44ce-8e33-7c415e942f9d response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
12322024-10-04T22:16:10.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 238836ff-6ebb-4496-bf51-a3e7bdf530d9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12332024-10-04T22:16:10.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 238836ff-6ebb-4496-bf51-a3e7bdf530d9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12342024-10-04T22:16:10.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 238836ff-6ebb-4496-bf51-a3e7bdf530d9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12352024-10-04T22:16:12.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = af5a440f-fdca-4ffb-acf8-726a7c7ef848 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12362024-10-04T22:16:12.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = af5a440f-fdca-4ffb-acf8-726a7c7ef848 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12372024-10-04T22:16:12.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = af5a440f-fdca-4ffb-acf8-726a7c7ef848 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12382024-10-04T22:16:13.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c525bbd-6e4e-4e35-aef1-71b45757c6ba roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12392024-10-04T22:16:13.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c525bbd-6e4e-4e35-aef1-71b45757c6ba resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12402024-10-04T22:16:13.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c525bbd-6e4e-4e35-aef1-71b45757c6ba response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12412024-10-04T22:16:14.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f2ef108b-591a-40b1-9f25-e02202961ac7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12422024-10-04T22:16:14.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f2ef108b-591a-40b1-9f25-e02202961ac7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12432024-10-04T22:16:14.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f2ef108b-591a-40b1-9f25-e02202961ac7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12442024-10-04T22:16:14.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
12452024-10-04T22:16:14.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12462024-10-04T22:16:14.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
12472024-10-04T22:16:14.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12482024-10-04T22:16:14.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12492024-10-04T22:16:14.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12502024-10-04T22:16:14.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12512024-10-04T22:16:14.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12522024-10-04T22:16:14.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12532024-10-04T22:16:14.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12542024-10-04T22:16:14.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12552024-10-04T22:16:14.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12562024-10-04T22:16:14.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12572024-10-04T22:16:14.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
12582024-10-04T22:16:14.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12592024-10-04T22:16:14.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12602024-10-04T22:16:14.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
12612024-10-04T22:16:14.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.52845ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
12622024-10-04T22:16:14.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12632024-10-04T22:16:14.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12642024-10-04T22:16:14.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.673592ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12652024-10-04T22:16:15.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 478ae1c0-3ab6-4811-bdb4-a9c486cf3274 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12662024-10-04T22:16:15.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 478ae1c0-3ab6-4811-bdb4-a9c486cf3274 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12672024-10-04T22:16:15.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 478ae1c0-3ab6-4811-bdb4-a9c486cf3274 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12682024-10-04T22:16:16.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ce9077c0-5d71-4592-9303-869e1653e85f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12692024-10-04T22:16:16.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ce9077c0-5d71-4592-9303-869e1653e85f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12702024-10-04T22:16:16.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ce9077c0-5d71-4592-9303-869e1653e85f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12712024-10-04T22:16:17.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 49ffa9a7-55fb-4498-980d-f7d201cfde16 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12722024-10-04T22:16:17.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 49ffa9a7-55fb-4498-980d-f7d201cfde16 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12732024-10-04T22:16:17.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 49ffa9a7-55fb-4498-980d-f7d201cfde16 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12742024-10-04T22:16:18.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ffc1cae4-96a1-45f6-b1d6-d25bdb3e7fa7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12752024-10-04T22:16:18.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ffc1cae4-96a1-45f6-b1d6-d25bdb3e7fa7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12762024-10-04T22:16:18.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ffc1cae4-96a1-45f6-b1d6-d25bdb3e7fa7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12772024-10-04T22:16:19.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 76ea3101-6164-45a8-8ffc-d23eee61d501 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12782024-10-04T22:16:19.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 76ea3101-6164-45a8-8ffc-d23eee61d501 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12792024-10-04T22:16:19.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 76ea3101-6164-45a8-8ffc-d23eee61d501 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12802024-10-04T22:16:20.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6d57d74d-ae3f-4d6f-8bde-18e73b5f7744 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12812024-10-04T22:16:20.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6d57d74d-ae3f-4d6f-8bde-18e73b5f7744 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12822024-10-04T22:16:20.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6d57d74d-ae3f-4d6f-8bde-18e73b5f7744 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12832024-10-04T22:16:20.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1817 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = f6ce9d39-3926-4b37-af34-3918460c65b5 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
12842024-10-04T22:16:21.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 87eae939-3e11-4ac2-a9d0-18aa5e1cad93 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12852024-10-04T22:16:21.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 87eae939-3e11-4ac2-a9d0-18aa5e1cad93 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12862024-10-04T22:16:21.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 87eae939-3e11-4ac2-a9d0-18aa5e1cad93 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12872024-10-04T22:16:22.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a919df51-9846-4261-a953-cf64054d5443 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12882024-10-04T22:16:22.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a919df51-9846-4261-a953-cf64054d5443 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12892024-10-04T22:16:22.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a919df51-9846-4261-a953-cf64054d5443 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12902024-10-04T22:16:23.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a1d76945-6a05-4457-a48e-87ddb8ae7cd3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12912024-10-04T22:16:23.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a1d76945-6a05-4457-a48e-87ddb8ae7cd3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12922024-10-04T22:16:23.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a1d76945-6a05-4457-a48e-87ddb8ae7cd3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12932024-10-04T22:16:24.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 72c50379-50b1-4273-9a7b-9effcea3dfa3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12942024-10-04T22:16:24.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 72c50379-50b1-4273-9a7b-9effcea3dfa3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12952024-10-04T22:16:24.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 72c50379-50b1-4273-9a7b-9effcea3dfa3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
12962024-10-04T22:16:24.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
12972024-10-04T22:16:24.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
12982024-10-04T22:16:24.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12992024-10-04T22:16:24.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13002024-10-04T22:16:24.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13012024-10-04T22:16:24.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13022024-10-04T22:16:24.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13032024-10-04T22:16:24.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13042024-10-04T22:16:24.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13052024-10-04T22:16:24.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13062024-10-04T22:16:24.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13072024-10-04T22:16:24.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13082024-10-04T22:16:24.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13092024-10-04T22:16:24.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13102024-10-04T22:16:24.607ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.919678ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13112024-10-04T22:16:24.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13122024-10-04T22:16:24.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
13132024-10-04T22:16:24.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13142024-10-04T22:16:24.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13152024-10-04T22:16:24.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
13162024-10-04T22:16:24.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.250244ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
13172024-10-04T22:16:25.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 00ca88fa-2277-4959-b2a6-fb50ca157693 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13182024-10-04T22:16:25.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 00ca88fa-2277-4959-b2a6-fb50ca157693 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13192024-10-04T22:16:25.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 00ca88fa-2277-4959-b2a6-fb50ca157693 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13202024-10-04T22:16:26.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d19447b5-209f-4a22-9f28-b83f7e3fd0e6 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13212024-10-04T22:16:26.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d19447b5-209f-4a22-9f28-b83f7e3fd0e6 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13222024-10-04T22:16:26.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d19447b5-209f-4a22-9f28-b83f7e3fd0e6 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13232024-10-04T22:16:27.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 106238f4-8a6e-43ac-847c-3b8ad7ae646d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13242024-10-04T22:16:27.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 106238f4-8a6e-43ac-847c-3b8ad7ae646d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13252024-10-04T22:16:27.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 106238f4-8a6e-43ac-847c-3b8ad7ae646d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13262024-10-04T22:16:28.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9fe9395b-7b0e-4595-9b5d-24ef2c3bb32c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13272024-10-04T22:16:28.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9fe9395b-7b0e-4595-9b5d-24ef2c3bb32c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13282024-10-04T22:16:28.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9fe9395b-7b0e-4595-9b5d-24ef2c3bb32c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13292024-10-04T22:16:29.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2bb594f9-9221-4027-b40a-9bcc8f676e0f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13302024-10-04T22:16:29.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2bb594f9-9221-4027-b40a-9bcc8f676e0f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13312024-10-04T22:16:29.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2bb594f9-9221-4027-b40a-9bcc8f676e0f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13322024-10-04T22:16:30.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1eea29d9-371e-48fb-a26d-95d6ae20f530 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13332024-10-04T22:16:30.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1eea29d9-371e-48fb-a26d-95d6ae20f530 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13342024-10-04T22:16:30.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1eea29d9-371e-48fb-a26d-95d6ae20f530 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13352024-10-04T22:16:30.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = d4e7db4f-8a7e-458f-8259-9ff9edb16a3c response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
13362024-10-04T22:16:31.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 35ebc855-a554-41c7-a0f2-5232e5190097 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13372024-10-04T22:16:31.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 35ebc855-a554-41c7-a0f2-5232e5190097 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13382024-10-04T22:16:31.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 35ebc855-a554-41c7-a0f2-5232e5190097 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13392024-10-04T22:16:32.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1e62ea61-fccd-4bdf-ba9d-76c77205918a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13402024-10-04T22:16:32.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1e62ea61-fccd-4bdf-ba9d-76c77205918a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13412024-10-04T22:16:32.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1e62ea61-fccd-4bdf-ba9d-76c77205918a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13422024-10-04T22:16:33.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3120d07d-fa09-4d96-aad4-454e7593926c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13432024-10-04T22:16:33.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3120d07d-fa09-4d96-aad4-454e7593926c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13442024-10-04T22:16:33.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3120d07d-fa09-4d96-aad4-454e7593926c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13452024-10-04T22:16:33.978ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:36541
13462024-10-04T22:16:33.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36541 req_id = bdd64117-5403-42c3-b35e-4a5450163049 roles = RoleSet { roles: {} } uri = /metrics/producers
13472024-10-04T22:16:33.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36541 req_id = bdd64117-5403-42c3-b35e-4a5450163049 resource = Database result = Ok(()) uri = /metrics/producers
13482024-10-04T22:16:34.011ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
13492024-10-04T22:16:34.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36541 req_id = bdd64117-5403-42c3-b35e-4a5450163049 roles = RoleSet { roles: {} } uri = /metrics/producers
13502024-10-04T22:16:34.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36541 req_id = bdd64117-5403-42c3-b35e-4a5450163049 resource = Database result = Ok(()) uri = /metrics/producers
13512024-10-04T22:16:34.053ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
13522024-10-04T22:16:34.056ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "2247d112-cde4-41ee-b823-88d88066b712", "date": "Fri, 04 Oct 2024 22:16:34 GMT"} })
13532024-10-04T22:16:34.056ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 544b0af3-4a18-4467-8697-af690997796e
13542024-10-04T22:16:34.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79524 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36541 req_id = bdd64117-5403-42c3-b35e-4a5450163049 response_code = 201 uri = /metrics/producers
13552024-10-04T22:16:34.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 21cad608-9bd2-4946-b100-c988ed6e12b7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13562024-10-04T22:16:34.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 21cad608-9bd2-4946-b100-c988ed6e12b7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13572024-10-04T22:16:34.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 21cad608-9bd2-4946-b100-c988ed6e12b7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
13582024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
13592024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13602024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
13612024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
13622024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13632024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13642024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
13652024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13662024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
13672024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
13682024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13692024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13702024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
13712024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13722024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
13732024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
13742024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.131\u{b5}s iteration = 6 status = {"errors":[],"records_set_to_done":[]}
13752024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13762024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
13772024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13782024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
13792024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
13802024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.41\u{b5}s iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13812024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
13822024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13832024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
13842024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.331\u{b5}s iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
13852024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.33\u{b5}s iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13862024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
13872024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
13882024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
13892024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13902024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13912024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13922024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13932024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13942024-10-04T22:16:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13952024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13962024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13972024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13982024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13992024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14002024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14012024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14022024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14032024-10-04T22:16:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14042024-10-04T22:16:34.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14052024-10-04T22:16:34.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14062024-10-04T22:16:34.583ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.384577ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14072024-10-04T22:16:34.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14082024-10-04T22:16:34.584ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14092024-10-04T22:16:34.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14102024-10-04T22:16:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14112024-10-04T22:16:34.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14122024-10-04T22:16:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14132024-10-04T22:16:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14142024-10-04T22:16:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14152024-10-04T22:16:34.586ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14162024-10-04T22:16:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14172024-10-04T22:16:34.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 992, tv_nsec: 888765826 } })
14182024-10-04T22:16:34.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
14192024-10-04T22:16:34.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14202024-10-04T22:16:34.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212024-10-04T22:16:34.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14222024-10-04T22:16:34.589ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14232024-10-04T22:16:34.590ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14242024-10-04T22:16:34.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14252024-10-04T22:16:34.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14262024-10-04T22:16:34.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 992, tv_nsec: 892458710 } })
14272024-10-04T22:16:34.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
14282024-10-04T22:16:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14292024-10-04T22:16:34.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14302024-10-04T22:16:34.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14312024-10-04T22:16:34.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14322024-10-04T22:16:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14332024-10-04T22:16:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14342024-10-04T22:16:34.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14352024-10-04T22:16:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14362024-10-04T22:16:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14372024-10-04T22:16:34.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 15.332426ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14382024-10-04T22:16:34.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392024-10-04T22:16:34.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14402024-10-04T22:16:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14412024-10-04T22:16:34.599ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 992, tv_nsec: 901518681 } })
14422024-10-04T22:16:34.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
14432024-10-04T22:16:34.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14442024-10-04T22:16:34.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14452024-10-04T22:16:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14462024-10-04T22:16:34.602ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14472024-10-04T22:16:34.602ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.864777ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14482024-10-04T22:16:34.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14492024-10-04T22:16:34.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14502024-10-04T22:16:34.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14512024-10-04T22:16:34.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
14522024-10-04T22:16:34.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14532024-10-04T22:16:34.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14542024-10-04T22:16:34.620ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
14552024-10-04T22:16:34.620ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.789665ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
14562024-10-04T22:16:34.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14572024-10-04T22:16:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14582024-10-04T22:16:34.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14592024-10-04T22:16:34.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14602024-10-04T22:16:34.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14612024-10-04T22:16:34.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14622024-10-04T22:16:34.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14632024-10-04T22:16:34.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14642024-10-04T22:16:34.625ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14652024-10-04T22:16:34.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.136191ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14662024-10-04T22:16:34.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14672024-10-04T22:16:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14682024-10-04T22:16:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
14692024-10-04T22:16:34.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14702024-10-04T22:16:34.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14712024-10-04T22:16:34.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14722024-10-04T22:16:34.630ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.05839ms iteration = 6 status = 0
14732024-10-04T22:16:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14742024-10-04T22:16:34.631ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14752024-10-04T22:16:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14762024-10-04T22:16:34.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14772024-10-04T22:16:34.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14782024-10-04T22:16:34.642ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14792024-10-04T22:16:34.642ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14802024-10-04T22:16:34.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14812024-10-04T22:16:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14822024-10-04T22:16:34.667ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
14832024-10-04T22:16:34.667ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14842024-10-04T22:16:34.667ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54a1607f-1caa-4853-a0bf-4d6ac176e586", "content-length": "26", "date": "Fri, 04 Oct 2024 22:16:33 GMT"} })
14852024-10-04T22:16:34.667ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14862024-10-04T22:16:34.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14872024-10-04T22:16:34.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
14882024-10-04T22:16:34.671ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14892024-10-04T22:16:34.671ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9945ebef-05aa-4e6d-99cb-d36f198af5a3", "content-length": "26", "date": "Fri, 04 Oct 2024 22:16:33 GMT"} })
14902024-10-04T22:16:34.671ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14912024-10-04T22:16:34.673ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14922024-10-04T22:16:34.675ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
14932024-10-04T22:16:34.675ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14942024-10-04T22:16:34.675ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0ddc359-1d07-4da7-9c22-828b4c9c1a9c", "content-length": "26", "date": "Fri, 04 Oct 2024 22:16:33 GMT"} })
14952024-10-04T22:16:34.675ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14962024-10-04T22:16:34.676ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
14972024-10-04T22:16:34.701ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14982024-10-04T22:16:34.701ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14992024-10-04T22:16:34.701ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.303793ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15002024-10-04T22:16:34.718ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 137.552488ms iteration = 9 status = {"physical_disks_added":0}
15012024-10-04T22:16:34.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15022024-10-04T22:16:34.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15032024-10-04T22:16:34.745ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042024-10-04T22:16:34.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15052024-10-04T22:16:34.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15062024-10-04T22:16:34.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15072024-10-04T22:16:34.770ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15082024-10-04T22:16:34.770ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2572b289-30ac-4abe-81f6-f85f43dfb534", "content-length": "1", "date": "Fri, 04 Oct 2024 22:16:33 GMT"} })
15092024-10-04T22:16:34.771ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15102024-10-04T22:16:34.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15112024-10-04T22:16:34.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15122024-10-04T22:16:34.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15132024-10-04T22:16:34.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15142024-10-04T22:16:34.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15152024-10-04T22:16:34.775ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 195.216939ms iteration = 6 status = null
15162024-10-04T22:16:34.779ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 198.495925ms iteration = 6 status = {}
15172024-10-04T22:16:34.785ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15182024-10-04T22:16:34.786ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "af0d6319-15c9-4e08-8e3a-810751003083", "content-length": "372", "date": "Fri, 04 Oct 2024 22:16:34 GMT"} })
15192024-10-04T22:16:34.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15202024-10-04T22:16:34.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15212024-10-04T22:16:34.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15222024-10-04T22:16:34.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15232024-10-04T22:16:34.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15242024-10-04T22:16:34.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15252024-10-04T22:16:34.794ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15262024-10-04T22:16:34.795ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "81bcad50-d378-4a74-8d86-d94827f7ea56", "date": "Fri, 04 Oct 2024 22:16:34 GMT"} })
15272024-10-04T22:16:34.796ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 215.816681ms iteration = 7 status = {}
15282024-10-04T22:16:34.847ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15292024-10-04T22:16:34.847ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "da92993c-8f57-4ed9-a7ac-fc4f96dde69a", "content-length": "691", "date": "Fri, 04 Oct 2024 22:16:34 GMT"} })
15302024-10-04T22:16:34.847ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15312024-10-04T22:16:34.847ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15322024-10-04T22:16:34.847ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15332024-10-04T22:16:34.848ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 267.669447ms iteration = 6 status = {}
15342024-10-04T22:16:34.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15352024-10-04T22:16:34.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15362024-10-04T22:16:34.874ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
15372024-10-04T22:16:34.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15382024-10-04T22:16:34.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15392024-10-04T22:16:34.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15402024-10-04T22:16:34.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d52d36c7-e195-4681-9ded-38d72989b9a4", "content-length": "121", "date": "Fri, 04 Oct 2024 22:16:33 GMT"} })
15412024-10-04T22:16:34.883ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
15422024-10-04T22:16:34.883ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
15432024-10-04T22:16:34.883ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15442024-10-04T22:16:34.883ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15452024-10-04T22:16:34.883ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
15462024-10-04T22:16:34.883ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
15472024-10-04T22:16:34.883ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
15482024-10-04T22:16:34.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15492024-10-04T22:16:34.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15502024-10-04T22:16:34.885ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15512024-10-04T22:16:34.886ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a479d764-c424-48d3-a109-cbc55c97d5d0", "content-length": "2", "date": "Fri, 04 Oct 2024 22:16:33 GMT"} })
15522024-10-04T22:16:34.886ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15532024-10-04T22:16:34.886ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "458c8d11-f7cf-46a6-99ab-02869cfe9f95", "content-length": "52", "date": "Fri, 04 Oct 2024 22:16:33 GMT"} })
15542024-10-04T22:16:34.886ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
15552024-10-04T22:16:34.886ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15562024-10-04T22:16:34.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "138a0b99-bd39-4a4e-accb-d91b49e17efe", "date": "Fri, 04 Oct 2024 22:16:34 GMT"} })
15572024-10-04T22:16:34.979ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
15582024-10-04T22:16:34.979ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15592024-10-04T22:16:34.979ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d02f5f5-9a35-4839-87f0-9f71f8bbbdba", "content-length": "667", "date": "Fri, 04 Oct 2024 22:16:34 GMT"} })
15602024-10-04T22:16:34.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15612024-10-04T22:16:34.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15622024-10-04T22:16:34.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15632024-10-04T22:16:34.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15642024-10-04T22:16:35.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15652024-10-04T22:16:35.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15662024-10-04T22:16:35.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15672024-10-04T22:16:35.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15682024-10-04T22:16:35.011ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 430.499229ms iteration = 6 status = {}
15692024-10-04T22:16:35.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 1f8cbb62-390a-49c9-b6d4-20ee8109a4ba roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
15702024-10-04T22:16:35.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 1f8cbb62-390a-49c9-b6d4-20ee8109a4ba resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
15712024-10-04T22:16:35.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 1f8cbb62-390a-49c9-b6d4-20ee8109a4ba response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
15722024-10-04T22:16:35.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ef8d2605-4dbe-4c92-b25a-6ceaed094494 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15732024-10-04T22:16:35.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ef8d2605-4dbe-4c92-b25a-6ceaed094494 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15742024-10-04T22:16:35.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ef8d2605-4dbe-4c92-b25a-6ceaed094494 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15752024-10-04T22:16:36.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1eb45d54-f20a-41e5-a6a4-8c9356de5d5e roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15762024-10-04T22:16:36.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1eb45d54-f20a-41e5-a6a4-8c9356de5d5e resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15772024-10-04T22:16:36.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1eb45d54-f20a-41e5-a6a4-8c9356de5d5e response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15782024-10-04T22:16:37.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5cfed8bd-278e-4ce7-917e-4c2412fe487a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15792024-10-04T22:16:37.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5cfed8bd-278e-4ce7-917e-4c2412fe487a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15802024-10-04T22:16:37.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5cfed8bd-278e-4ce7-917e-4c2412fe487a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15812024-10-04T22:16:38.488ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55474
15822024-10-04T22:16:38.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55474 req_id = 023cffea-4b08-48da-8328-05a1f494adad roles = RoleSet { roles: {} } uri = /metrics/producers
15832024-10-04T22:16:38.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55474 req_id = 023cffea-4b08-48da-8328-05a1f494adad resource = Database result = Ok(()) uri = /metrics/producers
15842024-10-04T22:16:38.522ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
15852024-10-04T22:16:38.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55474 req_id = 023cffea-4b08-48da-8328-05a1f494adad roles = RoleSet { roles: {} } uri = /metrics/producers
15862024-10-04T22:16:38.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55474 req_id = 023cffea-4b08-48da-8328-05a1f494adad resource = Database result = Ok(()) uri = /metrics/producers
15872024-10-04T22:16:38.558ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
15882024-10-04T22:16:38.558ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "ee412a79-6846-4417-927a-6db022241d89", "date": "Fri, 04 Oct 2024 22:16:38 GMT"} })
15892024-10-04T22:16:38.558ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = e003a4f9-367c-4ba5-b4e7-8e2206c9a111
15902024-10-04T22:16:38.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69955 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55474 req_id = 023cffea-4b08-48da-8328-05a1f494adad response_code = 201 uri = /metrics/producers
15912024-10-04T22:16:38.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f7614b1c-4920-4859-bf55-5cb4d8a41aac roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15922024-10-04T22:16:38.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f7614b1c-4920-4859-bf55-5cb4d8a41aac resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15932024-10-04T22:16:38.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f7614b1c-4920-4859-bf55-5cb4d8a41aac response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15942024-10-04T22:16:39.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 07dfe2db-6ad4-46c9-9105-b4496b90673b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15952024-10-04T22:16:39.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 07dfe2db-6ad4-46c9-9105-b4496b90673b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15962024-10-04T22:16:39.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 07dfe2db-6ad4-46c9-9105-b4496b90673b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15972024-10-04T22:16:40.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 13599624-e25f-4ce0-9be8-8d57e1824e4a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15982024-10-04T22:16:40.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 13599624-e25f-4ce0-9be8-8d57e1824e4a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
15992024-10-04T22:16:40.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 13599624-e25f-4ce0-9be8-8d57e1824e4a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16002024-10-04T22:16:40.687ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:35949
16012024-10-04T22:16:40.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35949 req_id = 7ed6f308-aaf8-4e68-87c9-ffca19c6e8aa roles = RoleSet { roles: {} } uri = /metrics/producers
16022024-10-04T22:16:40.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35949 req_id = 7ed6f308-aaf8-4e68-87c9-ffca19c6e8aa resource = Database result = Ok(()) uri = /metrics/producers
16032024-10-04T22:16:40.719ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
16042024-10-04T22:16:40.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35949 req_id = 7ed6f308-aaf8-4e68-87c9-ffca19c6e8aa roles = RoleSet { roles: {} } uri = /metrics/producers
16052024-10-04T22:16:40.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35949 req_id = 7ed6f308-aaf8-4e68-87c9-ffca19c6e8aa resource = Database result = Ok(()) uri = /metrics/producers
16062024-10-04T22:16:40.725ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
16072024-10-04T22:16:40.726ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "bab773be-1a00-4dad-817a-337ff065a1ef", "date": "Fri, 04 Oct 2024 22:16:40 GMT"} })
16082024-10-04T22:16:40.726ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 267536c4-b0ca-40c9-ba2b-798521f99028
16092024-10-04T22:16:40.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40843 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35949 req_id = 7ed6f308-aaf8-4e68-87c9-ffca19c6e8aa response_code = 201 uri = /metrics/producers
16102024-10-04T22:16:40.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1590 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = b3e67aca-ffa4-4132-a45a-8e17c90ff2ff response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
16112024-10-04T22:16:41.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 707e9637-ad6d-40ef-9165-abb3ce2d1153 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16122024-10-04T22:16:41.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 707e9637-ad6d-40ef-9165-abb3ce2d1153 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16132024-10-04T22:16:41.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 707e9637-ad6d-40ef-9165-abb3ce2d1153 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16142024-10-04T22:16:41.965ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:47340
16152024-10-04T22:16:41.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47340 req_id = e4d080ee-f443-4606-808d-0662cc7f0c64 roles = RoleSet { roles: {} } uri = /metrics/producers
16162024-10-04T22:16:41.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47340 req_id = e4d080ee-f443-4606-808d-0662cc7f0c64 resource = Database result = Ok(()) uri = /metrics/producers
16172024-10-04T22:16:41.998ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
16182024-10-04T22:16:41.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47340 req_id = e4d080ee-f443-4606-808d-0662cc7f0c64 roles = RoleSet { roles: {} } uri = /metrics/producers
16192024-10-04T22:16:41.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47340 req_id = e4d080ee-f443-4606-808d-0662cc7f0c64 resource = Database result = Ok(()) uri = /metrics/producers
16202024-10-04T22:16:42.033ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
16212024-10-04T22:16:42.033ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "90051f0d-68f2-47b8-8fdb-fd0e4314dbf7", "date": "Fri, 04 Oct 2024 22:16:42 GMT"} })
16222024-10-04T22:16:42.033ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 424e4c9a-473d-43a4-aed1-77de951357f7
16232024-10-04T22:16:42.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69678 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47340 req_id = e4d080ee-f443-4606-808d-0662cc7f0c64 response_code = 201 uri = /metrics/producers
16242024-10-04T22:16:42.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6f6d3d66-1fdf-4863-8834-d506addfd9fd roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16252024-10-04T22:16:42.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6f6d3d66-1fdf-4863-8834-d506addfd9fd resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16262024-10-04T22:16:42.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6f6d3d66-1fdf-4863-8834-d506addfd9fd response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16272024-10-04T22:16:43.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 43fc61ec-02fd-456a-9cdd-2de3ad54c346 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16282024-10-04T22:16:43.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 43fc61ec-02fd-456a-9cdd-2de3ad54c346 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16292024-10-04T22:16:43.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 43fc61ec-02fd-456a-9cdd-2de3ad54c346 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16302024-10-04T22:16:44.011ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40471
16312024-10-04T22:16:44.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40471 req_id = ad836566-e172-4747-9c76-9d18379043a9 roles = RoleSet { roles: {} } uri = /metrics/producers
16322024-10-04T22:16:44.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40471 req_id = ad836566-e172-4747-9c76-9d18379043a9 resource = Database result = Ok(()) uri = /metrics/producers
16332024-10-04T22:16:44.045ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
16342024-10-04T22:16:44.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40471 req_id = ad836566-e172-4747-9c76-9d18379043a9 roles = RoleSet { roles: {} } uri = /metrics/producers
16352024-10-04T22:16:44.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40471 req_id = ad836566-e172-4747-9c76-9d18379043a9 resource = Database result = Ok(()) uri = /metrics/producers
16362024-10-04T22:16:44.074ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
16372024-10-04T22:16:44.075ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "0333ec47-42c1-4c06-8607-200f2e969097", "date": "Fri, 04 Oct 2024 22:16:44 GMT"} })
16382024-10-04T22:16:44.075ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = adfc6ece-c25a-427e-af7d-fef3dd24e379
16392024-10-04T22:16:44.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64055 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40471 req_id = ad836566-e172-4747-9c76-9d18379043a9 response_code = 201 uri = /metrics/producers
16402024-10-04T22:16:44.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
16412024-10-04T22:16:44.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16422024-10-04T22:16:44.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
16432024-10-04T22:16:44.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16442024-10-04T22:16:44.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16452024-10-04T22:16:44.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16462024-10-04T22:16:44.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16472024-10-04T22:16:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16482024-10-04T22:16:44.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16492024-10-04T22:16:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16502024-10-04T22:16:44.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16512024-10-04T22:16:44.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16522024-10-04T22:16:44.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16532024-10-04T22:16:44.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
16542024-10-04T22:16:44.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16552024-10-04T22:16:44.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16562024-10-04T22:16:44.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
16572024-10-04T22:16:44.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.299396ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
16582024-10-04T22:16:44.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16592024-10-04T22:16:44.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16602024-10-04T22:16:44.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.281324ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16612024-10-04T22:16:44.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 79bff38d-e439-4c4a-9b04-dca118936e7f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16622024-10-04T22:16:44.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 79bff38d-e439-4c4a-9b04-dca118936e7f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16632024-10-04T22:16:44.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 79bff38d-e439-4c4a-9b04-dca118936e7f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16642024-10-04T22:16:45.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1d2a9473-5a72-49ad-acee-cc1b43ec4fc7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16652024-10-04T22:16:45.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1d2a9473-5a72-49ad-acee-cc1b43ec4fc7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16662024-10-04T22:16:45.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1d2a9473-5a72-49ad-acee-cc1b43ec4fc7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16672024-10-04T22:16:46.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0cb032fa-abf3-40cb-88ee-07590320265c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16682024-10-04T22:16:46.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0cb032fa-abf3-40cb-88ee-07590320265c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16692024-10-04T22:16:46.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0cb032fa-abf3-40cb-88ee-07590320265c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16702024-10-04T22:16:47.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d3509b80-d1f2-4488-af8f-e53b2a49ae12 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16712024-10-04T22:16:47.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d3509b80-d1f2-4488-af8f-e53b2a49ae12 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16722024-10-04T22:16:47.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d3509b80-d1f2-4488-af8f-e53b2a49ae12 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16732024-10-04T22:16:48.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bd997f6c-5d1e-4b76-bd3b-a0740b9fcad9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16742024-10-04T22:16:48.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bd997f6c-5d1e-4b76-bd3b-a0740b9fcad9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16752024-10-04T22:16:48.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bd997f6c-5d1e-4b76-bd3b-a0740b9fcad9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16762024-10-04T22:16:49.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2d1cbe6c-e9c1-4da0-9673-07cb3a552fba roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16772024-10-04T22:16:49.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2d1cbe6c-e9c1-4da0-9673-07cb3a552fba resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16782024-10-04T22:16:49.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2d1cbe6c-e9c1-4da0-9673-07cb3a552fba response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16792024-10-04T22:16:50.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8c05a38e-d799-4c0a-b370-5c64573496ec roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16802024-10-04T22:16:50.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8c05a38e-d799-4c0a-b370-5c64573496ec resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16812024-10-04T22:16:50.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8c05a38e-d799-4c0a-b370-5c64573496ec response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16822024-10-04T22:16:50.916ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 1be25b13-f902-49bc-980a-3dfdb66839fc response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
16832024-10-04T22:16:51.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 06accead-952d-41c5-9e80-f4d84789c248 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16842024-10-04T22:16:51.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 06accead-952d-41c5-9e80-f4d84789c248 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16852024-10-04T22:16:51.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 06accead-952d-41c5-9e80-f4d84789c248 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16862024-10-04T22:16:52.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f0697e57-45f6-4f27-9b44-22bacb48d560 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16872024-10-04T22:16:52.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f0697e57-45f6-4f27-9b44-22bacb48d560 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16882024-10-04T22:16:52.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f0697e57-45f6-4f27-9b44-22bacb48d560 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
16892024-10-04T22:16:53.673ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:59443
16902024-10-04T22:16:53.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59443 req_id = 0920537b-de7f-41b6-9c16-aa388275c56a roles = RoleSet { roles: {} } uri = /metrics/producers
16912024-10-04T22:16:53.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59443 req_id = 0920537b-de7f-41b6-9c16-aa388275c56a resource = Database result = Ok(()) uri = /metrics/producers
16922024-10-04T22:16:53.705ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
16932024-10-04T22:16:53.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59443 req_id = 0920537b-de7f-41b6-9c16-aa388275c56a roles = RoleSet { roles: {} } uri = /metrics/producers
16942024-10-04T22:16:53.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59443 req_id = 0920537b-de7f-41b6-9c16-aa388275c56a resource = Database result = Ok(()) uri = /metrics/producers
16952024-10-04T22:16:53.736ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
16962024-10-04T22:16:53.737ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "57374392-bd3e-4ba6-b2bf-916069c05493", "date": "Fri, 04 Oct 2024 22:16:53 GMT"} })
16972024-10-04T22:16:53.737ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = c799734e-ac9f-438c-a36e-667112d684ca
16982024-10-04T22:16:53.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64498 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59443 req_id = 0920537b-de7f-41b6-9c16-aa388275c56a response_code = 201 uri = /metrics/producers
16992024-10-04T22:16:53.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 13ae8e7f-1884-4edf-8b64-e5b34670aa7b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17002024-10-04T22:16:53.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 13ae8e7f-1884-4edf-8b64-e5b34670aa7b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17012024-10-04T22:16:53.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 13ae8e7f-1884-4edf-8b64-e5b34670aa7b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17022024-10-04T22:16:54.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
17032024-10-04T22:16:54.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
17042024-10-04T22:16:54.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17052024-10-04T22:16:54.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17062024-10-04T22:16:54.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17072024-10-04T22:16:54.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17082024-10-04T22:16:54.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17092024-10-04T22:16:54.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17102024-10-04T22:16:54.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17112024-10-04T22:16:54.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17122024-10-04T22:16:54.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17132024-10-04T22:16:54.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17142024-10-04T22:16:54.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17152024-10-04T22:16:54.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17162024-10-04T22:16:54.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17172024-10-04T22:16:54.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
17182024-10-04T22:16:54.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17192024-10-04T22:16:54.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17202024-10-04T22:16:54.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
17212024-10-04T22:16:54.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.00765ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
17222024-10-04T22:16:54.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.01029ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17232024-10-04T22:16:54.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 020490cb-b624-4d10-9d03-3bfaa22d4198 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17242024-10-04T22:16:54.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 020490cb-b624-4d10-9d03-3bfaa22d4198 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17252024-10-04T22:16:54.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 020490cb-b624-4d10-9d03-3bfaa22d4198 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17262024-10-04T22:16:55.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c80445ab-51c5-4200-bfef-71d8e7d6c9b2 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17272024-10-04T22:16:55.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c80445ab-51c5-4200-bfef-71d8e7d6c9b2 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17282024-10-04T22:16:55.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c80445ab-51c5-4200-bfef-71d8e7d6c9b2 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17292024-10-04T22:16:56.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c4f8e4a4-192d-4491-ad3d-0fd14cbe781c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17302024-10-04T22:16:56.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c4f8e4a4-192d-4491-ad3d-0fd14cbe781c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17312024-10-04T22:16:56.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c4f8e4a4-192d-4491-ad3d-0fd14cbe781c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17322024-10-04T22:16:57.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a2845109-6acb-4759-84eb-065efb6a0d11 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17332024-10-04T22:16:57.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a2845109-6acb-4759-84eb-065efb6a0d11 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17342024-10-04T22:16:57.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a2845109-6acb-4759-84eb-065efb6a0d11 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17352024-10-04T22:16:59.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 16215837-4609-463c-8df1-835daa84b0e9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17362024-10-04T22:16:59.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 16215837-4609-463c-8df1-835daa84b0e9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17372024-10-04T22:16:59.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 16215837-4609-463c-8df1-835daa84b0e9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17382024-10-04T22:17:00.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 48d86221-5c27-4c18-a781-1e69eede6d2d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17392024-10-04T22:17:00.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 48d86221-5c27-4c18-a781-1e69eede6d2d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17402024-10-04T22:17:00.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 48d86221-5c27-4c18-a781-1e69eede6d2d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17412024-10-04T22:17:00.915ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1317 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 4327bc56-3184-4a5a-9f04-ef37390e3d9d response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
17422024-10-04T22:17:01.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 895fc869-106e-4d45-9e3d-67083c2ffb25 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17432024-10-04T22:17:01.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 895fc869-106e-4d45-9e3d-67083c2ffb25 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17442024-10-04T22:17:01.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 895fc869-106e-4d45-9e3d-67083c2ffb25 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17452024-10-04T22:17:02.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = de03b247-1dea-404a-b403-50e0c09da998 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17462024-10-04T22:17:02.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = de03b247-1dea-404a-b403-50e0c09da998 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17472024-10-04T22:17:02.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = de03b247-1dea-404a-b403-50e0c09da998 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17482024-10-04T22:17:03.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d9cdb33e-af68-44e1-b268-68af02497fc1 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17492024-10-04T22:17:03.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d9cdb33e-af68-44e1-b268-68af02497fc1 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17502024-10-04T22:17:03.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d9cdb33e-af68-44e1-b268-68af02497fc1 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17512024-10-04T22:17:04.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81f6065f-37b5-487a-88ea-c0ca7464e8ab roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17522024-10-04T22:17:04.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81f6065f-37b5-487a-88ea-c0ca7464e8ab resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17532024-10-04T22:17:04.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81f6065f-37b5-487a-88ea-c0ca7464e8ab response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
17542024-10-04T22:17:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
17552024-10-04T22:17:04.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
17562024-10-04T22:17:04.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17572024-10-04T22:17:04.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17582024-10-04T22:17:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
17592024-10-04T22:17:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.31\u{b5}s iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
17602024-10-04T22:17:04.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
17612024-10-04T22:17:04.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
17622024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
17632024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17642024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17652024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17662024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17672024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
17682024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
17692024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17702024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17712024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
17722024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
17732024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.67\u{b5}s iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17742024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
17752024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17762024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
17772024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17782024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
17792024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
17802024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
17812024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
17822024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
17832024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17842024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
17852024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17862024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17872024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
17882024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.75\u{b5}s iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
17892024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
17902024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
17912024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17922024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17932024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
17942024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17952024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
17962024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.7\u{b5}s iteration = 7 status = {"errors":[],"records_set_to_done":[]}
17972024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
17982024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
17992024-10-04T22:17:04.581ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 568e0899-5775-47c6-8a59-2b161d236a0c
18002024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
18012024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18022024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.73\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"568e0899-5775-47c6-8a59-2b161d236a0c"}
18032024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
18042024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
18052024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18062024-10-04T22:17:04.581ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-04 22:07:04.581228803 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18072024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18082024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18092024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
18102024-10-04T22:17:04.581ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18112024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18122024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
18132024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18142024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
18152024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
18162024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18172024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18182024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18192024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18202024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18212024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18222024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18232024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18242024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18252024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18262024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18272024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18282024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18292024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18302024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18312024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18322024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18332024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18342024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18352024-10-04T22:17:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18362024-10-04T22:17:04.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18372024-10-04T22:17:04.584ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("173a8178-efd5-4ec1-9f4c-a05bc972d94c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cceb95f-37ad-478b-be36-e32fb96c3dd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1022, tv_nsec: 885975091 } })
18382024-10-04T22:17:04.584ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e5972f58-0215-4789-9de6-8c745fc8691c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1022, tv_nsec: 886167215 } })
18392024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18402024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18412024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18422024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18432024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18442024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18452024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18462024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18472024-10-04T22:17:04.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18482024-10-04T22:17:04.586ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
18492024-10-04T22:17:04.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.360537ms iteration = 5 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
18502024-10-04T22:17:04.587ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18512024-10-04T22:17:04.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18522024-10-04T22:17:04.587ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.840967ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18532024-10-04T22:17:04.587ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
18542024-10-04T22:17:04.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.901588ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
18552024-10-04T22:17:04.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18562024-10-04T22:17:04.589ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.443619ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
18572024-10-04T22:17:04.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18582024-10-04T22:17:04.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18592024-10-04T22:17:04.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18602024-10-04T22:17:04.592ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1022, tv_nsec: 893708565 } })
18612024-10-04T22:17:04.592ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
18622024-10-04T22:17:04.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18632024-10-04T22:17:04.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18642024-10-04T22:17:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18652024-10-04T22:17:04.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18662024-10-04T22:17:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18672024-10-04T22:17:04.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18682024-10-04T22:17:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18692024-10-04T22:17:04.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18702024-10-04T22:17:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18712024-10-04T22:17:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18722024-10-04T22:17:04.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732024-10-04T22:17:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18742024-10-04T22:17:04.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18752024-10-04T22:17:04.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18762024-10-04T22:17:04.613ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-04 22:07:04.581228803 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18772024-10-04T22:17:04.613ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 32.364337ms iteration = 4 status = {"expiration":"2024-10-04T22:07:04.581228803Z","pruned":[]}
18782024-10-04T22:17:04.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18792024-10-04T22:17:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18802024-10-04T22:17:04.616ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18812024-10-04T22:17:04.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1022, tv_nsec: 920021121 } })
18822024-10-04T22:17:04.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18832024-10-04T22:17:04.619ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18842024-10-04T22:17:04.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18852024-10-04T22:17:04.620ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
18862024-10-04T22:17:04.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18872024-10-04T22:17:04.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
18882024-10-04T22:17:04.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18892024-10-04T22:17:04.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
18902024-10-04T22:17:04.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18912024-10-04T22:17:04.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18922024-10-04T22:17:04.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932024-10-04T22:17:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18942024-10-04T22:17:04.631ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1022, tv_nsec: 933403858 } })
18952024-10-04T22:17:04.632ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
18962024-10-04T22:17:04.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18972024-10-04T22:17:04.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18982024-10-04T22:17:04.654ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18992024-10-04T22:17:04.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19002024-10-04T22:17:04.662ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19012024-10-04T22:17:04.663ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19022024-10-04T22:17:04.663ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 82.000298ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19032024-10-04T22:17:04.670ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042024-10-04T22:17:04.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052024-10-04T22:17:04.671ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19062024-10-04T22:17:04.671ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19072024-10-04T22:17:04.671ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19082024-10-04T22:17:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19092024-10-04T22:17:04.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19102024-10-04T22:17:04.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19112024-10-04T22:17:04.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19122024-10-04T22:17:04.673ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19132024-10-04T22:17:04.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19142024-10-04T22:17:04.674ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19152024-10-04T22:17:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19162024-10-04T22:17:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19172024-10-04T22:17:04.674ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-10-04T22:17:04.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19192024-10-04T22:17:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19202024-10-04T22:17:04.677ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19212024-10-04T22:17:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19222024-10-04T22:17:04.677ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232024-10-04T22:17:04.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19242024-10-04T22:17:04.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19252024-10-04T22:17:04.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19262024-10-04T22:17:04.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.199041ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19272024-10-04T22:17:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19282024-10-04T22:17:04.680ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19292024-10-04T22:17:04.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19302024-10-04T22:17:04.681ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19312024-10-04T22:17:04.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19322024-10-04T22:17:04.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19332024-10-04T22:17:04.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19342024-10-04T22:17:04.684ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19352024-10-04T22:17:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19362024-10-04T22:17:04.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19372024-10-04T22:17:04.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19382024-10-04T22:17:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19392024-10-04T22:17:04.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19402024-10-04T22:17:04.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19412024-10-04T22:17:04.693ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19422024-10-04T22:17:04.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19432024-10-04T22:17:04.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19442024-10-04T22:17:04.698ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19452024-10-04T22:17:04.698ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 117.864285ms iteration = 3 status = {"nsuccess":5}
19462024-10-04T22:17:04.699ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19472024-10-04T22:17:04.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19482024-10-04T22:17:04.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19492024-10-04T22:17:04.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19502024-10-04T22:17:04.702ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19512024-10-04T22:17:04.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19522024-10-04T22:17:04.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19532024-10-04T22:17:04.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19542024-10-04T22:17:04.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19552024-10-04T22:17:04.707ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19562024-10-04T22:17:04.707ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
19572024-10-04T22:17:04.707ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 126.478206ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19582024-10-04T22:17:04.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19592024-10-04T22:17:04.718ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19602024-10-04T22:17:04.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19612024-10-04T22:17:04.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
19622024-10-04T22:17:04.719ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19632024-10-04T22:17:04.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19642024-10-04T22:17:04.729ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19652024-10-04T22:17:04.729ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19662024-10-04T22:17:04.729ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19672024-10-04T22:17:04.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19682024-10-04T22:17:04.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19692024-10-04T22:17:04.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19702024-10-04T22:17:04.734ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19712024-10-04T22:17:04.734ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19722024-10-04T22:17:04.734ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19732024-10-04T22:17:04.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19742024-10-04T22:17:04.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 152.982316ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19752024-10-04T22:17:04.734ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
19762024-10-04T22:17:04.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19772024-10-04T22:17:04.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19782024-10-04T22:17:04.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19792024-10-04T22:17:04.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19802024-10-04T22:17:04.736ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
19812024-10-04T22:17:04.736ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 156.048177ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
19822024-10-04T22:17:04.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19832024-10-04T22:17:04.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19842024-10-04T22:17:04.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19852024-10-04T22:17:04.748ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19862024-10-04T22:17:04.748ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19872024-10-04T22:17:04.748ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19882024-10-04T22:17:04.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19892024-10-04T22:17:04.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19902024-10-04T22:17:04.748ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19912024-10-04T22:17:04.748ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 167.805392ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19922024-10-04T22:17:04.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19932024-10-04T22:17:04.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19942024-10-04T22:17:04.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19952024-10-04T22:17:04.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19962024-10-04T22:17:04.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19972024-10-04T22:17:04.754ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19982024-10-04T22:17:04.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19992024-10-04T22:17:04.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20002024-10-04T22:17:04.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20012024-10-04T22:17:04.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20022024-10-04T22:17:04.758ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20032024-10-04T22:17:04.758ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20042024-10-04T22:17:04.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20052024-10-04T22:17:04.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20062024-10-04T22:17:04.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20072024-10-04T22:17:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20082024-10-04T22:17:04.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20092024-10-04T22:17:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20102024-10-04T22:17:04.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20112024-10-04T22:17:04.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20122024-10-04T22:17:04.767ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
20132024-10-04T22:17:04.767ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20142024-10-04T22:17:04.767ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-04 22:14:36.136216 UTC dns_group = internal generation = 1
20152024-10-04T22:17:04.767ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 186.388483ms iteration = 5 status = {"generation":1}
20162024-10-04T22:17:04.774ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20172024-10-04T22:17:04.774ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20182024-10-04T22:17:04.774ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 193.483875ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20192024-10-04T22:17:04.777ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202024-10-04T22:17:04.780ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
20212024-10-04T22:17:04.780ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20222024-10-04T22:17:04.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20232024-10-04T22:17:04.785ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-04T22:14:02.806172Z, time_modified: 2024-10-04T22:14:02.806172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }) }
20242024-10-04T22:17:04.785ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 204.311081ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]}},"default_endpoint":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20252024-10-04T22:17:04.789ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20262024-10-04T22:17:04.789ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 0 version = 2
20272024-10-04T22:17:04.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20282024-10-04T22:17:04.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20292024-10-04T22:17:04.801ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
20302024-10-04T22:17:04.812ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 231.79561ms iteration = 10 status = {"physical_disks_added":0}
20312024-10-04T22:17:04.820ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
20322024-10-04T22:17:04.820ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20332024-10-04T22:17:04.820ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba073876-7368-4d61-b483-52edcddfe39b", "content-length": "26", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
20342024-10-04T22:17:04.820ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20352024-10-04T22:17:04.822ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20362024-10-04T22:17:04.829ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
20372024-10-04T22:17:04.829ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 248.004224ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20382024-10-04T22:17:04.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20392024-10-04T22:17:04.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20402024-10-04T22:17:04.874ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
20412024-10-04T22:17:04.874ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20422024-10-04T22:17:04.875ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "25f38d9c-5174-4e48-8631-dcd44265188c", "content-length": "26", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
20432024-10-04T22:17:04.875ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20442024-10-04T22:17:04.877ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
20452024-10-04T22:17:04.908ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
20462024-10-04T22:17:04.908ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20472024-10-04T22:17:04.908ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "90b7d282-ed7d-4c21-a77d-a4b5309fc875", "content-length": "26", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
20482024-10-04T22:17:04.908ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20492024-10-04T22:17:04.909ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20502024-10-04T22:17:04.964ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
20512024-10-04T22:17:04.976ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20522024-10-04T22:17:04.976ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f8415bc-3d2f-4ce5-85a1-e2703a277f62", "content-length": "372", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
20532024-10-04T22:17:04.977ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20542024-10-04T22:17:04.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20552024-10-04T22:17:04.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20562024-10-04T22:17:04.979ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 398.189114ms iteration = 7 status = 0
20572024-10-04T22:17:04.979ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582024-10-04T22:17:04.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20592024-10-04T22:17:04.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20602024-10-04T22:17:04.981ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20612024-10-04T22:17:04.981ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20622024-10-04T22:17:04.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20632024-10-04T22:17:04.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20642024-10-04T22:17:04.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20652024-10-04T22:17:04.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20662024-10-04T22:17:04.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672024-10-04T22:17:04.984ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 1 version = 2
20682024-10-04T22:17:04.984ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20692024-10-04T22:17:04.984ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-04 22:14:38.170044 UTC dns_group = external generation = 2
20702024-10-04T22:17:04.984ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 403.314857ms iteration = 5 status = {"generation":2}
20712024-10-04T22:17:04.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20722024-10-04T22:17:04.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20732024-10-04T22:17:04.985ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20742024-10-04T22:17:04.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20752024-10-04T22:17:04.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20762024-10-04T22:17:04.988ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20772024-10-04T22:17:04.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "baadfb39-6808-4f8f-a2dc-59189b56bb99", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
20782024-10-04T22:17:04.990ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 409.913239ms iteration = 8 status = {}
20792024-10-04T22:17:05.034ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
20802024-10-04T22:17:05.035ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cf7c2464-d88d-47f0-bf42-2c2a31761b43", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20812024-10-04T22:17:05.035ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20822024-10-04T22:17:05.036ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "40e3c8fc-42fe-4e7e-b341-c667cdb3f1fc", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20832024-10-04T22:17:05.036ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20842024-10-04T22:17:05.038ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20852024-10-04T22:17:05.038ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 457.626891ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
20862024-10-04T22:17:05.049ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
20872024-10-04T22:17:05.050ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9134d19d-c485-4470-be96-1866e8527cba", "content-length": "1", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
20882024-10-04T22:17:05.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20892024-10-04T22:17:05.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20902024-10-04T22:17:05.054ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 473.55354ms iteration = 7 status = null
20912024-10-04T22:17:05.119ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 538.356284ms iteration = 7 status = {}
20922024-10-04T22:17:05.160ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20932024-10-04T22:17:05.161ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
20942024-10-04T22:17:05.162ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "66a646ae-1107-440e-bfbc-f778f384e107", "content-length": "691", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
20952024-10-04T22:17:05.162ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
20962024-10-04T22:17:05.162ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
20972024-10-04T22:17:05.162ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
20982024-10-04T22:17:05.163ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 582.389083ms iteration = 7 status = {}
20992024-10-04T22:17:05.163ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f7327bdd-67a4-49a4-95c0-dd39150dffa1", "date": "Fri, 04 Oct 2024 22:17:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21002024-10-04T22:17:05.163ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21012024-10-04T22:17:05.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ece75be6-5e7b-4351-8196-c4e3a52d6cff roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21022024-10-04T22:17:05.165ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "942c9000-3774-4fc7-a74b-692860adba9f", "date": "Fri, 04 Oct 2024 22:17:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21032024-10-04T22:17:05.165ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21042024-10-04T22:17:05.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ece75be6-5e7b-4351-8196-c4e3a52d6cff resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21052024-10-04T22:17:05.167ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "55121e19-9125-4b0c-904b-914d3af6e3f5", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21062024-10-04T22:17:05.167ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21072024-10-04T22:17:05.168ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
21082024-10-04T22:17:05.168ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 587.747061ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
21092024-10-04T22:17:05.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ece75be6-5e7b-4351-8196-c4e3a52d6cff response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21102024-10-04T22:17:05.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21112024-10-04T22:17:05.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21122024-10-04T22:17:05.192ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
21132024-10-04T22:17:05.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21142024-10-04T22:17:05.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21152024-10-04T22:17:05.200ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21162024-10-04T22:17:05.200ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "761971e4-11b9-4eb6-9c41-d5d04a2bbb2f", "content-length": "121", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
21172024-10-04T22:17:05.200ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
21182024-10-04T22:17:05.200ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
21192024-10-04T22:17:05.201ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21202024-10-04T22:17:05.201ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21212024-10-04T22:17:05.201ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
21222024-10-04T22:17:05.201ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
21232024-10-04T22:17:05.201ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
21242024-10-04T22:17:05.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21252024-10-04T22:17:05.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21262024-10-04T22:17:05.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21272024-10-04T22:17:05.203ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "20857f98-f977-4c90-addc-b6f5bf65a84e", "content-length": "2", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
21282024-10-04T22:17:05.203ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21292024-10-04T22:17:05.203ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "677d2707-c73d-40bd-b1de-69dc98dbf3bf", "content-length": "52", "date": "Fri, 04 Oct 2024 22:17:04 GMT"} })
21302024-10-04T22:17:05.203ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
21312024-10-04T22:17:05.203ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21322024-10-04T22:17:05.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = cf752bf3-8f9a-408d-986a-899d0bcc8a08 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
21332024-10-04T22:17:05.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = cf752bf3-8f9a-408d-986a-899d0bcc8a08 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
21342024-10-04T22:17:05.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = cf752bf3-8f9a-408d-986a-899d0bcc8a08 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
21352024-10-04T22:17:05.402ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7d1e5109-68fd-4d21-8813-641b813d7142", "date": "Fri, 04 Oct 2024 22:17:05 GMT"} })
21362024-10-04T22:17:05.402ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
21372024-10-04T22:17:05.402ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21382024-10-04T22:17:05.402ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b67c8bd4-ddbb-4e47-aab4-be9c7e3d17bb", "content-length": "667", "date": "Fri, 04 Oct 2024 22:17:05 GMT"} })
21392024-10-04T22:17:05.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21402024-10-04T22:17:05.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21412024-10-04T22:17:05.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21422024-10-04T22:17:05.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21432024-10-04T22:17:05.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21442024-10-04T22:17:05.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21452024-10-04T22:17:05.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21462024-10-04T22:17:05.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21472024-10-04T22:17:05.417ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 836.087592ms iteration = 7 status = {}
21482024-10-04T22:17:06.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f63a9756-b195-40b6-9262-999bb8c43058 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21492024-10-04T22:17:06.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f63a9756-b195-40b6-9262-999bb8c43058 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21502024-10-04T22:17:06.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f63a9756-b195-40b6-9262-999bb8c43058 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21512024-10-04T22:17:07.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ba6e611e-d522-4ac7-bf00-09f182afc24f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21522024-10-04T22:17:07.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ba6e611e-d522-4ac7-bf00-09f182afc24f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21532024-10-04T22:17:07.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ba6e611e-d522-4ac7-bf00-09f182afc24f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21542024-10-04T22:17:08.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd81055e-1a86-4bb3-93f6-f0fcc87d0680 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21552024-10-04T22:17:08.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd81055e-1a86-4bb3-93f6-f0fcc87d0680 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21562024-10-04T22:17:08.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd81055e-1a86-4bb3-93f6-f0fcc87d0680 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21572024-10-04T22:17:09.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 313a5c93-4bc2-4481-9aa6-160fd65ad8ac roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21582024-10-04T22:17:09.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 313a5c93-4bc2-4481-9aa6-160fd65ad8ac resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21592024-10-04T22:17:09.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 313a5c93-4bc2-4481-9aa6-160fd65ad8ac response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21602024-10-04T22:17:10.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3fb89d69-b814-48af-990a-619657940d2a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21612024-10-04T22:17:10.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3fb89d69-b814-48af-990a-619657940d2a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21622024-10-04T22:17:10.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3fb89d69-b814-48af-990a-619657940d2a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21632024-10-04T22:17:10.886ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
21642024-10-04T22:17:10.886ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
21652024-10-04T22:17:10.916ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
21662024-10-04T22:17:10.916ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:35495
21672024-10-04T22:17:10.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:35495 req_id = 2882f387-cc70-4a70-ac9a-be7bda2bfdff roles = RoleSet { roles: {} } uri = /metrics/producers
21682024-10-04T22:17:10.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:35495 req_id = 2882f387-cc70-4a70-ac9a-be7bda2bfdff resource = Database result = Ok(()) uri = /metrics/producers
21692024-10-04T22:17:10.917ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1274 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = ebef2ae1-0050-4a5a-a9bd-d30daa4cd570 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
21702024-10-04T22:17:10.949ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
21712024-10-04T22:17:10.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:35495 req_id = 2882f387-cc70-4a70-ac9a-be7bda2bfdff roles = RoleSet { roles: {} } uri = /metrics/producers
21722024-10-04T22:17:10.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:35495 req_id = 2882f387-cc70-4a70-ac9a-be7bda2bfdff resource = Database result = Ok(()) uri = /metrics/producers
21732024-10-04T22:17:10.980ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
21742024-10-04T22:17:10.980ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "a230b9f9-f5cb-4049-a4ac-ec6619678469", "date": "Fri, 04 Oct 2024 22:17:10 GMT"} })
21752024-10-04T22:17:10.980ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 46d21628-a828-4b09-b280-d1af35f56206
21762024-10-04T22:17:10.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64419 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:35495 req_id = 2882f387-cc70-4a70-ac9a-be7bda2bfdff response_code = 201 uri = /metrics/producers
21772024-10-04T22:17:10.981ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2882f387-cc70-4a70-ac9a-be7bda2bfdff", "content-length": "41", "date": "Fri, 04 Oct 2024 22:17:10 GMT"} })
21782024-10-04T22:17:10.983ZDEBGnexus (producer-registration-task): registered with nexus successfully
21792024-10-04T22:17:10.983ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
21802024-10-04T22:17:11.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b1657b2a-e235-4778-9bbe-c508f2a6a399 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21812024-10-04T22:17:11.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b1657b2a-e235-4778-9bbe-c508f2a6a399 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21822024-10-04T22:17:11.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b1657b2a-e235-4778-9bbe-c508f2a6a399 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21832024-10-04T22:17:12.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6d5c3ca5-5048-472c-8e50-35b88406f78c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21842024-10-04T22:17:12.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6d5c3ca5-5048-472c-8e50-35b88406f78c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21852024-10-04T22:17:12.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6d5c3ca5-5048-472c-8e50-35b88406f78c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21862024-10-04T22:17:13.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 38b95b9c-5ce8-45fb-aaa0-6810b49edfdd roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21872024-10-04T22:17:13.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 38b95b9c-5ce8-45fb-aaa0-6810b49edfdd resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21882024-10-04T22:17:13.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 38b95b9c-5ce8-45fb-aaa0-6810b49edfdd response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21892024-10-04T22:17:14.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 502791e2-aa37-4ae0-8f15-7ba5ab7a6630 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21902024-10-04T22:17:14.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 502791e2-aa37-4ae0-8f15-7ba5ab7a6630 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21912024-10-04T22:17:14.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 502791e2-aa37-4ae0-8f15-7ba5ab7a6630 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
21922024-10-04T22:17:14.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
21932024-10-04T22:17:14.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21942024-10-04T22:17:14.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
21952024-10-04T22:17:14.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21962024-10-04T22:17:14.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21972024-10-04T22:17:14.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21982024-10-04T22:17:14.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21992024-10-04T22:17:14.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22002024-10-04T22:17:14.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22012024-10-04T22:17:14.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22022024-10-04T22:17:14.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22032024-10-04T22:17:14.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22042024-10-04T22:17:14.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22052024-10-04T22:17:14.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
22062024-10-04T22:17:14.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22072024-10-04T22:17:14.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22082024-10-04T22:17:14.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
22092024-10-04T22:17:14.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.931259ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
22102024-10-04T22:17:14.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22112024-10-04T22:17:14.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22122024-10-04T22:17:14.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.890907ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22132024-10-04T22:17:15.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd7b18b2-56d5-4e2a-a8e5-244b68ae15ba roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22142024-10-04T22:17:15.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd7b18b2-56d5-4e2a-a8e5-244b68ae15ba resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22152024-10-04T22:17:15.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fd7b18b2-56d5-4e2a-a8e5-244b68ae15ba response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22162024-10-04T22:17:16.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b799562e-0219-4e24-b0db-f2f0104d7b98 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22172024-10-04T22:17:16.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b799562e-0219-4e24-b0db-f2f0104d7b98 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22182024-10-04T22:17:16.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b799562e-0219-4e24-b0db-f2f0104d7b98 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22192024-10-04T22:17:17.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f7f369e-58fe-4b78-810e-72c0d6e3b1f9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22202024-10-04T22:17:17.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f7f369e-58fe-4b78-810e-72c0d6e3b1f9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22212024-10-04T22:17:17.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f7f369e-58fe-4b78-810e-72c0d6e3b1f9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22222024-10-04T22:17:18.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2e0bfda5-8200-4593-b627-0f649940255a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22232024-10-04T22:17:18.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2e0bfda5-8200-4593-b627-0f649940255a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22242024-10-04T22:17:18.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2e0bfda5-8200-4593-b627-0f649940255a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22252024-10-04T22:17:19.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1f336bb0-25f4-4660-ab16-358f1283dd4d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22262024-10-04T22:17:19.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1f336bb0-25f4-4660-ab16-358f1283dd4d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22272024-10-04T22:17:19.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1f336bb0-25f4-4660-ab16-358f1283dd4d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22282024-10-04T22:17:20.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 03b94ad6-6268-4e32-977e-e56a052d2c67 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22292024-10-04T22:17:20.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 03b94ad6-6268-4e32-977e-e56a052d2c67 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22302024-10-04T22:17:20.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 03b94ad6-6268-4e32-977e-e56a052d2c67 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22312024-10-04T22:17:20.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1335 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = b2f7e7c3-c1c9-43db-b16a-c83bb827bf74 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
22322024-10-04T22:17:21.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a5b5a677-c80f-4544-b4d9-f2ca6528df31 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22332024-10-04T22:17:21.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a5b5a677-c80f-4544-b4d9-f2ca6528df31 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22342024-10-04T22:17:21.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a5b5a677-c80f-4544-b4d9-f2ca6528df31 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22352024-10-04T22:17:22.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 501521d2-359a-4121-9964-8eff4e1b8648 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22362024-10-04T22:17:22.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 501521d2-359a-4121-9964-8eff4e1b8648 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22372024-10-04T22:17:22.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 501521d2-359a-4121-9964-8eff4e1b8648 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22382024-10-04T22:17:23.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64c3d31b-f2d2-4317-a58c-20d086485f93 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22392024-10-04T22:17:23.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64c3d31b-f2d2-4317-a58c-20d086485f93 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22402024-10-04T22:17:23.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64c3d31b-f2d2-4317-a58c-20d086485f93 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22412024-10-04T22:17:24.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
22422024-10-04T22:17:24.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22432024-10-04T22:17:24.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
22442024-10-04T22:17:24.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22452024-10-04T22:17:24.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22462024-10-04T22:17:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22472024-10-04T22:17:24.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22482024-10-04T22:17:24.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22492024-10-04T22:17:24.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22502024-10-04T22:17:24.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22512024-10-04T22:17:24.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f7aa84b-49d5-459b-a128-705806987bd7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22522024-10-04T22:17:24.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f7aa84b-49d5-459b-a128-705806987bd7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22532024-10-04T22:17:24.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22542024-10-04T22:17:24.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22552024-10-04T22:17:24.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f7aa84b-49d5-459b-a128-705806987bd7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22562024-10-04T22:17:24.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22572024-10-04T22:17:24.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
22582024-10-04T22:17:24.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22592024-10-04T22:17:24.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22602024-10-04T22:17:24.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
22612024-10-04T22:17:24.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.300725ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
22622024-10-04T22:17:24.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22632024-10-04T22:17:24.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22642024-10-04T22:17:24.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.795624ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22652024-10-04T22:17:25.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8ee5c087-aff5-4a84-a686-997714d76d21 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22662024-10-04T22:17:25.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8ee5c087-aff5-4a84-a686-997714d76d21 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22672024-10-04T22:17:25.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8ee5c087-aff5-4a84-a686-997714d76d21 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22682024-10-04T22:17:26.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ae61e9e-a620-477b-9983-0ec2c63e16dc roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22692024-10-04T22:17:26.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ae61e9e-a620-477b-9983-0ec2c63e16dc resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22702024-10-04T22:17:26.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ae61e9e-a620-477b-9983-0ec2c63e16dc response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22712024-10-04T22:17:27.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c18f9e1b-691f-4bd8-ac2b-17e08f9af181 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22722024-10-04T22:17:27.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c18f9e1b-691f-4bd8-ac2b-17e08f9af181 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22732024-10-04T22:17:27.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c18f9e1b-691f-4bd8-ac2b-17e08f9af181 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22742024-10-04T22:17:28.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = eaf9ba5e-64c9-4f0c-a6e8-00e02b908540 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22752024-10-04T22:17:28.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = eaf9ba5e-64c9-4f0c-a6e8-00e02b908540 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22762024-10-04T22:17:28.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = eaf9ba5e-64c9-4f0c-a6e8-00e02b908540 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22772024-10-04T22:17:29.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c69c0a0a-cbf8-43be-af3c-7018f9ae0d01 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22782024-10-04T22:17:29.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c69c0a0a-cbf8-43be-af3c-7018f9ae0d01 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22792024-10-04T22:17:29.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c69c0a0a-cbf8-43be-af3c-7018f9ae0d01 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22802024-10-04T22:17:30.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6719d254-d073-4968-a16b-a1c7e23dde73 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22812024-10-04T22:17:30.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6719d254-d073-4968-a16b-a1c7e23dde73 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22822024-10-04T22:17:30.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6719d254-d073-4968-a16b-a1c7e23dde73 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22832024-10-04T22:17:30.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1375 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 68ca0d91-d41e-406c-9e05-e10635646e9b response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
22842024-10-04T22:17:31.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f90a5cde-81f4-430f-8ea3-5b9b40fcce00 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22852024-10-04T22:17:31.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f90a5cde-81f4-430f-8ea3-5b9b40fcce00 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22862024-10-04T22:17:31.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f90a5cde-81f4-430f-8ea3-5b9b40fcce00 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22872024-10-04T22:17:32.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4dd89977-629e-4617-a2b4-db1db9b47a20 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22882024-10-04T22:17:32.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4dd89977-629e-4617-a2b4-db1db9b47a20 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22892024-10-04T22:17:32.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4dd89977-629e-4617-a2b4-db1db9b47a20 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22902024-10-04T22:17:33.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0f34fdc6-4a61-4f6f-871b-f9b29b627f82 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22912024-10-04T22:17:33.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0f34fdc6-4a61-4f6f-871b-f9b29b627f82 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22922024-10-04T22:17:33.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0f34fdc6-4a61-4f6f-871b-f9b29b627f82 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
22932024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
22942024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22952024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
22962024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22972024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22982024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
22992024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
23002024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23012024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.02\u{b5}s iteration = 8 status = {"errors":[],"records_set_to_done":[]}
23022024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
23032024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
23042024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23052024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
23062024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
23072024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
23082024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23092024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23102024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
23112024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23122024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23132024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
23142024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.52\u{b5}s iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23152024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
23162024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
23172024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23182024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.38\u{b5}s iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
23192024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
23202024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
23212024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23222024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.201\u{b5}s iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23232024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
23242024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
23252024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23262024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23272024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23282024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23292024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23302024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23312024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23322024-10-04T22:17:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23332024-10-04T22:17:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23342024-10-04T22:17:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23352024-10-04T22:17:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23362024-10-04T22:17:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23372024-10-04T22:17:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23382024-10-04T22:17:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23392024-10-04T22:17:34.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23402024-10-04T22:17:34.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23412024-10-04T22:17:34.584ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.819497ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23422024-10-04T22:17:34.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432024-10-04T22:17:34.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23442024-10-04T22:17:34.585ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23452024-10-04T22:17:34.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23462024-10-04T22:17:34.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23472024-10-04T22:17:34.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23482024-10-04T22:17:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23492024-10-04T22:17:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23502024-10-04T22:17:34.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23512024-10-04T22:17:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23522024-10-04T22:17:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23532024-10-04T22:17:34.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23542024-10-04T22:17:34.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23552024-10-04T22:17:34.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23562024-10-04T22:17:34.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23572024-10-04T22:17:34.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23582024-10-04T22:17:34.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23592024-10-04T22:17:34.593ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1052, tv_nsec: 895178204 } })
23602024-10-04T22:17:34.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23612024-10-04T22:17:34.594ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
23622024-10-04T22:17:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23632024-10-04T22:17:34.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23642024-10-04T22:17:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23652024-10-04T22:17:34.595ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1052, tv_nsec: 897024411 } })
23662024-10-04T22:17:34.595ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
23672024-10-04T22:17:34.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23682024-10-04T22:17:34.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23692024-10-04T22:17:34.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23702024-10-04T22:17:34.597ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1052, tv_nsec: 899553692 } })
23712024-10-04T22:17:34.598ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
23722024-10-04T22:17:34.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23732024-10-04T22:17:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23742024-10-04T22:17:34.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23752024-10-04T22:17:34.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23762024-10-04T22:17:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23772024-10-04T22:17:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23782024-10-04T22:17:34.622ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23792024-10-04T22:17:34.622ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23802024-10-04T22:17:34.622ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23812024-10-04T22:17:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23822024-10-04T22:17:34.624ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23832024-10-04T22:17:34.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23842024-10-04T22:17:34.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23852024-10-04T22:17:34.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23862024-10-04T22:17:34.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23872024-10-04T22:17:34.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23882024-10-04T22:17:34.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23892024-10-04T22:17:34.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23902024-10-04T22:17:34.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23912024-10-04T22:17:34.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
23922024-10-04T22:17:34.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23932024-10-04T22:17:34.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23942024-10-04T22:17:34.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23952024-10-04T22:17:34.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.492559ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23962024-10-04T22:17:34.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23972024-10-04T22:17:34.650ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23982024-10-04T22:17:34.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23992024-10-04T22:17:34.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24002024-10-04T22:17:34.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24012024-10-04T22:17:34.710ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
24022024-10-04T22:17:34.710ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24032024-10-04T22:17:34.710ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "572d35b9-5937-4ea7-82d0-eacb2c758907", "content-length": "26", "date": "Fri, 04 Oct 2024 22:17:34 GMT"} })
24042024-10-04T22:17:34.710ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24052024-10-04T22:17:34.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
24062024-10-04T22:17:34.713ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24072024-10-04T22:17:34.713ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24082024-10-04T22:17:34.713ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4659a92b-b61d-4153-8be5-c129193c6cd4", "content-length": "26", "date": "Fri, 04 Oct 2024 22:17:34 GMT"} })
24092024-10-04T22:17:34.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24102024-10-04T22:17:34.714ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24112024-10-04T22:17:34.722ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
24122024-10-04T22:17:34.722ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24132024-10-04T22:17:34.723ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "524d901b-3a43-42b8-a8d3-dcee569aaa23", "content-length": "26", "date": "Fri, 04 Oct 2024 22:17:34 GMT"} })
24142024-10-04T22:17:34.723ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24152024-10-04T22:17:34.724ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
24162024-10-04T22:17:34.728ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24172024-10-04T22:17:34.729ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb48cf26-cd83-4be1-8931-1438746293ec", "content-length": "372", "date": "Fri, 04 Oct 2024 22:17:34 GMT"} })
24182024-10-04T22:17:34.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24192024-10-04T22:17:34.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24202024-10-04T22:17:34.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24212024-10-04T22:17:34.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24222024-10-04T22:17:34.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24232024-10-04T22:17:34.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24242024-10-04T22:17:34.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24252024-10-04T22:17:34.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24262024-10-04T22:17:34.743ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
24272024-10-04T22:17:34.743ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 162.429284ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
24282024-10-04T22:17:34.745ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24292024-10-04T22:17:34.745ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "94a54650-3cc4-4154-bc64-ce02314942e7", "date": "Fri, 04 Oct 2024 22:17:34 GMT"} })
24302024-10-04T22:17:34.746ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 166.382104ms iteration = 9 status = {}
24312024-10-04T22:17:34.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 186.038767ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24322024-10-04T22:17:34.767ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24332024-10-04T22:17:34.767ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24342024-10-04T22:17:34.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24352024-10-04T22:17:34.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24362024-10-04T22:17:34.769ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24372024-10-04T22:17:34.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 188.512146ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24382024-10-04T22:17:34.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24392024-10-04T22:17:34.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
24402024-10-04T22:17:34.774ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24412024-10-04T22:17:34.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24422024-10-04T22:17:34.777ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 196.885583ms iteration = 8 status = 0
24432024-10-04T22:17:34.795ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24442024-10-04T22:17:34.795ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24452024-10-04T22:17:34.795ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 214.831212ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24462024-10-04T22:17:34.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4e86fd44-7b24-48d5-b2be-cbb3a78182f5 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
24472024-10-04T22:17:34.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4e86fd44-7b24-48d5-b2be-cbb3a78182f5 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
24482024-10-04T22:17:34.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4e86fd44-7b24-48d5-b2be-cbb3a78182f5 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
24492024-10-04T22:17:34.808ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24502024-10-04T22:17:34.808ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1998bf19-8de2-4f60-a252-6b0ab66feca1", "content-length": "1", "date": "Fri, 04 Oct 2024 22:17:33 GMT"} })
24512024-10-04T22:17:34.809ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24522024-10-04T22:17:34.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24532024-10-04T22:17:34.814ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 233.706079ms iteration = 8 status = null
24542024-10-04T22:17:34.816ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 236.2784ms iteration = 11 status = {"physical_disks_added":0}
24552024-10-04T22:17:34.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24562024-10-04T22:17:34.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24572024-10-04T22:17:34.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24582024-10-04T22:17:34.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24592024-10-04T22:17:34.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24602024-10-04T22:17:34.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24612024-10-04T22:17:34.868ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 287.911851ms iteration = 8 status = {}
24622024-10-04T22:17:34.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24632024-10-04T22:17:34.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24642024-10-04T22:17:34.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24652024-10-04T22:17:34.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24662024-10-04T22:17:34.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24672024-10-04T22:17:34.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24682024-10-04T22:17:34.944ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
24692024-10-04T22:17:34.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24702024-10-04T22:17:34.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24712024-10-04T22:17:34.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24722024-10-04T22:17:35.017ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1880e841-db71-40f9-8153-b586d846f71e", "content-length": "691", "date": "Fri, 04 Oct 2024 22:17:34 GMT"} })
24732024-10-04T22:17:35.017ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
24742024-10-04T22:17:35.017ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
24752024-10-04T22:17:35.017ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
24762024-10-04T22:17:35.019ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 438.734184ms iteration = 8 status = {}
24772024-10-04T22:17:35.091ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24782024-10-04T22:17:35.091ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7bb3ee0-21cb-4328-9496-1c4e922a57b0", "content-length": "121", "date": "Fri, 04 Oct 2024 22:17:35 GMT"} })
24792024-10-04T22:17:35.091ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
24802024-10-04T22:17:35.091ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
24812024-10-04T22:17:35.091ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24822024-10-04T22:17:35.091ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24832024-10-04T22:17:35.091ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
24842024-10-04T22:17:35.091ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
24852024-10-04T22:17:35.091ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
24862024-10-04T22:17:35.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24872024-10-04T22:17:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24882024-10-04T22:17:35.094ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24892024-10-04T22:17:35.094ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5e96ac2-d4ab-4c54-81f5-fd250488dd60", "content-length": "2", "date": "Fri, 04 Oct 2024 22:17:35 GMT"} })
24902024-10-04T22:17:35.094ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24912024-10-04T22:17:35.094ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d921d45-07d3-484f-83cb-60ed647a7f53", "content-length": "52", "date": "Fri, 04 Oct 2024 22:17:35 GMT"} })
24922024-10-04T22:17:35.094ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
24932024-10-04T22:17:35.094ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24942024-10-04T22:17:35.194ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "86577c90-e388-4273-be9f-e152b061ae4b", "date": "Fri, 04 Oct 2024 22:17:35 GMT"} })
24952024-10-04T22:17:35.194ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
24962024-10-04T22:17:35.194ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24972024-10-04T22:17:35.194ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "580e8e35-2f49-4978-98ad-9ec2c1b3bbae", "content-length": "667", "date": "Fri, 04 Oct 2024 22:17:35 GMT"} })
24982024-10-04T22:17:35.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24992024-10-04T22:17:35.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25002024-10-04T22:17:35.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25012024-10-04T22:17:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25022024-10-04T22:17:35.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25032024-10-04T22:17:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25042024-10-04T22:17:35.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25052024-10-04T22:17:35.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25062024-10-04T22:17:35.209ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 629.286351ms iteration = 8 status = {}
25072024-10-04T22:17:35.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 8afb5753-8c2d-4179-9add-3f1ad96d7062 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25082024-10-04T22:17:35.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 8afb5753-8c2d-4179-9add-3f1ad96d7062 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25092024-10-04T22:17:35.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2972 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 8afb5753-8c2d-4179-9add-3f1ad96d7062 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25102024-10-04T22:17:35.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9fbf4d2f-872f-4c89-85e9-845b955d78d2 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25112024-10-04T22:17:35.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9fbf4d2f-872f-4c89-85e9-845b955d78d2 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25122024-10-04T22:17:35.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9fbf4d2f-872f-4c89-85e9-845b955d78d2 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25132024-10-04T22:17:36.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66d1c69f-f9f4-4021-8b30-1e9a62826965 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25142024-10-04T22:17:36.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66d1c69f-f9f4-4021-8b30-1e9a62826965 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25152024-10-04T22:17:36.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66d1c69f-f9f4-4021-8b30-1e9a62826965 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25162024-10-04T22:17:37.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b511506d-64a6-4fb8-aa5d-fe7da026cf99 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25172024-10-04T22:17:37.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b511506d-64a6-4fb8-aa5d-fe7da026cf99 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25182024-10-04T22:17:37.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b511506d-64a6-4fb8-aa5d-fe7da026cf99 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25192024-10-04T22:17:38.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4e625570-35b6-41e9-8c86-09c51e87fb09 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25202024-10-04T22:17:38.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4e625570-35b6-41e9-8c86-09c51e87fb09 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25212024-10-04T22:17:38.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4e625570-35b6-41e9-8c86-09c51e87fb09 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25222024-10-04T22:17:39.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96beda27-7d92-440e-948f-763c91a1fd56 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25232024-10-04T22:17:39.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96beda27-7d92-440e-948f-763c91a1fd56 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25242024-10-04T22:17:39.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96beda27-7d92-440e-948f-763c91a1fd56 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25252024-10-04T22:17:40.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c75384d1-d923-4b19-872e-07140bb16109 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25262024-10-04T22:17:40.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c75384d1-d923-4b19-872e-07140bb16109 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25272024-10-04T22:17:40.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c75384d1-d923-4b19-872e-07140bb16109 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25282024-10-04T22:17:40.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 021ce9ca-0217-420a-835b-7d6144f0658a response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
25292024-10-04T22:17:41.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 943df37e-b433-4061-a987-5519ac946089 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25302024-10-04T22:17:41.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 943df37e-b433-4061-a987-5519ac946089 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25312024-10-04T22:17:41.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 943df37e-b433-4061-a987-5519ac946089 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25322024-10-04T22:17:42.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e8c269d2-862b-4a20-bc92-ea6d75287482 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25332024-10-04T22:17:42.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e8c269d2-862b-4a20-bc92-ea6d75287482 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25342024-10-04T22:17:42.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e8c269d2-862b-4a20-bc92-ea6d75287482 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25352024-10-04T22:17:43.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ccc7e28-3e33-4bb3-9864-d42b88eaa244 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25362024-10-04T22:17:43.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ccc7e28-3e33-4bb3-9864-d42b88eaa244 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25372024-10-04T22:17:44.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ccc7e28-3e33-4bb3-9864-d42b88eaa244 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25382024-10-04T22:17:44.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
25392024-10-04T22:17:44.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25402024-10-04T22:17:44.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
25412024-10-04T22:17:44.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25422024-10-04T22:17:44.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25432024-10-04T22:17:44.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25442024-10-04T22:17:44.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25452024-10-04T22:17:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25462024-10-04T22:17:44.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25472024-10-04T22:17:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25482024-10-04T22:17:44.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25492024-10-04T22:17:44.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25502024-10-04T22:17:44.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25512024-10-04T22:17:44.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25522024-10-04T22:17:44.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25532024-10-04T22:17:44.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
25542024-10-04T22:17:44.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25552024-10-04T22:17:44.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25562024-10-04T22:17:44.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
25572024-10-04T22:17:44.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.310815ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
25582024-10-04T22:17:44.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.783344ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25592024-10-04T22:17:45.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 75eb1e86-b354-4e70-8a5e-27548f3c1498 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25602024-10-04T22:17:45.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 75eb1e86-b354-4e70-8a5e-27548f3c1498 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25612024-10-04T22:17:45.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 75eb1e86-b354-4e70-8a5e-27548f3c1498 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25622024-10-04T22:17:46.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5d16554d-63ea-4f02-b4b4-c68591f2f9ed roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25632024-10-04T22:17:46.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5d16554d-63ea-4f02-b4b4-c68591f2f9ed resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25642024-10-04T22:17:46.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5d16554d-63ea-4f02-b4b4-c68591f2f9ed response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25652024-10-04T22:17:47.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 16aea075-512a-44c7-973c-48920a3eccfb roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25662024-10-04T22:17:47.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 16aea075-512a-44c7-973c-48920a3eccfb resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25672024-10-04T22:17:47.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 16aea075-512a-44c7-973c-48920a3eccfb response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25682024-10-04T22:17:48.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a9eb71a2-650b-4f41-97f1-152672ea6c1d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25692024-10-04T22:17:48.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a9eb71a2-650b-4f41-97f1-152672ea6c1d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25702024-10-04T22:17:48.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a9eb71a2-650b-4f41-97f1-152672ea6c1d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25712024-10-04T22:17:49.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 428b2cd2-611c-4275-8c19-ce2c9fed4da7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25722024-10-04T22:17:49.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 428b2cd2-611c-4275-8c19-ce2c9fed4da7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25732024-10-04T22:17:49.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 428b2cd2-611c-4275-8c19-ce2c9fed4da7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25742024-10-04T22:17:50.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a8d2b805-1d3a-41be-8d56-7daf17db649f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25752024-10-04T22:17:50.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a8d2b805-1d3a-41be-8d56-7daf17db649f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25762024-10-04T22:17:50.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a8d2b805-1d3a-41be-8d56-7daf17db649f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25772024-10-04T22:17:50.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = aa186b01-ba5b-408e-a805-f145509f6519 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
25782024-10-04T22:17:51.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 01cb6254-678d-4668-9aa2-ec3661360f90 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25792024-10-04T22:17:51.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 01cb6254-678d-4668-9aa2-ec3661360f90 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25802024-10-04T22:17:51.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 01cb6254-678d-4668-9aa2-ec3661360f90 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25812024-10-04T22:17:52.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f0626a5-5472-4297-93eb-d4f9732ef0e5 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25822024-10-04T22:17:52.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f0626a5-5472-4297-93eb-d4f9732ef0e5 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25832024-10-04T22:17:52.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2668 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f0626a5-5472-4297-93eb-d4f9732ef0e5 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25842024-10-04T22:17:53.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = db29acc6-7f3c-4675-bfd1-3a9e4e4a6449 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25852024-10-04T22:17:53.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = db29acc6-7f3c-4675-bfd1-3a9e4e4a6449 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25862024-10-04T22:17:53.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = db29acc6-7f3c-4675-bfd1-3a9e4e4a6449 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25872024-10-04T22:17:54.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 04307c63-eb0b-464b-aa13-b808b9e5ed20 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25882024-10-04T22:17:54.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 04307c63-eb0b-464b-aa13-b808b9e5ed20 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25892024-10-04T22:17:54.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1871 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 04307c63-eb0b-464b-aa13-b808b9e5ed20 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
25902024-10-04T22:17:54.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
25912024-10-04T22:17:54.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25922024-10-04T22:17:54.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
25932024-10-04T22:17:54.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25942024-10-04T22:17:54.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25952024-10-04T22:17:54.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25962024-10-04T22:17:54.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25972024-10-04T22:17:54.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25982024-10-04T22:17:54.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25992024-10-04T22:17:54.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26002024-10-04T22:17:54.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26012024-10-04T22:17:54.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26022024-10-04T22:17:54.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26032024-10-04T22:17:54.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26042024-10-04T22:17:54.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26052024-10-04T22:17:54.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
26062024-10-04T22:17:54.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26072024-10-04T22:17:54.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26082024-10-04T22:17:54.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
26092024-10-04T22:17:54.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.450088ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
26102024-10-04T22:17:54.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.723113ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26112024-10-04T22:17:55.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4feb103f-4717-42a1-94aa-a361b78626b8 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26122024-10-04T22:17:55.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4feb103f-4717-42a1-94aa-a361b78626b8 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26132024-10-04T22:17:55.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4feb103f-4717-42a1-94aa-a361b78626b8 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26142024-10-04T22:17:56.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ca70f921-554f-4c79-86b0-2e8b4ce7e79c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26152024-10-04T22:17:56.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ca70f921-554f-4c79-86b0-2e8b4ce7e79c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26162024-10-04T22:17:56.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ca70f921-554f-4c79-86b0-2e8b4ce7e79c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26172024-10-04T22:17:57.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ba88089-9fd0-44a2-8b80-13bf155c68b3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26182024-10-04T22:17:57.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ba88089-9fd0-44a2-8b80-13bf155c68b3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26192024-10-04T22:17:57.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0ba88089-9fd0-44a2-8b80-13bf155c68b3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26202024-10-04T22:17:58.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 272ca9fd-3abc-4da7-a82f-92a5b06adefe roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26212024-10-04T22:17:58.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 272ca9fd-3abc-4da7-a82f-92a5b06adefe resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26222024-10-04T22:17:58.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 272ca9fd-3abc-4da7-a82f-92a5b06adefe response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26232024-10-04T22:17:59.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 74b3ba15-3d25-43d1-848e-9f2e5b933534 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26242024-10-04T22:17:59.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 74b3ba15-3d25-43d1-848e-9f2e5b933534 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26252024-10-04T22:17:59.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 74b3ba15-3d25-43d1-848e-9f2e5b933534 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26262024-10-04T22:18:00.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bbc7d48a-da3e-4356-8dab-4c37761fa9dd roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26272024-10-04T22:18:00.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bbc7d48a-da3e-4356-8dab-4c37761fa9dd resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26282024-10-04T22:18:00.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bbc7d48a-da3e-4356-8dab-4c37761fa9dd response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26292024-10-04T22:18:00.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1465 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 0ebe3b7b-f161-4411-b1b6-699515856d22 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
26302024-10-04T22:18:01.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 69310d12-b530-467b-ac0f-433e499a0020 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26312024-10-04T22:18:01.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 69310d12-b530-467b-ac0f-433e499a0020 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26322024-10-04T22:18:01.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 69310d12-b530-467b-ac0f-433e499a0020 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26332024-10-04T22:18:02.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f577e853-d263-4f1c-9722-4a5097162226 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26342024-10-04T22:18:02.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f577e853-d263-4f1c-9722-4a5097162226 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26352024-10-04T22:18:02.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f577e853-d263-4f1c-9722-4a5097162226 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26362024-10-04T22:18:03.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a3e7f669-1a14-46dc-89ba-d3e7ebfe2c3a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26372024-10-04T22:18:03.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a3e7f669-1a14-46dc-89ba-d3e7ebfe2c3a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26382024-10-04T22:18:03.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a3e7f669-1a14-46dc-89ba-d3e7ebfe2c3a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26392024-10-04T22:18:04.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d2fb8a39-6634-4499-8671-efd2cc249c38 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26402024-10-04T22:18:04.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d2fb8a39-6634-4499-8671-efd2cc249c38 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26412024-10-04T22:18:04.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d2fb8a39-6634-4499-8671-efd2cc249c38 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
26422024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
26432024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26442024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
26452024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26462024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26472024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
26482024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
26492024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.81\u{b5}s iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
26502024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
26512024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
26522024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.671\u{b5}s iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26532024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
26542024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26552024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26562024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26572024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
26582024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
26592024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
26602024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26612024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
26622024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
26632024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26642024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26652024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
26662024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.69\u{b5}s iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26672024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
26682024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
26692024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26702024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26712024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
26722024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26732024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
26742024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
26752024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
26762024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
26772024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26782024-10-04T22:18:04.580ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-04 22:08:04.580671982 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
26792024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
26802024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
26812024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.44\u{b5}s iteration = 9 status = {"errors":[],"records_set_to_done":[]}
26822024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
26832024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
26842024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26852024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
26862024-10-04T22:18:04.580ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 568e0899-5775-47c6-8a59-2b161d236a0c
26872024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.64\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"568e0899-5775-47c6-8a59-2b161d236a0c"}
26882024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
26892024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26902024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
26912024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
26922024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
26932024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
26942024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26952024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26962024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
26972024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
26982024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26992024-10-04T22:18:04.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27002024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
27012024-10-04T22:18:04.581ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
27022024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27032024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27042024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27052024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27062024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
27072024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27082024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27092024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
27102024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27112024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27122024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
27132024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27142024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27152024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27162024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27172024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27182024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27192024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27202024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27212024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27222024-10-04T22:18:04.581ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e5972f58-0215-4789-9de6-8c745fc8691c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1082, tv_nsec: 883166364 } })
27232024-10-04T22:18:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27242024-10-04T22:18:04.581ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("173a8178-efd5-4ec1-9f4c-a05bc972d94c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cceb95f-37ad-478b-be36-e32fb96c3dd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1082, tv_nsec: 883236126 } })
27252024-10-04T22:18:04.583ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
27262024-10-04T22:18:04.583ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.638482ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
27272024-10-04T22:18:04.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27282024-10-04T22:18:04.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27292024-10-04T22:18:04.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
27302024-10-04T22:18:04.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.374347ms iteration = 6 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
27312024-10-04T22:18:04.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27322024-10-04T22:18:04.587ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
27332024-10-04T22:18:04.587ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
27342024-10-04T22:18:04.587ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 7.150312ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
27352024-10-04T22:18:04.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1082, tv_nsec: 889372059 } })
27362024-10-04T22:18:04.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
27372024-10-04T22:18:04.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27382024-10-04T22:18:04.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27392024-10-04T22:18:04.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27402024-10-04T22:18:04.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27412024-10-04T22:18:04.591ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.818967ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
27422024-10-04T22:18:04.591ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.109342ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27432024-10-04T22:18:04.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27442024-10-04T22:18:04.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27452024-10-04T22:18:04.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27462024-10-04T22:18:04.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27472024-10-04T22:18:04.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27482024-10-04T22:18:04.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27492024-10-04T22:18:04.600ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-04 22:08:04.580671982 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
27502024-10-04T22:18:04.600ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.239375ms iteration = 5 status = {"expiration":"2024-10-04T22:08:04.580671982Z","pruned":[]}
27512024-10-04T22:18:04.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27522024-10-04T22:18:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27532024-10-04T22:18:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27542024-10-04T22:18:04.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27552024-10-04T22:18:04.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27562024-10-04T22:18:04.604ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1082, tv_nsec: 906032081 } })
27572024-10-04T22:18:04.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
27582024-10-04T22:18:04.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27592024-10-04T22:18:04.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27602024-10-04T22:18:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27612024-10-04T22:18:04.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27622024-10-04T22:18:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27632024-10-04T22:18:04.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27642024-10-04T22:18:04.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27652024-10-04T22:18:04.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27662024-10-04T22:18:04.618ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27672024-10-04T22:18:04.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27682024-10-04T22:18:04.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27692024-10-04T22:18:04.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27702024-10-04T22:18:04.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27712024-10-04T22:18:04.640ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27722024-10-04T22:18:04.641ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27732024-10-04T22:18:04.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27742024-10-04T22:18:04.641ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27752024-10-04T22:18:04.641ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27762024-10-04T22:18:04.641ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27772024-10-04T22:18:04.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27782024-10-04T22:18:04.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27792024-10-04T22:18:04.645ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27802024-10-04T22:18:04.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27812024-10-04T22:18:04.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27822024-10-04T22:18:04.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27832024-10-04T22:18:04.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.330505ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27842024-10-04T22:18:04.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27852024-10-04T22:18:04.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27862024-10-04T22:18:04.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27872024-10-04T22:18:04.656ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1082, tv_nsec: 958043340 } })
27882024-10-04T22:18:04.657ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27892024-10-04T22:18:04.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27902024-10-04T22:18:04.659ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
27912024-10-04T22:18:04.660ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27922024-10-04T22:18:04.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27932024-10-04T22:18:04.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27942024-10-04T22:18:04.661ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27952024-10-04T22:18:04.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
27962024-10-04T22:18:04.663ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27972024-10-04T22:18:04.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27982024-10-04T22:18:04.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27992024-10-04T22:18:04.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28002024-10-04T22:18:04.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28012024-10-04T22:18:04.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28022024-10-04T22:18:04.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28032024-10-04T22:18:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28042024-10-04T22:18:04.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
28052024-10-04T22:18:04.667ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28062024-10-04T22:18:04.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28072024-10-04T22:18:04.676ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28082024-10-04T22:18:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28092024-10-04T22:18:04.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28102024-10-04T22:18:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28112024-10-04T22:18:04.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28122024-10-04T22:18:04.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28132024-10-04T22:18:04.679ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28142024-10-04T22:18:04.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28152024-10-04T22:18:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
28162024-10-04T22:18:04.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28172024-10-04T22:18:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28182024-10-04T22:18:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28192024-10-04T22:18:04.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28202024-10-04T22:18:04.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28212024-10-04T22:18:04.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28222024-10-04T22:18:04.683ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
28232024-10-04T22:18:04.683ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
28242024-10-04T22:18:04.683ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
28252024-10-04T22:18:04.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28262024-10-04T22:18:04.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28272024-10-04T22:18:04.684ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.972907ms iteration = 9 status = 0
28282024-10-04T22:18:04.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
28292024-10-04T22:18:04.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28302024-10-04T22:18:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28312024-10-04T22:18:04.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28322024-10-04T22:18:04.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28332024-10-04T22:18:04.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28342024-10-04T22:18:04.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28352024-10-04T22:18:04.691ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
28362024-10-04T22:18:04.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.989857ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
28372024-10-04T22:18:04.692ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28382024-10-04T22:18:04.692ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.897826ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28392024-10-04T22:18:04.694ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28402024-10-04T22:18:04.694ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28412024-10-04T22:18:04.694ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28422024-10-04T22:18:04.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.734872ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28432024-10-04T22:18:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28442024-10-04T22:18:04.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28452024-10-04T22:18:04.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28462024-10-04T22:18:04.712ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
28472024-10-04T22:18:04.712ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
28482024-10-04T22:18:04.712ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 131.66241ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
28492024-10-04T22:18:04.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28502024-10-04T22:18:04.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28512024-10-04T22:18:04.715ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28522024-10-04T22:18:04.720ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
28532024-10-04T22:18:04.720ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
28542024-10-04T22:18:04.720ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
28552024-10-04T22:18:04.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28562024-10-04T22:18:04.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28572024-10-04T22:18:04.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28582024-10-04T22:18:04.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28592024-10-04T22:18:04.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28602024-10-04T22:18:04.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28612024-10-04T22:18:04.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28622024-10-04T22:18:04.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28632024-10-04T22:18:04.733ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
28642024-10-04T22:18:04.733ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 0 version = 2
28652024-10-04T22:18:04.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28662024-10-04T22:18:04.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28672024-10-04T22:18:04.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28682024-10-04T22:18:04.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28692024-10-04T22:18:04.735ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28702024-10-04T22:18:04.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28712024-10-04T22:18:04.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28722024-10-04T22:18:04.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28732024-10-04T22:18:04.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28742024-10-04T22:18:04.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28752024-10-04T22:18:04.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28762024-10-04T22:18:04.743ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28772024-10-04T22:18:04.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28782024-10-04T22:18:04.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28792024-10-04T22:18:04.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28802024-10-04T22:18:04.748ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
28812024-10-04T22:18:04.748ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28822024-10-04T22:18:04.749ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28832024-10-04T22:18:04.749ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28842024-10-04T22:18:04.749ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 169.194159ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28852024-10-04T22:18:04.749ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d3ae4f0-d4f5-4f0a-9a51-026f2cf235be", "content-length": "26", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
28862024-10-04T22:18:04.749ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28872024-10-04T22:18:04.752ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28882024-10-04T22:18:04.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28892024-10-04T22:18:04.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28902024-10-04T22:18:04.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28912024-10-04T22:18:04.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28922024-10-04T22:18:04.770ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 1 version = 2
28932024-10-04T22:18:04.770ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28942024-10-04T22:18:04.770ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-04 22:14:38.170044 UTC dns_group = external generation = 2
28952024-10-04T22:18:04.770ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 189.937115ms iteration = 6 status = {"generation":2}
28962024-10-04T22:18:04.771ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
28972024-10-04T22:18:04.771ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
28982024-10-04T22:18:04.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28992024-10-04T22:18:04.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29002024-10-04T22:18:04.772ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29012024-10-04T22:18:04.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29022024-10-04T22:18:04.775ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29032024-10-04T22:18:04.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29042024-10-04T22:18:04.778ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
29052024-10-04T22:18:04.778ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
29062024-10-04T22:18:04.778ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-04 22:14:36.136216 UTC dns_group = internal generation = 1
29072024-10-04T22:18:04.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 197.649828ms iteration = 6 status = {"generation":1}
29082024-10-04T22:18:04.790ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-04T22:14:02.806172Z, time_modified: 2024-10-04T22:14:02.806172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }) }
29092024-10-04T22:18:04.790ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 209.853682ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]}},"default_endpoint":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
29102024-10-04T22:18:04.790ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
29112024-10-04T22:18:04.790ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29122024-10-04T22:18:04.791ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03eba191-9d18-41dd-a4cc-fe597e955282", "content-length": "26", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29132024-10-04T22:18:04.791ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29142024-10-04T22:18:04.793ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29152024-10-04T22:18:04.795ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 215.171528ms iteration = 12 status = {"physical_disks_added":0}
29162024-10-04T22:18:04.801ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
29172024-10-04T22:18:04.801ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 221.110647ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
29182024-10-04T22:18:04.807ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
29192024-10-04T22:18:04.807ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29202024-10-04T22:18:04.808ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc236371-20b4-4b63-a560-eb41e49d90bc", "content-length": "26", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29212024-10-04T22:18:04.808ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29222024-10-04T22:18:04.810ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
29232024-10-04T22:18:04.852ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29242024-10-04T22:18:04.853ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5927b573-ac78-413d-8181-99d6173afa6e", "content-length": "372", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29252024-10-04T22:18:04.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29262024-10-04T22:18:04.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29272024-10-04T22:18:04.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29282024-10-04T22:18:04.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29292024-10-04T22:18:04.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29302024-10-04T22:18:04.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29312024-10-04T22:18:04.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29322024-10-04T22:18:04.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d5c545eb-ab15-4d34-8e3d-daf86a1137bb", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29332024-10-04T22:18:04.864ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.933732ms iteration = 10 status = {}
29342024-10-04T22:18:04.927ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29352024-10-04T22:18:04.927ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e1ccac84-81c0-4761-8da1-311b578db773", "content-length": "1", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29362024-10-04T22:18:04.929ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29372024-10-04T22:18:04.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29382024-10-04T22:18:04.930ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 350.295828ms iteration = 9 status = null
29392024-10-04T22:18:04.936ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
29402024-10-04T22:18:04.937ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d599825c-9543-4fb2-81b3-a024e9a5208b", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29412024-10-04T22:18:04.937ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29422024-10-04T22:18:04.939ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e43cd2ff-6725-44e0-9207-fa848cd15b92", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29432024-10-04T22:18:04.939ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29442024-10-04T22:18:04.940ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29452024-10-04T22:18:04.940ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 360.343678ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
29462024-10-04T22:18:04.986ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29472024-10-04T22:18:04.987ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "393f8b7f-5777-4fcc-95a1-f28cd1397a2b", "content-length": "691", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29482024-10-04T22:18:04.987ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29492024-10-04T22:18:04.987ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29502024-10-04T22:18:04.987ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29512024-10-04T22:18:04.988ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 408.024131ms iteration = 9 status = {}
29522024-10-04T22:18:04.992ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
29532024-10-04T22:18:05.005ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 424.578691ms iteration = 9 status = {}
29542024-10-04T22:18:05.076ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
29552024-10-04T22:18:05.076ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "868c6a12-af43-41b5-aa57-cf431d8f3ff7", "date": "Fri, 04 Oct 2024 22:18:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29562024-10-04T22:18:05.076ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29572024-10-04T22:18:05.078ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9b25fa86-58eb-4676-9fba-929f358c41c0", "date": "Fri, 04 Oct 2024 22:18:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29582024-10-04T22:18:05.078ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29592024-10-04T22:18:05.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8265c829-2678-40d4-854c-ddd52e6424f2", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29602024-10-04T22:18:05.080ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29612024-10-04T22:18:05.082ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
29622024-10-04T22:18:05.082ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 501.887545ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
29632024-10-04T22:18:05.095ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29642024-10-04T22:18:05.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29652024-10-04T22:18:05.098ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
29662024-10-04T22:18:05.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29672024-10-04T22:18:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29682024-10-04T22:18:05.105ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29692024-10-04T22:18:05.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b398e53c-d3d9-458d-9865-ea0f3ab2329f", "content-length": "121", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29702024-10-04T22:18:05.105ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
29712024-10-04T22:18:05.105ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
29722024-10-04T22:18:05.106ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29732024-10-04T22:18:05.106ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29742024-10-04T22:18:05.106ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
29752024-10-04T22:18:05.106ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
29762024-10-04T22:18:05.106ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
29772024-10-04T22:18:05.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29782024-10-04T22:18:05.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29792024-10-04T22:18:05.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29802024-10-04T22:18:05.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "131b5c7b-cd08-496b-b1a2-8ea298f3a1fa", "content-length": "2", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29812024-10-04T22:18:05.108ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29822024-10-04T22:18:05.108ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f24c33e9-6836-4482-a65a-d67459653f27", "content-length": "52", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29832024-10-04T22:18:05.108ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
29842024-10-04T22:18:05.108ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29852024-10-04T22:18:05.206ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "45f46709-7a84-4081-ab6c-dc881bb127ef", "date": "Fri, 04 Oct 2024 22:18:04 GMT"} })
29862024-10-04T22:18:05.206ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
29872024-10-04T22:18:05.206ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29882024-10-04T22:18:05.211ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b3b7bd3-98ea-4765-b2bc-944e736b2b85", "content-length": "667", "date": "Fri, 04 Oct 2024 22:18:05 GMT"} })
29892024-10-04T22:18:05.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29902024-10-04T22:18:05.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29912024-10-04T22:18:05.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29922024-10-04T22:18:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29932024-10-04T22:18:05.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29942024-10-04T22:18:05.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29952024-10-04T22:18:05.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29962024-10-04T22:18:05.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29972024-10-04T22:18:05.228ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 647.7769ms iteration = 9 status = {}
29982024-10-04T22:18:05.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 79abe58a-d44b-4f60-a562-e1106b430072 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
29992024-10-04T22:18:05.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 79abe58a-d44b-4f60-a562-e1106b430072 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
30002024-10-04T22:18:05.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 79abe58a-d44b-4f60-a562-e1106b430072 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
30012024-10-04T22:18:05.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 022bf963-3ec4-4afd-a3d8-f14a133e9e18 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30022024-10-04T22:18:05.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 022bf963-3ec4-4afd-a3d8-f14a133e9e18 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30032024-10-04T22:18:05.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 022bf963-3ec4-4afd-a3d8-f14a133e9e18 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30042024-10-04T22:18:06.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ed46659e-b6e3-4fd9-aa86-9b97825afb20 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30052024-10-04T22:18:06.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ed46659e-b6e3-4fd9-aa86-9b97825afb20 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30062024-10-04T22:18:06.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2744 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ed46659e-b6e3-4fd9-aa86-9b97825afb20 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30072024-10-04T22:18:07.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a1c2ef5-f7c7-41ad-97c0-36e522000a76 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30082024-10-04T22:18:07.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a1c2ef5-f7c7-41ad-97c0-36e522000a76 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30092024-10-04T22:18:07.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a1c2ef5-f7c7-41ad-97c0-36e522000a76 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30102024-10-04T22:18:08.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f2f2820-045a-46c3-bcbd-aef94bbb8c23 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30112024-10-04T22:18:08.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f2f2820-045a-46c3-bcbd-aef94bbb8c23 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30122024-10-04T22:18:08.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f2f2820-045a-46c3-bcbd-aef94bbb8c23 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30132024-10-04T22:18:09.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96bee4b9-d243-4730-8a3a-b5a2ba799266 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30142024-10-04T22:18:09.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96bee4b9-d243-4730-8a3a-b5a2ba799266 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30152024-10-04T22:18:09.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96bee4b9-d243-4730-8a3a-b5a2ba799266 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30162024-10-04T22:18:10.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0879f3b2-f94a-42f2-9c24-4cd4878bc07b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30172024-10-04T22:18:10.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0879f3b2-f94a-42f2-9c24-4cd4878bc07b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30182024-10-04T22:18:10.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 0879f3b2-f94a-42f2-9c24-4cd4878bc07b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30192024-10-04T22:18:10.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1657 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = d5138e46-7597-41db-8f4d-1441ca34869c response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
30202024-10-04T22:18:11.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 61c3b41c-8c49-42f4-8622-53cc0026ffc0 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30212024-10-04T22:18:11.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 61c3b41c-8c49-42f4-8622-53cc0026ffc0 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30222024-10-04T22:18:11.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 61c3b41c-8c49-42f4-8622-53cc0026ffc0 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30232024-10-04T22:18:12.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a4570fe6-1c83-44f4-8a8a-7188ec900e2a roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30242024-10-04T22:18:12.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a4570fe6-1c83-44f4-8a8a-7188ec900e2a resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30252024-10-04T22:18:12.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a4570fe6-1c83-44f4-8a8a-7188ec900e2a response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30262024-10-04T22:18:13.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 67571513-43bf-4add-be86-62b10013d3ad roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30272024-10-04T22:18:13.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 67571513-43bf-4add-be86-62b10013d3ad resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30282024-10-04T22:18:13.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 67571513-43bf-4add-be86-62b10013d3ad response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30292024-10-04T22:18:14.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
30302024-10-04T22:18:14.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30312024-10-04T22:18:14.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
30322024-10-04T22:18:14.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30332024-10-04T22:18:14.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30342024-10-04T22:18:14.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30352024-10-04T22:18:14.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30362024-10-04T22:18:14.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30372024-10-04T22:18:14.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30382024-10-04T22:18:14.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30392024-10-04T22:18:14.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30402024-10-04T22:18:14.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30412024-10-04T22:18:14.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30422024-10-04T22:18:14.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
30432024-10-04T22:18:14.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30442024-10-04T22:18:14.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30452024-10-04T22:18:14.603ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
30462024-10-04T22:18:14.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.116352ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
30472024-10-04T22:18:14.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30482024-10-04T22:18:14.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30492024-10-04T22:18:14.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.933638ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30502024-10-04T22:18:14.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 426355e3-4067-428a-a564-80b98441fa58 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30512024-10-04T22:18:14.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 426355e3-4067-428a-a564-80b98441fa58 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30522024-10-04T22:18:14.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 426355e3-4067-428a-a564-80b98441fa58 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30532024-10-04T22:18:15.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 68d6f56a-b061-4d16-be99-cfe9c8cfb6e8 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30542024-10-04T22:18:15.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 68d6f56a-b061-4d16-be99-cfe9c8cfb6e8 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30552024-10-04T22:18:15.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 68d6f56a-b061-4d16-be99-cfe9c8cfb6e8 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30562024-10-04T22:18:16.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10be7aab-8aef-4482-a3ff-1fd63e3e2e54 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30572024-10-04T22:18:16.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10be7aab-8aef-4482-a3ff-1fd63e3e2e54 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30582024-10-04T22:18:16.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10be7aab-8aef-4482-a3ff-1fd63e3e2e54 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30592024-10-04T22:18:17.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a36124c2-13e9-40b7-8e65-048d42e5d144 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30602024-10-04T22:18:17.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a36124c2-13e9-40b7-8e65-048d42e5d144 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30612024-10-04T22:18:17.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a36124c2-13e9-40b7-8e65-048d42e5d144 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30622024-10-04T22:18:18.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 049ec935-ae53-4ef5-af82-eb034151d97d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30632024-10-04T22:18:18.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 049ec935-ae53-4ef5-af82-eb034151d97d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30642024-10-04T22:18:18.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 049ec935-ae53-4ef5-af82-eb034151d97d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30652024-10-04T22:18:19.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b425b439-f298-4423-9d53-c9c6bee6c54e roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30662024-10-04T22:18:19.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b425b439-f298-4423-9d53-c9c6bee6c54e resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30672024-10-04T22:18:19.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b425b439-f298-4423-9d53-c9c6bee6c54e response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30682024-10-04T22:18:20.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f06b99bd-fe1b-46bb-ba71-238f86a7f1af roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30692024-10-04T22:18:20.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f06b99bd-fe1b-46bb-ba71-238f86a7f1af resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30702024-10-04T22:18:20.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f06b99bd-fe1b-46bb-ba71-238f86a7f1af response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30712024-10-04T22:18:20.984ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 79ce0308-e6d8-4fe3-b036-4d7d789308c6 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
30722024-10-04T22:18:21.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41ccb222-b374-44dc-8333-bc1f1987dc80 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30732024-10-04T22:18:21.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41ccb222-b374-44dc-8333-bc1f1987dc80 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30742024-10-04T22:18:21.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41ccb222-b374-44dc-8333-bc1f1987dc80 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30752024-10-04T22:18:22.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5158c003-6839-4254-a161-5adefaa46282 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30762024-10-04T22:18:22.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5158c003-6839-4254-a161-5adefaa46282 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30772024-10-04T22:18:22.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5158c003-6839-4254-a161-5adefaa46282 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30782024-10-04T22:18:23.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 65871472-65ee-4c95-8bf3-a7512b935205 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30792024-10-04T22:18:23.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 65871472-65ee-4c95-8bf3-a7512b935205 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30802024-10-04T22:18:23.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 65871472-65ee-4c95-8bf3-a7512b935205 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
30812024-10-04T22:18:24.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
30822024-10-04T22:18:24.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30832024-10-04T22:18:24.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
30842024-10-04T22:18:24.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30852024-10-04T22:18:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30862024-10-04T22:18:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30872024-10-04T22:18:24.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30882024-10-04T22:18:24.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30892024-10-04T22:18:24.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30902024-10-04T22:18:24.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30912024-10-04T22:18:24.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30922024-10-04T22:18:24.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30932024-10-04T22:18:24.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30942024-10-04T22:18:24.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
30952024-10-04T22:18:24.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30962024-10-04T22:18:24.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30972024-10-04T22:18:24.599ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
30982024-10-04T22:18:24.599ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.173083ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
30992024-10-04T22:18:24.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31002024-10-04T22:18:24.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31012024-10-04T22:18:24.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.458258ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31022024-10-04T22:18:24.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ae0992d2-8375-437e-9539-fa8b60222ff2 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31032024-10-04T22:18:24.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ae0992d2-8375-437e-9539-fa8b60222ff2 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31042024-10-04T22:18:24.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2000 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ae0992d2-8375-437e-9539-fa8b60222ff2 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31052024-10-04T22:18:25.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9cec2d19-fc6b-48d3-8f89-5a77fcfab974 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31062024-10-04T22:18:25.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9cec2d19-fc6b-48d3-8f89-5a77fcfab974 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31072024-10-04T22:18:25.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9cec2d19-fc6b-48d3-8f89-5a77fcfab974 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31082024-10-04T22:18:26.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f94e55eb-850a-4201-98ba-aed9e5bf1e70 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31092024-10-04T22:18:26.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f94e55eb-850a-4201-98ba-aed9e5bf1e70 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31102024-10-04T22:18:26.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f94e55eb-850a-4201-98ba-aed9e5bf1e70 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31112024-10-04T22:18:27.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d5b9cd6c-1d18-4392-8a20-937b5b20af75 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31122024-10-04T22:18:27.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d5b9cd6c-1d18-4392-8a20-937b5b20af75 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31132024-10-04T22:18:27.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d5b9cd6c-1d18-4392-8a20-937b5b20af75 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31142024-10-04T22:18:28.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b859b34a-ca96-4faf-9495-6d46a9c0ee8d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31152024-10-04T22:18:28.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b859b34a-ca96-4faf-9495-6d46a9c0ee8d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31162024-10-04T22:18:28.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b859b34a-ca96-4faf-9495-6d46a9c0ee8d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31172024-10-04T22:18:29.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 68764aa0-6a92-4fbd-bc02-4eab8d647cfa roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31182024-10-04T22:18:29.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 68764aa0-6a92-4fbd-bc02-4eab8d647cfa resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31192024-10-04T22:18:29.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 68764aa0-6a92-4fbd-bc02-4eab8d647cfa response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31202024-10-04T22:18:30.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1376 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 3234d6d8-ec84-42d8-b8db-6277b20f9d10 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
31212024-10-04T22:18:30.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 62c73120-9a2a-4b1c-a998-1c53a2f565c9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31222024-10-04T22:18:30.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 62c73120-9a2a-4b1c-a998-1c53a2f565c9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31232024-10-04T22:18:30.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 62c73120-9a2a-4b1c-a998-1c53a2f565c9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31242024-10-04T22:18:31.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 2b677a12-d629-4ef0-a3e1-2c0cf1a7de37 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
31252024-10-04T22:18:31.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 2b677a12-d629-4ef0-a3e1-2c0cf1a7de37 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
31262024-10-04T22:18:31.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 2b677a12-d629-4ef0-a3e1-2c0cf1a7de37 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
31272024-10-04T22:18:31.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 238286dd-90a6-477c-bc1e-59a6da5d0a71 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
31282024-10-04T22:18:31.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 238286dd-90a6-477c-bc1e-59a6da5d0a71 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
31292024-10-04T22:18:31.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 238286dd-90a6-477c-bc1e-59a6da5d0a71 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
31302024-10-04T22:18:32.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 12f0f64c-4a2e-4bb3-aee9-408deadd4e65 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31312024-10-04T22:18:32.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 12f0f64c-4a2e-4bb3-aee9-408deadd4e65 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31322024-10-04T22:18:32.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2280 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 12f0f64c-4a2e-4bb3-aee9-408deadd4e65 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31332024-10-04T22:18:33.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a39d1fcd-fd3f-4182-8975-8fd1e7fc80ec roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31342024-10-04T22:18:33.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a39d1fcd-fd3f-4182-8975-8fd1e7fc80ec resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31352024-10-04T22:18:33.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a39d1fcd-fd3f-4182-8975-8fd1e7fc80ec response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31362024-10-04T22:18:34.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b77e53a3-02ee-4d94-8573-83cdf4156904 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31372024-10-04T22:18:34.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b77e53a3-02ee-4d94-8573-83cdf4156904 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31382024-10-04T22:18:34.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b77e53a3-02ee-4d94-8573-83cdf4156904 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
31392024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
31402024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31412024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
31422024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
31432024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 19.731\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
31442024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
31452024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 14.95\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31462024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
31472024-10-04T22:18:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
31482024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31492024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.41\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
31502024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31512024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31522024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
31532024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.711\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31542024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
31552024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
31562024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31572024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31582024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
31592024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
31602024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31612024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31622024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
31632024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
31642024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
31652024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
31662024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31672024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
31682024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31692024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31702024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31712024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
31722024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31732024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31742024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31752024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31762024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31772024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31782024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31792024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31802024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31812024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31822024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31832024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31842024-10-04T22:18:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31852024-10-04T22:18:34.585ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1112, tv_nsec: 887595683 } })
31862024-10-04T22:18:34.586ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.186454ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31872024-10-04T22:18:34.586ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
31882024-10-04T22:18:34.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1112, tv_nsec: 889433710 } })
31892024-10-04T22:18:34.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31902024-10-04T22:18:34.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
31912024-10-04T22:18:34.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31922024-10-04T22:18:34.589ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31932024-10-04T22:18:34.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31942024-10-04T22:18:34.590ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31952024-10-04T22:18:34.590ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31962024-10-04T22:18:34.590ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31972024-10-04T22:18:34.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31982024-10-04T22:18:34.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31992024-10-04T22:18:34.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32002024-10-04T22:18:34.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32012024-10-04T22:18:34.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32022024-10-04T22:18:34.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32032024-10-04T22:18:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32042024-10-04T22:18:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32052024-10-04T22:18:34.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32062024-10-04T22:18:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32072024-10-04T22:18:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32082024-10-04T22:18:34.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32092024-10-04T22:18:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32102024-10-04T22:18:34.595ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32112024-10-04T22:18:34.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32122024-10-04T22:18:34.596ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32132024-10-04T22:18:34.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32142024-10-04T22:18:34.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32152024-10-04T22:18:34.598ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32162024-10-04T22:18:34.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32172024-10-04T22:18:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32182024-10-04T22:18:34.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32192024-10-04T22:18:34.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32202024-10-04T22:18:34.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32212024-10-04T22:18:34.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32222024-10-04T22:18:34.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32232024-10-04T22:18:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32242024-10-04T22:18:34.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32252024-10-04T22:18:34.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32262024-10-04T22:18:34.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32272024-10-04T22:18:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32282024-10-04T22:18:34.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1112, tv_nsec: 907830287 } })
32292024-10-04T22:18:34.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
32302024-10-04T22:18:34.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32312024-10-04T22:18:34.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32322024-10-04T22:18:34.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32332024-10-04T22:18:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32342024-10-04T22:18:34.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32352024-10-04T22:18:34.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32362024-10-04T22:18:34.630ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32372024-10-04T22:18:34.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32382024-10-04T22:18:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32392024-10-04T22:18:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32402024-10-04T22:18:34.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32412024-10-04T22:18:34.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32422024-10-04T22:18:34.635ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32432024-10-04T22:18:34.635ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32442024-10-04T22:18:34.635ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32452024-10-04T22:18:34.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32462024-10-04T22:18:34.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.517149ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32472024-10-04T22:18:34.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32482024-10-04T22:18:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
32492024-10-04T22:18:34.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32502024-10-04T22:18:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32512024-10-04T22:18:34.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.947597ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32522024-10-04T22:18:34.678ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
32532024-10-04T22:18:34.679ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32542024-10-04T22:18:34.680ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afb04ed6-795f-44a2-9eb0-61614926a082", "content-length": "26", "date": "Fri, 04 Oct 2024 22:18:33 GMT"} })
32552024-10-04T22:18:34.680ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32562024-10-04T22:18:34.682ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32572024-10-04T22:18:34.705ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
32582024-10-04T22:18:34.705ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32592024-10-04T22:18:34.706ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b8283ff-b163-4e45-9882-9a65ebe40535", "content-length": "26", "date": "Fri, 04 Oct 2024 22:18:33 GMT"} })
32602024-10-04T22:18:34.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32612024-10-04T22:18:34.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32622024-10-04T22:18:34.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32632024-10-04T22:18:34.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32642024-10-04T22:18:34.716ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588/state
32652024-10-04T22:18:34.717ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32662024-10-04T22:18:34.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
32672024-10-04T22:18:34.720ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32682024-10-04T22:18:34.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32692024-10-04T22:18:34.724ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.264212ms iteration = 13 status = {"physical_disks_added":0}
32702024-10-04T22:18:34.726ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
32712024-10-04T22:18:34.726ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32722024-10-04T22:18:34.727ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "201afc80-f2a0-4aa9-a7e0-59343a30d250", "content-length": "26", "date": "Fri, 04 Oct 2024 22:18:33 GMT"} })
32732024-10-04T22:18:34.727ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32742024-10-04T22:18:34.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
32752024-10-04T22:18:34.780ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32762024-10-04T22:18:34.781ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca0f46d2-2650-40ec-828e-49637ac5deb9", "content-length": "585", "date": "Fri, 04 Oct 2024 22:18:34 GMT"} })
32772024-10-04T22:18:34.781ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32782024-10-04T22:18:34.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32792024-10-04T22:18:34.782ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 201.415373ms iteration = 10 status = {}
32802024-10-04T22:18:34.784ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 203.158488ms iteration = 10 status = 0
32812024-10-04T22:18:34.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32822024-10-04T22:18:34.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32832024-10-04T22:18:34.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32842024-10-04T22:18:34.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32852024-10-04T22:18:34.789ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
32862024-10-04T22:18:34.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 208.051146ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
32872024-10-04T22:18:34.791ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32882024-10-04T22:18:34.791ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "045e43f8-6ec3-40d1-8d6b-c3e4e1fd6240", "content-length": "1", "date": "Fri, 04 Oct 2024 22:18:33 GMT"} })
32892024-10-04T22:18:34.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32902024-10-04T22:18:34.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32912024-10-04T22:18:34.792ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32922024-10-04T22:18:34.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32932024-10-04T22:18:34.793ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 212.671688ms iteration = 10 status = null
32942024-10-04T22:18:34.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32952024-10-04T22:18:34.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32962024-10-04T22:18:34.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32972024-10-04T22:18:34.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32982024-10-04T22:18:34.802ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32992024-10-04T22:18:34.802ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "109db59a-8014-4a9e-bbb5-93731a23a18c", "date": "Fri, 04 Oct 2024 22:18:34 GMT"} })
33002024-10-04T22:18:34.803ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 222.716439ms iteration = 11 status = {}
33012024-10-04T22:18:34.815ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33022024-10-04T22:18:34.815ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33032024-10-04T22:18:34.815ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 234.364382ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33042024-10-04T22:18:34.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33052024-10-04T22:18:34.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33062024-10-04T22:18:34.860ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
33072024-10-04T22:18:34.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33082024-10-04T22:18:34.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33092024-10-04T22:18:34.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33102024-10-04T22:18:34.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33112024-10-04T22:18:34.867ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33122024-10-04T22:18:34.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33132024-10-04T22:18:34.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33142024-10-04T22:18:34.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33152024-10-04T22:18:34.870ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33162024-10-04T22:18:34.870ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "894b9c01-7bc3-4e53-9e44-0b57153d0ce2", "content-length": "121", "date": "Fri, 04 Oct 2024 22:18:33 GMT"} })
33172024-10-04T22:18:34.870ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
33182024-10-04T22:18:34.870ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
33192024-10-04T22:18:34.870ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33202024-10-04T22:18:34.870ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33212024-10-04T22:18:34.870ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
33222024-10-04T22:18:34.870ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
33232024-10-04T22:18:34.870ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
33242024-10-04T22:18:34.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33252024-10-04T22:18:34.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33262024-10-04T22:18:34.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33272024-10-04T22:18:34.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33282024-10-04T22:18:34.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "162cf89e-144f-4db1-8ab2-074006f6c519", "content-length": "2", "date": "Fri, 04 Oct 2024 22:18:33 GMT"} })
33292024-10-04T22:18:34.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33302024-10-04T22:18:34.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33312024-10-04T22:18:34.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33322024-10-04T22:18:34.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2138e8b7-ede7-499a-98be-e67dd5870424", "content-length": "52", "date": "Fri, 04 Oct 2024 22:18:33 GMT"} })
33332024-10-04T22:18:34.872ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
33342024-10-04T22:18:34.872ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33352024-10-04T22:18:34.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33362024-10-04T22:18:34.954ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33372024-10-04T22:18:34.965ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d2bad2a9-618e-4030-9ab1-da72c5ef1c11", "date": "Fri, 04 Oct 2024 22:18:34 GMT"} })
33382024-10-04T22:18:34.965ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
33392024-10-04T22:18:34.965ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33402024-10-04T22:18:34.966ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "11f0f4e7-8182-43b3-9d21-9641a442721d", "content-length": "667", "date": "Fri, 04 Oct 2024 22:18:34 GMT"} })
33412024-10-04T22:18:34.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33422024-10-04T22:18:34.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33432024-10-04T22:18:34.966ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b12c57c0-66c9-4c13-b4c3-f2867a572faa", "content-length": "811", "date": "Fri, 04 Oct 2024 22:18:34 GMT"} })
33442024-10-04T22:18:34.966ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(11189461) }} sled = sock
33452024-10-04T22:18:34.966ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
33462024-10-04T22:18:34.966ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
33472024-10-04T22:18:34.968ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 387.864788ms iteration = 10 status = {}
33482024-10-04T22:18:34.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33492024-10-04T22:18:34.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33502024-10-04T22:18:34.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33512024-10-04T22:18:34.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33522024-10-04T22:18:34.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33532024-10-04T22:18:34.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33542024-10-04T22:18:34.982ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 401.207015ms iteration = 10 status = {}
33552024-10-04T22:18:35.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3c6d5b7f-3857-4199-97c2-887279173900 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33562024-10-04T22:18:35.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3c6d5b7f-3857-4199-97c2-887279173900 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33572024-10-04T22:18:35.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3c6d5b7f-3857-4199-97c2-887279173900 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33582024-10-04T22:18:36.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c9e48bce-2657-480e-bc8e-ea246e9621b7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33592024-10-04T22:18:36.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c9e48bce-2657-480e-bc8e-ea246e9621b7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33602024-10-04T22:18:36.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c9e48bce-2657-480e-bc8e-ea246e9621b7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33612024-10-04T22:18:37.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3bc861f-333f-4b67-9090-b6f96a3f81ed roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33622024-10-04T22:18:37.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3bc861f-333f-4b67-9090-b6f96a3f81ed resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33632024-10-04T22:18:37.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3bc861f-333f-4b67-9090-b6f96a3f81ed response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33642024-10-04T22:18:38.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 54996e86-505b-42ed-8502-be61c71b5a06 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33652024-10-04T22:18:38.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 54996e86-505b-42ed-8502-be61c71b5a06 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33662024-10-04T22:18:38.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2525 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 54996e86-505b-42ed-8502-be61c71b5a06 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33672024-10-04T22:18:38.438ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c333f75-f39e-4810-8e1e-52b48b1c44b7", "content-length": "131", "date": "Fri, 04 Oct 2024 22:18:38 GMT"} })
33682024-10-04T22:18:38.439ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 sled_id = 544b0af3-4a18-4467-8697-af690997796e state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-04T22:18:30.692471595Z }, migration_in: None, migration_out: None } vmm_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588
33692024-10-04T22:18:38.439ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2137 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 sled_id = 544b0af3-4a18-4467-8697-af690997796e vmm_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-04T22:18:30.692471595Z }
33702024-10-04T22:18:38.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 roles = RoleSet { roles: {} } sled_id = 544b0af3-4a18-4467-8697-af690997796e vmm_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588
33712024-10-04T22:18:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 resource = Database result = Ok(()) sled_id = 544b0af3-4a18-4467-8697-af690997796e vmm_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588
33722024-10-04T22:18:38.446ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2137 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f41ba0b0-4c14-46b1-b1c8-e46f9031b1e3 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-10-04T22:18:38.443433381Z }
33732024-10-04T22:18:38.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f41ba0b0-4c14-46b1-b1c8-e46f9031b1e3 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
33742024-10-04T22:18:38.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f41ba0b0-4c14-46b1-b1c8-e46f9031b1e3 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
33752024-10-04T22:18:38.450ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
33762024-10-04T22:18:38.451ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 3.870526374s iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
33772024-10-04T22:18:38.477ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:64010
33782024-10-04T22:18:38.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64010 req_id = 5a850d7d-56c7-43c4-9107-41b2cd35394f roles = RoleSet { roles: {} } uri = /metrics/producers
33792024-10-04T22:18:38.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64010 req_id = 5a850d7d-56c7-43c4-9107-41b2cd35394f resource = Database result = Ok(()) uri = /metrics/producers
33802024-10-04T22:18:38.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36989 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f41ba0b0-4c14-46b1-b1c8-e46f9031b1e3 response_code = 204 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
33812024-10-04T22:18:38.481ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2137 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 455d35c7-d09a-4d2d-8551-3f37016dceab uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-04T22:18:38.480912180Z }
33822024-10-04T22:18:38.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 455d35c7-d09a-4d2d-8551-3f37016dceab roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
33832024-10-04T22:18:38.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 455d35c7-d09a-4d2d-8551-3f37016dceab resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
33842024-10-04T22:18:38.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8438 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 455d35c7-d09a-4d2d-8551-3f37016dceab response_code = 204 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
33852024-10-04T22:18:38.510ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
33862024-10-04T22:18:38.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64010 req_id = 5a850d7d-56c7-43c4-9107-41b2cd35394f roles = RoleSet { roles: {} } uri = /metrics/producers
33872024-10-04T22:18:38.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64010 req_id = 5a850d7d-56c7-43c4-9107-41b2cd35394f resource = Database result = Ok(()) uri = /metrics/producers
33882024-10-04T22:18:38.541ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
33892024-10-04T22:18:38.541ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "7c61e320-bda2-4cbc-b680-e67b583532c9", "date": "Fri, 04 Oct 2024 22:18:38 GMT"} })
33902024-10-04T22:18:38.541ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 0d966f86-2001-459d-9023-a8291a8f49d9
33912024-10-04T22:18:38.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66118 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:64010 req_id = 5a850d7d-56c7-43c4-9107-41b2cd35394f response_code = 201 uri = /metrics/producers
33922024-10-04T22:18:39.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 462e0634-903d-4cbb-9b1d-ae3521c920e3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33932024-10-04T22:18:39.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 462e0634-903d-4cbb-9b1d-ae3521c920e3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33942024-10-04T22:18:39.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 462e0634-903d-4cbb-9b1d-ae3521c920e3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33952024-10-04T22:18:40.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66ad5768-c541-485f-9443-2b3d438dc867 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33962024-10-04T22:18:40.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66ad5768-c541-485f-9443-2b3d438dc867 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33972024-10-04T22:18:40.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66ad5768-c541-485f-9443-2b3d438dc867 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
33982024-10-04T22:18:40.987ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6235 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = e12e84a7-e022-477b-bcca-f25c11ccf55b response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
33992024-10-04T22:18:41.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e88564a8-6253-4711-a0b2-20474070c32d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34002024-10-04T22:18:41.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e88564a8-6253-4711-a0b2-20474070c32d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34012024-10-04T22:18:41.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e88564a8-6253-4711-a0b2-20474070c32d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34022024-10-04T22:18:42.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f843962b-a550-4209-88fd-2f6f504a06c5 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34032024-10-04T22:18:42.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f843962b-a550-4209-88fd-2f6f504a06c5 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34042024-10-04T22:18:42.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f843962b-a550-4209-88fd-2f6f504a06c5 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34052024-10-04T22:18:43.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a4238672-5179-4883-8e9a-e22ee8f3d115 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34062024-10-04T22:18:43.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a4238672-5179-4883-8e9a-e22ee8f3d115 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34072024-10-04T22:18:43.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a4238672-5179-4883-8e9a-e22ee8f3d115 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34082024-10-04T22:18:44.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5d66d9d3-90b0-44e5-9a2e-86ad8cc15116 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34092024-10-04T22:18:44.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5d66d9d3-90b0-44e5-9a2e-86ad8cc15116 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34102024-10-04T22:18:44.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5d66d9d3-90b0-44e5-9a2e-86ad8cc15116 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34112024-10-04T22:18:44.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
34122024-10-04T22:18:44.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34132024-10-04T22:18:44.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
34142024-10-04T22:18:44.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34152024-10-04T22:18:44.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34162024-10-04T22:18:44.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34172024-10-04T22:18:44.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34182024-10-04T22:18:44.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34192024-10-04T22:18:44.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202024-10-04T22:18:44.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.362097ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34212024-10-04T22:18:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34222024-10-04T22:18:44.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34232024-10-04T22:18:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34242024-10-04T22:18:44.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34252024-10-04T22:18:44.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34262024-10-04T22:18:44.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34272024-10-04T22:18:44.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
34282024-10-04T22:18:44.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34292024-10-04T22:18:44.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34302024-10-04T22:18:44.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
34312024-10-04T22:18:44.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.264134ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
34322024-10-04T22:18:45.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cf7d0042-1813-4133-bf06-6e78b75a2e8c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34332024-10-04T22:18:45.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cf7d0042-1813-4133-bf06-6e78b75a2e8c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34342024-10-04T22:18:45.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cf7d0042-1813-4133-bf06-6e78b75a2e8c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34352024-10-04T22:18:46.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a949ae45-d073-416f-af28-06c6ed319167 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34362024-10-04T22:18:46.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a949ae45-d073-416f-af28-06c6ed319167 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34372024-10-04T22:18:46.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a949ae45-d073-416f-af28-06c6ed319167 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34382024-10-04T22:18:47.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 223fa819-6948-4d47-87a5-31f6df67915f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34392024-10-04T22:18:47.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 223fa819-6948-4d47-87a5-31f6df67915f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34402024-10-04T22:18:47.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 223fa819-6948-4d47-87a5-31f6df67915f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34412024-10-04T22:18:48.360ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2137 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 56529aad-3d29-4b3b-ad7a-208f0f4a1403 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-10-04T22:18:48.359931923Z }
34422024-10-04T22:18:48.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 56529aad-3d29-4b3b-ad7a-208f0f4a1403 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34432024-10-04T22:18:48.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 56529aad-3d29-4b3b-ad7a-208f0f4a1403 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34442024-10-04T22:18:48.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11004 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 56529aad-3d29-4b3b-ad7a-208f0f4a1403 response_code = 204 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34452024-10-04T22:18:48.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cfc80364-8154-409d-9fe6-11ce0d135b44 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34462024-10-04T22:18:48.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cfc80364-8154-409d-9fe6-11ce0d135b44 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34472024-10-04T22:18:48.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cfc80364-8154-409d-9fe6-11ce0d135b44 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34482024-10-04T22:18:49.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 12b5db99-da76-4362-9b0d-e37ed52e4fce roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34492024-10-04T22:18:49.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 12b5db99-da76-4362-9b0d-e37ed52e4fce resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34502024-10-04T22:18:49.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 12b5db99-da76-4362-9b0d-e37ed52e4fce response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34512024-10-04T22:18:49.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = d52a13f6-0ed8-4278-934d-6fd6d81e5b2f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
34522024-10-04T22:18:49.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = d52a13f6-0ed8-4278-934d-6fd6d81e5b2f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
34532024-10-04T22:18:49.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = d52a13f6-0ed8-4278-934d-6fd6d81e5b2f response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
34542024-10-04T22:18:49.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = b5b98a5d-74f3-4da7-9c0f-ed1a5aa32ca5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
34552024-10-04T22:18:49.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = b5b98a5d-74f3-4da7-9c0f-ed1a5aa32ca5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
34562024-10-04T22:18:49.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = b5b98a5d-74f3-4da7-9c0f-ed1a5aa32ca5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
34572024-10-04T22:18:50.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3f73a79-57c0-4fbd-a0f6-d7200de0f2fa roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34582024-10-04T22:18:50.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3f73a79-57c0-4fbd-a0f6-d7200de0f2fa resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34592024-10-04T22:18:50.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3f73a79-57c0-4fbd-a0f6-d7200de0f2fa response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
34602024-10-04T22:18:50.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = b2a6a4f3-1a68-4776-92ab-aca5aa40cbaf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
34612024-10-04T22:18:50.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = b2a6a4f3-1a68-4776-92ab-aca5aa40cbaf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
34622024-10-04T22:18:50.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = b2a6a4f3-1a68-4776-92ab-aca5aa40cbaf response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
34632024-10-04T22:18:50.756ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2137 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-04T22:18:50.756048085Z }
34642024-10-04T22:18:50.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34652024-10-04T22:18:50.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34662024-10-04T22:18:50.790ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588 vmm_needs_update = true
34672024-10-04T22:18:50.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34682024-10-04T22:18:50.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34692024-10-04T22:18:50.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34702024-10-04T22:18:50.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34712024-10-04T22:18:50.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34722024-10-04T22:18:50.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34732024-10-04T22:18:50.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34742024-10-04T22:18:50.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34752024-10-04T22:18:50.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34762024-10-04T22:18:50.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34772024-10-04T22:18:50.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34782024-10-04T22:18:50.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34792024-10-04T22:18:50.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34802024-10-04T22:18:50.806ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5782a804-afa1-460e-b170-bf8495d7f170, lookup_type: ById(5782a804-afa1-460e-b170-bf8495d7f170) }, key: a2a6f842-3219-4148-9113-865ec5e05329, lookup_type: ById(a2a6f842-3219-4148-9113-865ec5e05329) }, key: 0d966f86-2001-459d-9023-a8291a8f49d9, lookup_type: ById(0d966f86-2001-459d-9023-a8291a8f49d9) } result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34812024-10-04T22:18:50.806ZINFOnexus (dropshot_internal): starting update saga for 0d966f86-2001-459d-9023-a8291a8f49d9 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1612 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-04T22:18:50.756048085Z }
34822024-10-04T22:18:50.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50463 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 response_code = 204 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34832024-10-04T22:18:50.806ZDEBGnexus (dropshot_internal): preparing instance-update saga for 0d966f86-2001-459d-9023-a8291a8f49d9... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 41cbbcf8-d3f8-4807-af83-3bdc6846fdc4 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34842024-10-04T22:18:50.807ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2137 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 770a0c1a-ff75-41a6-9a08-ad2f50f5a2c8 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-04T22:18:50.756048085Z }
34852024-10-04T22:18:50.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 770a0c1a-ff75-41a6-9a08-ad2f50f5a2c8 roles = RoleSet { roles: {} } uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34862024-10-04T22:18:50.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 770a0c1a-ff75-41a6-9a08-ad2f50f5a2c8 resource = Database result = Ok(()) uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34872024-10-04T22:18:50.809ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update
34882024-10-04T22:18:50.809ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"0d966f86-2001-459d-9023-a8291a8f49d9","lookup_type":{"ById":"0d966f86-2001-459d-9023-a8291a8f49d9"},"parent":{"key":"a2a6f842-3219-4148-9113-865ec5e05329","lookup_type":{"ById":"a2a6f842-3219-4148-9113-865ec5e05329"},"parent":{"key":"5782a804-afa1-460e-b170-bf8495d7f170","lookup_type":{"ById":"5782a804-afa1-460e-b170-bf8495d7f170"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update sec_id = 46d21628-a828-4b09-b280-d1af35f56206
34892024-10-04T22:18:50.809ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update
34902024-10-04T22:18:50.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3050 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 770a0c1a-ff75-41a6-9a08-ad2f50f5a2c8 response_code = 204 uri = /vmms/2cc38d1a-5eae-4208-baf7-b332dc17e588
34912024-10-04T22:18:50.835ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update
34922024-10-04T22:18:50.835ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update sec_id = 46d21628-a828-4b09-b280-d1af35f56206
34932024-10-04T22:18:50.835ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
34942024-10-04T22:18:50.835ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
34952024-10-04T22:18:50.839ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
34962024-10-04T22:18:50.839ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
34972024-10-04T22:18:50.842ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
34982024-10-04T22:18:50.842ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
34992024-10-04T22:18:50.845ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35002024-10-04T22:18:50.845ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("413091e6-89f7-4bd7-b461-1265aed49f77")) node_id = 0 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
35012024-10-04T22:18:50.848ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35022024-10-04T22:18:50.848ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
35032024-10-04T22:18:50.853ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update
35042024-10-04T22:18:50.853ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35052024-10-04T22:18:50.854ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35062024-10-04T22:18:50.855ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35072024-10-04T22:18:50.855ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35082024-10-04T22:18:50.857ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35092024-10-04T22:18:50.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35102024-10-04T22:18:50.859ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35112024-10-04T22:18:50.859ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35122024-10-04T22:18:50.860ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35132024-10-04T22:18:50.860ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35142024-10-04T22:18:50.861ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35152024-10-04T22:18:50.862ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35162024-10-04T22:18:50.863ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35172024-10-04T22:18:50.865ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5782a804-afa1-460e-b170-bf8495d7f170, lookup_type: ById(5782a804-afa1-460e-b170-bf8495d7f170) }, key: a2a6f842-3219-4148-9113-865ec5e05329, lookup_type: ById(a2a6f842-3219-4148-9113-865ec5e05329) }, key: 0d966f86-2001-459d-9023-a8291a8f49d9, lookup_type: ById(0d966f86-2001-459d-9023-a8291a8f49d9) } result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35182024-10-04T22:18:50.865ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance updater_id = 413091e6-89f7-4bd7-b461-1265aed49f77
35192024-10-04T22:18:50.865ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35202024-10-04T22:18:50.866ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35212024-10-04T22:18:50.873ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance updater_id = 413091e6-89f7-4bd7-b461-1265aed49f77
35222024-10-04T22:18:50.873ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35232024-10-04T22:18:50.874ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance
35242024-10-04T22:18:50.878ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 locked_gen = Generation(Generation(2)) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = LockInstance updater_id = 413091e6-89f7-4bd7-b461-1265aed49f77
35252024-10-04T22:18:50.878ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35262024-10-04T22:18:50.878ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("413091e6-89f7-4bd7-b461-1265aed49f77")}) node_id = 1 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
35272024-10-04T22:18:50.881ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35282024-10-04T22:18:50.881ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
35292024-10-04T22:18:50.892ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35302024-10-04T22:18:50.892ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35312024-10-04T22:18:50.894ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35322024-10-04T22:18:50.894ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35332024-10-04T22:18:50.895ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35342024-10-04T22:18:50.895ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35352024-10-04T22:18:50.896ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35362024-10-04T22:18:50.899ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5782a804-afa1-460e-b170-bf8495d7f170, lookup_type: ById(5782a804-afa1-460e-b170-bf8495d7f170) }, key: a2a6f842-3219-4148-9113-865ec5e05329, lookup_type: ById(a2a6f842-3219-4148-9113-865ec5e05329) }, key: 0d966f86-2001-459d-9023-a8291a8f49d9, lookup_type: ById(0d966f86-2001-459d-9023-a8291a8f49d9) } result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35372024-10-04T22:18:50.899ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35382024-10-04T22:18:50.899ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
35392024-10-04T22:18:50.905ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 2cc38d1a-5eae-4208-baf7-b332dc17e588, time_created: 2024-10-04T22:18:30.202364Z, time_deleted: None, instance_id: 0d966f86-2001-459d-9023-a8291a8f49d9, sled_id: 544b0af3-4a18-4467-8697-af690997796e, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-10-04T22:18:50.756048Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-10-04T22:18:27.529410Z, gen: Generation(Generation(3)), propolis_id: Some(2cc38d1a-5eae-4208-baf7-b332dc17e588), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(2cc38d1a-5eae-4208-baf7-b332dc17e588 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-10-04T22:18:50.905790046Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
35402024-10-04T22:18:50.905ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
35412024-10-04T22:18:50.905ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"0d966f86-2001-459d-9023-a8291a8f49d9","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"2cc38d1a-5eae-4208-baf7-b332dc17e588"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"0d966f86-2001-459d-9023-a8291a8f49d9","lookup_type":{"ById":"0d966f86-2001-459d-9023-a8291a8f49d9"},"parent":{"key":"a2a6f842-3219-4148-9113-865ec5e05329","lookup_type":{"ById":"a2a6f842-3219-4148-9113-865ec5e05329"},"parent":{"key":"5782a804-afa1-460e-b170-bf8495d7f170","lookup_type":{"ById":"5782a804-afa1-460e-b170-bf8495d7f170"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"413091e6-89f7-4bd7-b461-1265aed49f77"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"a2a6f842-3219-4148-9113-865ec5e05329","ram_diff":1073741824},"destroy_active_vmm":"2cc38d1a-5eae-4208-baf7-b332dc17e588","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-10-04T22:18:50.905790046Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35422024-10-04T22:18:50.905ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
35432024-10-04T22:18:50.911ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
35442024-10-04T22:18:50.911ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35452024-10-04T22:18:50.911ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35462024-10-04T22:18:50.911ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35472024-10-04T22:18:50.914ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35482024-10-04T22:18:50.914ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35492024-10-04T22:18:50.917ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35502024-10-04T22:18:50.917ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35512024-10-04T22:18:50.920ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35522024-10-04T22:18:50.920ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("1207b0ff-75fc-43d2-bf2f-06753a08f2db")) node_id = 0 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35532024-10-04T22:18:50.923ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35542024-10-04T22:18:50.923ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35552024-10-04T22:18:50.930ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 parent_lock = UpdaterLock { updater_id: 413091e6-89f7-4bd7-b461-1265aed49f77, locked_gen: Generation(Generation(2)) } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
35562024-10-04T22:18:50.930ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = BecomeUpdater
35572024-10-04T22:18:50.931ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = BecomeUpdater
35582024-10-04T22:18:50.941ZDEBGnexus (SagaExecutor): inherited lock from 413091e6-89f7-4bd7-b461-1265aed49f77 to 1207b0ff-75fc-43d2-bf2f-06753a08f2db actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 413091e6-89f7-4bd7-b461-1265aed49f77 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = BecomeUpdater updater_id = 1207b0ff-75fc-43d2-bf2f-06753a08f2db
35592024-10-04T22:18:50.941ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
35602024-10-04T22:18:50.941ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35612024-10-04T22:18:50.941ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("1207b0ff-75fc-43d2-bf2f-06753a08f2db")}) node_id = 1 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35622024-10-04T22:18:50.946ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35632024-10-04T22:18:50.946ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35642024-10-04T22:18:50.949ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35652024-10-04T22:18:50.949ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35662024-10-04T22:18:50.952ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35672024-10-04T22:18:50.952ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35682024-10-04T22:18:50.958ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
35692024-10-04T22:18:50.960ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9
35702024-10-04T22:18:50.960ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UpdateNetworkConfig
35712024-10-04T22:18:50.961ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UpdateNetworkConfig
35722024-10-04T22:18:50.964ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UpdateNetworkConfig
35732024-10-04T22:18:50.964ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UpdateNetworkConfig
35742024-10-04T22:18:50.966ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
35752024-10-04T22:18:50.966ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UpdateNetworkConfig
35762024-10-04T22:18:50.966ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UpdateNetworkConfig
35772024-10-04T22:18:50.968ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
35782024-10-04T22:18:50.968ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
35792024-10-04T22:18:50.968ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
35802024-10-04T22:18:50.970ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
35812024-10-04T22:18:50.971ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
35822024-10-04T22:18:50.971ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
35832024-10-04T22:18:50.971ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
35842024-10-04T22:18:50.975ZDEBGnexus: notifying dendrite of updates instance_id = Some(0d966f86-2001-459d-9023-a8291a8f49d9 (instance)) switch = switch0
35852024-10-04T22:18:50.976ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1129, tv_nsec: 278212046 } })
35862024-10-04T22:18:50.976ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1051
35872024-10-04T22:18:51.006ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
35882024-10-04T22:18:51.006ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35892024-10-04T22:18:51.007ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d64f2c9-b5c3-40fe-b0f6-dce863288c60", "content-length": "26", "date": "Fri, 04 Oct 2024 22:18:51 GMT"} })
35902024-10-04T22:18:51.007ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35912024-10-04T22:18:51.008ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35922024-10-04T22:18:51.008ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = bf5e4276-b32b-4e9c-b774-71a65620ae4e response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
35932024-10-04T22:18:51.037ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
35942024-10-04T22:18:51.038ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "f02aeffa-b8e6-49e7-bb3a-34366b57f278", "content-length": "4", "date": "Fri, 04 Oct 2024 22:18:50 GMT"} })
35952024-10-04T22:18:51.038ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35962024-10-04T22:18:51.038ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35972024-10-04T22:18:51.041ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
35982024-10-04T22:18:51.041ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
35992024-10-04T22:18:51.046ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ReleaseVirtualProvisioning
36002024-10-04T22:18:51.047ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ReleaseVirtualProvisioning
36012024-10-04T22:18:51.058ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-10-04T22:18:51.049756Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 5782a804-afa1-460e-b170-bf8495d7f170, time_modified: Some(2024-10-04T22:18:51.049756Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: a2a6f842-3219-4148-9113-865ec5e05329, time_modified: Some(2024-10-04T22:18:51.049756Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36022024-10-04T22:18:51.058ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36032024-10-04T22:18:51.058ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36042024-10-04T22:18:51.062ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36052024-10-04T22:18:51.063ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36062024-10-04T22:18:51.067ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36072024-10-04T22:18:51.067ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UnassignOximeterProducer
36082024-10-04T22:18:51.067ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UnassignOximeterProducer
36092024-10-04T22:18:51.071ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf producer_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36102024-10-04T22:18:51.071ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UnassignOximeterProducer
36112024-10-04T22:18:51.071ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = UnassignOximeterProducer
36122024-10-04T22:18:51.104ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36132024-10-04T22:18:51.104ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/0d966f86-2001-459d-9023-a8291a8f49d9
36142024-10-04T22:18:51.107ZDEBGnexus (SagaExecutor): client response oximeter-collector = 0d966f86-2001-459d-9023-a8291a8f49d9 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/0d966f86-2001-459d-9023-a8291a8f49d9", status: 204, headers: {"x-request-id": "95b678a7-484c-4670-b46a-de543de113a2", "date": "Fri, 04 Oct 2024 22:18:51 GMT"} }) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36152024-10-04T22:18:51.107ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf producer_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36162024-10-04T22:18:51.109ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36172024-10-04T22:18:51.109ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36182024-10-04T22:18:51.113ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36192024-10-04T22:18:51.113ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36202024-10-04T22:18:51.117ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 lock = UpdaterLock { updater_id: 1207b0ff-75fc-43d2-bf2f-06753a08f2db, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-10-04T22:18:50.905790046Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36212024-10-04T22:18:51.117ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = CommitInstanceUpdates
36222024-10-04T22:18:51.117ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = CommitInstanceUpdates
36232024-10-04T22:18:51.150ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 new_runtime = InstanceRuntimeState { time_updated: 2024-10-04T22:18:50.905790046Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36242024-10-04T22:18:51.150ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36252024-10-04T22:18:51.150ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36262024-10-04T22:18:51.150ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Signaled
36272024-10-04T22:18:51.150ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Signaled
36282024-10-04T22:18:51.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36292024-10-04T22:18:51.150ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36302024-10-04T22:18:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36312024-10-04T22:18:51.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36322024-10-04T22:18:51.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36332024-10-04T22:18:51.153ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36342024-10-04T22:18:51.153ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36352024-10-04T22:18:51.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36362024-10-04T22:18:51.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36372024-10-04T22:18:51.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36382024-10-04T22:18:51.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36392024-10-04T22:18:51.157ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36402024-10-04T22:18:51.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36412024-10-04T22:18:51.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36422024-10-04T22:18:51.162ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36432024-10-04T22:18:51.162ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("0d966f86-2001-459d-9023-a8291a8f49d9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2cc38d1a-5eae-4208-baf7-b332dc17e588")}) node_id = 7 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36442024-10-04T22:18:51.167ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36452024-10-04T22:18:51.167ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36462024-10-04T22:18:51.171ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36472024-10-04T22:18:51.171ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36482024-10-04T22:18:51.175ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36492024-10-04T22:18:51.175ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36502024-10-04T22:18:51.178ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36512024-10-04T22:18:51.178ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ReleaseSledResources
36522024-10-04T22:18:51.179ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ReleaseSledResources
36532024-10-04T22:18:51.193ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36542024-10-04T22:18:51.194ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "979fab9c-4122-4b6e-8ff3-fb49667046a1", "content-length": "372", "date": "Fri, 04 Oct 2024 22:18:51 GMT"} })
36552024-10-04T22:18:51.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36562024-10-04T22:18:51.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36572024-10-04T22:18:51.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36582024-10-04T22:18:51.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36592024-10-04T22:18:51.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36602024-10-04T22:18:51.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36612024-10-04T22:18:51.201ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36622024-10-04T22:18:51.202ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6f491288-300b-46be-84ac-05aa4936d6f2", "date": "Fri, 04 Oct 2024 22:18:51 GMT"} })
36632024-10-04T22:18:51.203ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 53.439477ms iteration = 12 status = {}
36642024-10-04T22:18:51.204ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36652024-10-04T22:18:51.204ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36662024-10-04T22:18:51.207ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36672024-10-04T22:18:51.207ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36682024-10-04T22:18:51.210ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 propolis_id = 2cc38d1a-5eae-4208-baf7-b332dc17e588 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36692024-10-04T22:18:51.210ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = MarkVmmDeleted
36702024-10-04T22:18:51.211ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = MarkVmmDeleted
36712024-10-04T22:18:51.241ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36722024-10-04T22:18:51.241ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36732024-10-04T22:18:51.245ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36742024-10-04T22:18:51.245ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36752024-10-04T22:18:51.248ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36762024-10-04T22:18:51.248ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36772024-10-04T22:18:51.251ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36782024-10-04T22:18:51.251ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36792024-10-04T22:18:51.255ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36802024-10-04T22:18:51.255ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36812024-10-04T22:18:51.256ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36822024-10-04T22:18:51.256ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36832024-10-04T22:18:51.258ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36842024-10-04T22:18:51.258ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36852024-10-04T22:18:51.259ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36862024-10-04T22:18:51.262ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5782a804-afa1-460e-b170-bf8495d7f170, lookup_type: ById(5782a804-afa1-460e-b170-bf8495d7f170) }, key: a2a6f842-3219-4148-9113-865ec5e05329, lookup_type: ById(a2a6f842-3219-4148-9113-865ec5e05329) }, key: 0d966f86-2001-459d-9023-a8291a8f49d9, lookup_type: ById(0d966f86-2001-459d-9023-a8291a8f49d9) } result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36872024-10-04T22:18:51.262ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36882024-10-04T22:18:51.262ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_node = ChainSuccessorSaga
36892024-10-04T22:18:51.286ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update
36902024-10-04T22:18:51.286ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36912024-10-04T22:18:51.286ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
36922024-10-04T22:18:51.286ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
36932024-10-04T22:18:51.286ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Signaled
36942024-10-04T22:18:51.286ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36952024-10-04T22:18:51.286ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36962024-10-04T22:18:51.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36972024-10-04T22:18:51.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36982024-10-04T22:18:51.288ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36992024-10-04T22:18:51.288ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37002024-10-04T22:18:51.288ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37012024-10-04T22:18:51.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37022024-10-04T22:18:51.290ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37032024-10-04T22:18:51.290ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
37042024-10-04T22:18:51.291ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37052024-10-04T22:18:51.291ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37062024-10-04T22:18:51.291ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37072024-10-04T22:18:51.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37082024-10-04T22:18:51.293ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37092024-10-04T22:18:51.293ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37102024-10-04T22:18:51.293ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 6.824267ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37112024-10-04T22:18:51.293ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37122024-10-04T22:18:51.293ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
37132024-10-04T22:18:51.301ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37142024-10-04T22:18:51.302ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e
37152024-10-04T22:18:51.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37162024-10-04T22:18:51.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37172024-10-04T22:18:51.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37182024-10-04T22:18:51.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37192024-10-04T22:18:51.332ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37202024-10-04T22:18:51.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37212024-10-04T22:18:51.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37222024-10-04T22:18:51.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37232024-10-04T22:18:51.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37242024-10-04T22:18:51.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37252024-10-04T22:18:51.348ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37262024-10-04T22:18:51.348ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e saga_name = instance-update saga_result = SagaResult { saga_id: 182aef1e-7e4c-439f-bcd2-5e23bf0d170e, saga_log: SagaLog { saga_id: 182aef1e-7e4c-439f-bcd2-5e23bf0d170e, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("1207b0ff-75fc-43d2-bf2f-06753a08f2db")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("1207b0ff-75fc-43d2-bf2f-06753a08f2db")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("0d966f86-2001-459d-9023-a8291a8f49d9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2cc38d1a-5eae-4208-baf7-b332dc17e588")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("0d966f86-2001-459d-9023-a8291a8f49d9"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2cc38d1a-5eae-4208-baf7-b332dc17e588")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("1207b0ff-75fc-43d2-bf2f-06753a08f2db"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("1207b0ff-75fc-43d2-bf2f-06753a08f2db")}} }) }
37272024-10-04T22:18:51.348ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 182aef1e-7e4c-439f-bcd2-5e23bf0d170e instance_id = 0d966f86-2001-459d-9023-a8291a8f49d9 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update
37282024-10-04T22:18:51.348ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37292024-10-04T22:18:51.348ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
37302024-10-04T22:18:51.351ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37312024-10-04T22:18:51.352ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
37322024-10-04T22:18:51.355ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37332024-10-04T22:18:51.355ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
37342024-10-04T22:18:51.359ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37352024-10-04T22:18:51.359ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4
37362024-10-04T22:18:51.364ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update sec_id = 46d21628-a828-4b09-b280-d1af35f56206
37372024-10-04T22:18:51.364ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4 saga_name = start-instance-update saga_result = SagaResult { saga_id: e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4, saga_log: SagaLog { saga_id: e8380650-dd2e-43c1-a8ff-1dd5af1fc2b4, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("413091e6-89f7-4bd7-b461-1265aed49f77")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("413091e6-89f7-4bd7-b461-1265aed49f77")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("413091e6-89f7-4bd7-b461-1265aed49f77"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("413091e6-89f7-4bd7-b461-1265aed49f77")}} }) }
37382024-10-04T22:18:51.368ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37392024-10-04T22:18:51.369ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d17b8b9-4b3f-4838-9c27-822e5c54a509", "content-length": "691", "date": "Fri, 04 Oct 2024 22:18:51 GMT"} })
37402024-10-04T22:18:51.369ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
37412024-10-04T22:18:51.369ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
37422024-10-04T22:18:51.369ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
37432024-10-04T22:18:51.370ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 219.969654ms iteration = 11 status = {}
37442024-10-04T22:18:51.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 160c805d-8ee9-4bf7-9986-3defb28df3ad roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37452024-10-04T22:18:51.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 160c805d-8ee9-4bf7-9986-3defb28df3ad resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37462024-10-04T22:18:51.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 160c805d-8ee9-4bf7-9986-3defb28df3ad response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37472024-10-04T22:18:51.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 7162192c-11a5-4f14-9598-9be60ced35ef roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
37482024-10-04T22:18:51.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 7162192c-11a5-4f14-9598-9be60ced35ef resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
37492024-10-04T22:18:51.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 7162192c-11a5-4f14-9598-9be60ced35ef response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
37502024-10-04T22:18:52.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a924768f-b949-4ffe-aa28-fec989f2ac53 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37512024-10-04T22:18:52.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a924768f-b949-4ffe-aa28-fec989f2ac53 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37522024-10-04T22:18:52.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1820 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a924768f-b949-4ffe-aa28-fec989f2ac53 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37532024-10-04T22:18:53.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 523b90a1-347c-4a9f-a3f0-32a300f0cff0 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37542024-10-04T22:18:53.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 523b90a1-347c-4a9f-a3f0-32a300f0cff0 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37552024-10-04T22:18:53.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 523b90a1-347c-4a9f-a3f0-32a300f0cff0 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37562024-10-04T22:18:54.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 95e9eb1f-626c-4d15-b395-40585a0c3726 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37572024-10-04T22:18:54.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 95e9eb1f-626c-4d15-b395-40585a0c3726 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37582024-10-04T22:18:54.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 95e9eb1f-626c-4d15-b395-40585a0c3726 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37592024-10-04T22:18:54.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
37602024-10-04T22:18:54.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37612024-10-04T22:18:54.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
37622024-10-04T22:18:54.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37632024-10-04T22:18:54.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37642024-10-04T22:18:54.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37652024-10-04T22:18:54.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37662024-10-04T22:18:54.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37672024-10-04T22:18:54.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37682024-10-04T22:18:54.583ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.853627ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37692024-10-04T22:18:54.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37702024-10-04T22:18:54.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37712024-10-04T22:18:54.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37722024-10-04T22:18:54.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37732024-10-04T22:18:54.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37742024-10-04T22:18:54.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37752024-10-04T22:18:54.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
37762024-10-04T22:18:54.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37772024-10-04T22:18:54.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37782024-10-04T22:18:54.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
37792024-10-04T22:18:54.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.02516ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
37802024-10-04T22:18:55.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a901846e-84da-4d51-97fa-3ac34b8daa26 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37812024-10-04T22:18:55.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a901846e-84da-4d51-97fa-3ac34b8daa26 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37822024-10-04T22:18:55.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a901846e-84da-4d51-97fa-3ac34b8daa26 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37832024-10-04T22:18:56.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 79407c5d-9910-4258-8518-bc679d282d77 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37842024-10-04T22:18:56.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 79407c5d-9910-4258-8518-bc679d282d77 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37852024-10-04T22:18:56.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 79407c5d-9910-4258-8518-bc679d282d77 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37862024-10-04T22:18:57.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 78432303-4f7e-4ab8-a821-a61020f7abbf roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37872024-10-04T22:18:57.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 78432303-4f7e-4ab8-a821-a61020f7abbf resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37882024-10-04T22:18:57.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 78432303-4f7e-4ab8-a821-a61020f7abbf response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37892024-10-04T22:18:58.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3dcb8c9f-a069-4d8b-b003-aba9ea62574f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37902024-10-04T22:18:58.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3dcb8c9f-a069-4d8b-b003-aba9ea62574f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37912024-10-04T22:18:58.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3dcb8c9f-a069-4d8b-b003-aba9ea62574f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37922024-10-04T22:18:59.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 53854496-2b2c-4e28-98d4-e4ae371b2c32 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37932024-10-04T22:18:59.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 53854496-2b2c-4e28-98d4-e4ae371b2c32 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37942024-10-04T22:18:59.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 53854496-2b2c-4e28-98d4-e4ae371b2c32 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37952024-10-04T22:19:00.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f24e081-7c49-4ccc-bafe-67c1c2ab3448 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37962024-10-04T22:19:00.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f24e081-7c49-4ccc-bafe-67c1c2ab3448 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37972024-10-04T22:19:00.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f24e081-7c49-4ccc-bafe-67c1c2ab3448 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
37982024-10-04T22:19:00.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = ef0166bd-94c5-479c-bda5-582201026d74 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
37992024-10-04T22:19:01.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cd0dccdf-4b9e-4974-8aac-8b0248969674 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38002024-10-04T22:19:01.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cd0dccdf-4b9e-4974-8aac-8b0248969674 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38012024-10-04T22:19:01.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1951 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = cd0dccdf-4b9e-4974-8aac-8b0248969674 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38022024-10-04T22:19:02.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ff9865b4-bafc-4baa-add0-5e216e556f10 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38032024-10-04T22:19:02.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ff9865b4-bafc-4baa-add0-5e216e556f10 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38042024-10-04T22:19:02.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ff9865b4-bafc-4baa-add0-5e216e556f10 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38052024-10-04T22:19:03.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b4fbc7f2-523f-45ce-87b6-f5fde1ebd8f2 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38062024-10-04T22:19:03.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b4fbc7f2-523f-45ce-87b6-f5fde1ebd8f2 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38072024-10-04T22:19:03.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b4fbc7f2-523f-45ce-87b6-f5fde1ebd8f2 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
38082024-10-04T22:19:04.101ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:37621
38092024-10-04T22:19:04.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37621 req_id = 2e80dc97-89db-4f47-b5f7-0f4ec909bb8d roles = RoleSet { roles: {} } uri = /metrics/producers
38102024-10-04T22:19:04.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37621 req_id = 2e80dc97-89db-4f47-b5f7-0f4ec909bb8d resource = Database result = Ok(()) uri = /metrics/producers
38112024-10-04T22:19:04.134ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
38122024-10-04T22:19:04.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37621 req_id = 2e80dc97-89db-4f47-b5f7-0f4ec909bb8d roles = RoleSet { roles: {} } uri = /metrics/producers
38132024-10-04T22:19:04.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37621 req_id = 2e80dc97-89db-4f47-b5f7-0f4ec909bb8d resource = Database result = Ok(()) uri = /metrics/producers
38142024-10-04T22:19:04.165ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
38152024-10-04T22:19:04.165ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "3c74c65e-921a-42c0-851d-62bd165b4f30", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} })
38162024-10-04T22:19:04.165ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 544b0af3-4a18-4467-8697-af690997796e
38172024-10-04T22:19:04.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65043 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37621 req_id = 2e80dc97-89db-4f47-b5f7-0f4ec909bb8d response_code = 201 uri = /metrics/producers
38182024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
38192024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
38202024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 24.2\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
38212024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
38222024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
38232024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38242024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
38252024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38262024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
38272024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38282024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
38292024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38302024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
38312024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.701\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
38322024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
38332024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38342024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
38352024-10-04T22:19:04.581ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-04 22:09:04.581090330 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38362024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
38372024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38382024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
38392024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.77\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
38402024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38412024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
38422024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
38432024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.74\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
38442024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
38452024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
38462024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38472024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
38482024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38492024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38502024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
38512024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38522024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
38532024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
38542024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
38552024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
38562024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
38572024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38582024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38592024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
38602024-10-04T22:19:04.581ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
38612024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38622024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
38632024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
38642024-10-04T22:19:04.581ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 568e0899-5775-47c6-8a59-2b161d236a0c
38652024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.94\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"568e0899-5775-47c6-8a59-2b161d236a0c"}
38662024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
38672024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
38682024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
38692024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
38702024-10-04T22:19:04.581ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38712024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38722024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38732024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38742024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
38752024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
38762024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38772024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
38782024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
38792024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38802024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
38812024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38822024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
38832024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38842024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38852024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38862024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38872024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
38882024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38892024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38902024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38912024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38922024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38932024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38942024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38952024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38962024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38972024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38982024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38992024-10-04T22:19:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39002024-10-04T22:19:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39012024-10-04T22:19:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39022024-10-04T22:19:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39032024-10-04T22:19:04.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e5972f58-0215-4789-9de6-8c745fc8691c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1142, tv_nsec: 883655124 } })
39042024-10-04T22:19:04.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("173a8178-efd5-4ec1-9f4c-a05bc972d94c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cceb95f-37ad-478b-be36-e32fb96c3dd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1142, tv_nsec: 883656634 } })
39052024-10-04T22:19:04.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39062024-10-04T22:19:04.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.045711ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39072024-10-04T22:19:04.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
39082024-10-04T22:19:04.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.929368ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
39092024-10-04T22:19:04.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39102024-10-04T22:19:04.585ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.50215ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39112024-10-04T22:19:04.585ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-04 22:09:04.581090330 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39122024-10-04T22:19:04.585ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.754625ms iteration = 6 status = {"expiration":"2024-10-04T22:09:04.581090330Z","pruned":[]}
39132024-10-04T22:19:04.585ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.787006ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
39142024-10-04T22:19:04.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39152024-10-04T22:19:04.586ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39162024-10-04T22:19:04.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39172024-10-04T22:19:04.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39182024-10-04T22:19:04.588ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1142, tv_nsec: 889818297 } })
39192024-10-04T22:19:04.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39202024-10-04T22:19:04.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39212024-10-04T22:19:04.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39222024-10-04T22:19:04.589ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
39232024-10-04T22:19:04.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1142, tv_nsec: 891831068 } })
39242024-10-04T22:19:04.591ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39252024-10-04T22:19:04.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
39262024-10-04T22:19:04.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39272024-10-04T22:19:04.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39282024-10-04T22:19:04.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39292024-10-04T22:19:04.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39302024-10-04T22:19:04.592ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39312024-10-04T22:19:04.592ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39322024-10-04T22:19:04.592ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39332024-10-04T22:19:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39342024-10-04T22:19:04.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39352024-10-04T22:19:04.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39362024-10-04T22:19:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39372024-10-04T22:19:04.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39382024-10-04T22:19:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39392024-10-04T22:19:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39402024-10-04T22:19:04.594ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
39412024-10-04T22:19:04.594ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
39422024-10-04T22:19:04.595ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 13.756875ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
39432024-10-04T22:19:04.597ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39442024-10-04T22:19:04.598ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39452024-10-04T22:19:04.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39462024-10-04T22:19:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39472024-10-04T22:19:04.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39482024-10-04T22:19:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
39492024-10-04T22:19:04.599ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39502024-10-04T22:19:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39512024-10-04T22:19:04.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39522024-10-04T22:19:04.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39532024-10-04T22:19:04.603ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39542024-10-04T22:19:04.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39552024-10-04T22:19:04.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39562024-10-04T22:19:04.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39572024-10-04T22:19:04.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39582024-10-04T22:19:04.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39592024-10-04T22:19:04.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39602024-10-04T22:19:04.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.113151ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39612024-10-04T22:19:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39622024-10-04T22:19:04.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39632024-10-04T22:19:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39642024-10-04T22:19:04.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39652024-10-04T22:19:04.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39662024-10-04T22:19:04.612ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39672024-10-04T22:19:04.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39682024-10-04T22:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39692024-10-04T22:19:04.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39702024-10-04T22:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39712024-10-04T22:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39722024-10-04T22:19:04.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39732024-10-04T22:19:04.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39742024-10-04T22:19:04.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39752024-10-04T22:19:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39762024-10-04T22:19:04.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39772024-10-04T22:19:04.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39782024-10-04T22:19:04.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39792024-10-04T22:19:04.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39802024-10-04T22:19:04.620ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39812024-10-04T22:19:04.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39822024-10-04T22:19:04.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
39832024-10-04T22:19:04.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39842024-10-04T22:19:04.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39852024-10-04T22:19:04.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-10-04T22:19:04.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39872024-10-04T22:19:04.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39882024-10-04T22:19:04.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39892024-10-04T22:19:04.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39902024-10-04T22:19:04.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39912024-10-04T22:19:04.650ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
39922024-10-04T22:19:04.650ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
39932024-10-04T22:19:04.650ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
39942024-10-04T22:19:04.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39952024-10-04T22:19:04.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39962024-10-04T22:19:04.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39972024-10-04T22:19:04.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39982024-10-04T22:19:04.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39992024-10-04T22:19:04.651ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40002024-10-04T22:19:04.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40012024-10-04T22:19:04.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40022024-10-04T22:19:04.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40032024-10-04T22:19:04.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40042024-10-04T22:19:04.655ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40052024-10-04T22:19:04.655ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40062024-10-04T22:19:04.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40072024-10-04T22:19:04.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40082024-10-04T22:19:04.658ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40092024-10-04T22:19:04.658ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40102024-10-04T22:19:04.658ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
40112024-10-04T22:19:04.658ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40122024-10-04T22:19:04.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40132024-10-04T22:19:04.669ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
40142024-10-04T22:19:04.669ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
40152024-10-04T22:19:04.669ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 87.726203ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
40162024-10-04T22:19:04.678ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40172024-10-04T22:19:04.678ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.315395ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
40182024-10-04T22:19:04.680ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
40192024-10-04T22:19:04.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40202024-10-04T22:19:04.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = dee7eb99-4064-4699-aabd-beb0971c3045 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
40212024-10-04T22:19:04.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = dee7eb99-4064-4699-aabd-beb0971c3045 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
40222024-10-04T22:19:04.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
40232024-10-04T22:19:04.735ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40242024-10-04T22:19:04.737ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "204b3412-e239-4ec9-b11e-72760ae1d5dd", "content-length": "26", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} })
40252024-10-04T22:19:04.737ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40262024-10-04T22:19:04.739ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40272024-10-04T22:19:04.752ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40282024-10-04T22:19:04.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40292024-10-04T22:19:04.815ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40302024-10-04T22:19:04.816ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "809bd8a5-9415-4f35-98cb-421ccab965b3", "content-length": "372", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} })
40312024-10-04T22:19:04.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40322024-10-04T22:19:04.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40332024-10-04T22:19:04.817ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40342024-10-04T22:19:04.818ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40352024-10-04T22:19:04.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40362024-10-04T22:19:04.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40372024-10-04T22:19:04.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40382024-10-04T22:19:04.820ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40392024-10-04T22:19:04.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40402024-10-04T22:19:04.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40412024-10-04T22:19:04.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40422024-10-04T22:19:04.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40432024-10-04T22:19:04.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40442024-10-04T22:19:04.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40452024-10-04T22:19:04.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = dee7eb99-4064-4699-aabd-beb0971c3045 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
40462024-10-04T22:19:04.825ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1143, tv_nsec: 126714740 } })
40472024-10-04T22:19:04.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40482024-10-04T22:19:04.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40492024-10-04T22:19:04.826ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
40502024-10-04T22:19:04.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
40512024-10-04T22:19:04.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 246.875701ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
40522024-10-04T22:19:04.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
40532024-10-04T22:19:04.835ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40542024-10-04T22:19:04.835ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "167a4111-7960-4505-8cfd-884919cdcb97", "content-length": "26", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} })
40552024-10-04T22:19:04.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40562024-10-04T22:19:04.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40572024-10-04T22:19:04.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40582024-10-04T22:19:04.837ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40592024-10-04T22:19:04.840ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40602024-10-04T22:19:04.840ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "726797ef-7287-4c83-aeb4-d9f9686e4511", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} })
40612024-10-04T22:19:04.842ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.474393ms iteration = 13 status = {}
40622024-10-04T22:19:04.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 280.32764ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40632024-10-04T22:19:04.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40642024-10-04T22:19:04.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40652024-10-04T22:19:04.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40662024-10-04T22:19:04.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672024-10-04T22:19:04.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40682024-10-04T22:19:04.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40692024-10-04T22:19:04.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40702024-10-04T22:19:04.869ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40712024-10-04T22:19:04.869ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
40722024-10-04T22:19:04.869ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 288.37618ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
40732024-10-04T22:19:04.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40742024-10-04T22:19:04.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40752024-10-04T22:19:04.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40762024-10-04T22:19:04.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40772024-10-04T22:19:04.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40782024-10-04T22:19:04.871ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40792024-10-04T22:19:04.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40802024-10-04T22:19:04.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40812024-10-04T22:19:04.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40822024-10-04T22:19:04.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40832024-10-04T22:19:04.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40842024-10-04T22:19:04.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40852024-10-04T22:19:04.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40862024-10-04T22:19:04.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40872024-10-04T22:19:04.873ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40882024-10-04T22:19:04.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40892024-10-04T22:19:04.874ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
40902024-10-04T22:19:04.874ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
40912024-10-04T22:19:04.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40922024-10-04T22:19:04.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40932024-10-04T22:19:04.875ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
40942024-10-04T22:19:04.875ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 0 version = 2
40952024-10-04T22:19:04.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40962024-10-04T22:19:04.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40972024-10-04T22:19:04.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
40982024-10-04T22:19:04.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40992024-10-04T22:19:04.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41002024-10-04T22:19:04.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41012024-10-04T22:19:04.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41022024-10-04T22:19:04.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41032024-10-04T22:19:04.879ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 298.40727ms iteration = 11 status = 0
41042024-10-04T22:19:04.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41052024-10-04T22:19:04.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41062024-10-04T22:19:04.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41072024-10-04T22:19:04.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41082024-10-04T22:19:04.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41092024-10-04T22:19:04.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41102024-10-04T22:19:04.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41112024-10-04T22:19:04.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41122024-10-04T22:19:04.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41132024-10-04T22:19:04.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41142024-10-04T22:19:04.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41152024-10-04T22:19:04.884ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 1 version = 2
41162024-10-04T22:19:04.884ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41172024-10-04T22:19:04.884ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-04 22:14:38.170044 UTC dns_group = external generation = 2
41182024-10-04T22:19:04.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 303.464011ms iteration = 7 status = {"generation":2}
41192024-10-04T22:19:04.898ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
41202024-10-04T22:19:04.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9af441df-483c-49b5-9493-4089a9887da5", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41212024-10-04T22:19:04.898ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41222024-10-04T22:19:04.900ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b98effc9-2f21-4fe6-abed-6ee055cac58f", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41232024-10-04T22:19:04.900ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41242024-10-04T22:19:04.902ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
41252024-10-04T22:19:04.902ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 321.748277ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
41262024-10-04T22:19:04.907ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-04T22:14:02.806172Z, time_modified: 2024-10-04T22:14:02.806172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
41272024-10-04T22:19:04.907ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 325.774637ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]}},"default_endpoint":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41282024-10-04T22:19:04.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41292024-10-04T22:19:04.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41302024-10-04T22:19:04.920ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41312024-10-04T22:19:04.920ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "25e3bced-3d23-46e6-ab7d-39f1df1c77e9", "content-length": "2", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} })
41322024-10-04T22:19:04.922ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41332024-10-04T22:19:04.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41342024-10-04T22:19:04.927ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 346.102944ms iteration = 14 status = {"physical_disks_added":0}
41352024-10-04T22:19:04.929ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
41362024-10-04T22:19:04.929ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 348.92729ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
41372024-10-04T22:19:04.938ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41382024-10-04T22:19:04.938ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41392024-10-04T22:19:04.938ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-04 22:14:36.136216 UTC dns_group = internal generation = 1
41402024-10-04T22:19:04.938ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 357.387999ms iteration = 7 status = {"generation":1}
41412024-10-04T22:19:04.969ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 388.257066ms iteration = 11 status = {}
41422024-10-04T22:19:04.996ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41432024-10-04T22:19:04.996ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "40dc4061-b9f8-4163-a04e-ace83635c5a5", "content-length": "691", "date": "Fri, 04 Oct 2024 22:19:04 GMT"} })
41442024-10-04T22:19:04.996ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41452024-10-04T22:19:04.996ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41462024-10-04T22:19:04.996ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41472024-10-04T22:19:04.998ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 416.818936ms iteration = 12 status = {}
41482024-10-04T22:19:04.998ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 417.115692ms iteration = 11 status = null
41492024-10-04T22:19:05.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41502024-10-04T22:19:05.025ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
41512024-10-04T22:19:05.025ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41522024-10-04T22:19:05.026ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "58364d6c-6991-429c-b46e-a2fdfcd53977", "content-length": "26", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} })
41532024-10-04T22:19:05.026ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41542024-10-04T22:19:05.028ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
41552024-10-04T22:19:05.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41562024-10-04T22:19:05.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41572024-10-04T22:19:05.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41582024-10-04T22:19:05.030ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41592024-10-04T22:19:05.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41602024-10-04T22:19:05.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41612024-10-04T22:19:05.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41622024-10-04T22:19:05.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41632024-10-04T22:19:05.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41642024-10-04T22:19:05.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41652024-10-04T22:19:05.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41662024-10-04T22:19:05.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41672024-10-04T22:19:05.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41682024-10-04T22:19:05.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41692024-10-04T22:19:05.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41702024-10-04T22:19:05.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41712024-10-04T22:19:05.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41722024-10-04T22:19:05.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
41732024-10-04T22:19:05.044ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41742024-10-04T22:19:05.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41752024-10-04T22:19:05.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41762024-10-04T22:19:05.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41772024-10-04T22:19:05.047ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41782024-10-04T22:19:05.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41792024-10-04T22:19:05.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41802024-10-04T22:19:05.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41812024-10-04T22:19:05.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41822024-10-04T22:19:05.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41832024-10-04T22:19:05.053ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41842024-10-04T22:19:05.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41852024-10-04T22:19:05.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41862024-10-04T22:19:05.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41872024-10-04T22:19:05.056ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41882024-10-04T22:19:05.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
41892024-10-04T22:19:05.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41902024-10-04T22:19:05.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41912024-10-04T22:19:05.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41922024-10-04T22:19:05.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41932024-10-04T22:19:05.062ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41942024-10-04T22:19:05.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41952024-10-04T22:19:05.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962024-10-04T22:19:05.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
41972024-10-04T22:19:05.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41982024-10-04T22:19:05.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41992024-10-04T22:19:05.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42002024-10-04T22:19:05.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42012024-10-04T22:19:05.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42022024-10-04T22:19:05.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42032024-10-04T22:19:05.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42042024-10-04T22:19:05.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42052024-10-04T22:19:05.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42062024-10-04T22:19:05.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42072024-10-04T22:19:05.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42082024-10-04T22:19:05.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42092024-10-04T22:19:05.079ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42102024-10-04T22:19:05.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42112024-10-04T22:19:05.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42122024-10-04T22:19:05.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42132024-10-04T22:19:05.082ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142024-10-04T22:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
42152024-10-04T22:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42162024-10-04T22:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42172024-10-04T22:19:05.086ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42182024-10-04T22:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42192024-10-04T22:19:05.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42202024-10-04T22:19:05.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42212024-10-04T22:19:05.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42222024-10-04T22:19:05.090ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42232024-10-04T22:19:05.090ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "7ec47e68-d968-44cb-81c3-c14eb9157130", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42242024-10-04T22:19:05.090ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42252024-10-04T22:19:05.092ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
42262024-10-04T22:19:05.092ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42272024-10-04T22:19:05.092ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d1b435aa-ea5e-4484-9a07-bd58f13cbfd8", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42282024-10-04T22:19:05.092ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42292024-10-04T22:19:05.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42302024-10-04T22:19:05.094ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9d24f9bd-8f51-4e97-aba6-0aa26d2391c3", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42312024-10-04T22:19:05.094ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42322024-10-04T22:19:05.097ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
42332024-10-04T22:19:05.097ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 515.717092ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42342024-10-04T22:19:05.097ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 46b99b09-11d4-4fe4-bf41-6ed61ba36d44, kind: Service { id: e5972f58-0215-4789-9de6-8c745fc8691c }, name: Name("external-dns-e5972f58-0215-4789-9de6-8c745fc8691c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbfb69f6-617d-4782-a1f5-f7e225f6c330, kind: Service { id: fcb39657-4027-45f8-9b5b-fc09e764f468 }, name: Name("external-dns-fcb39657-4027-45f8-9b5b-fc09e764f468"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 13e67383-e8ea-42d3-b048-d94c625ebeb6, kind: Service { id: e72dd7c9-9d72-4f49-b48b-231a411d26a3 }, name: Name("nexus-e72dd7c9-9d72-4f49-b48b-231a411d26a3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9195d467-8fcf-4fcc-9e20-edc728f0400f, kind: Service { id: 46d21628-a828-4b09-b280-d1af35f56206 }, name: Name("nexus-46d21628-a828-4b09-b280-d1af35f56206"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 948c7b04-5bd4-4111-a486-7fc541ba08f2, kind: Service { id: 5b35dee7-890d-4eb6-8ee1-7360a15c561a }, name: Name("nexus-5b35dee7-890d-4eb6-8ee1-7360a15c561a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 10])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
42352024-10-04T22:19:05.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42362024-10-04T22:19:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42372024-10-04T22:19:05.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42382024-10-04T22:19:05.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
42392024-10-04T22:19:05.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42402024-10-04T22:19:05.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42412024-10-04T22:19:05.102ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
42422024-10-04T22:19:05.102ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 46b99b09-11d4-4fe4-bf41-6ed61ba36d44, kind: Service { id: e5972f58-0215-4789-9de6-8c745fc8691c }, name: Name("external-dns-e5972f58-0215-4789-9de6-8c745fc8691c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 244])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bbfb69f6-617d-4782-a1f5-f7e225f6c330, kind: Service { id: fcb39657-4027-45f8-9b5b-fc09e764f468 }, name: Name("external-dns-fcb39657-4027-45f8-9b5b-fc09e764f468"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 13e67383-e8ea-42d3-b048-d94c625ebeb6, kind: Service { id: e72dd7c9-9d72-4f49-b48b-231a411d26a3 }, name: Name("nexus-e72dd7c9-9d72-4f49-b48b-231a411d26a3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 174, 146])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9195d467-8fcf-4fcc-9e20-edc728f0400f, kind: Service { id: 46d21628-a828-4b09-b280-d1af35f56206 }, name: Name("nexus-46d21628-a828-4b09-b280-d1af35f56206"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 186])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 948c7b04-5bd4-4111-a486-7fc541ba08f2, kind: Service { id: 5b35dee7-890d-4eb6-8ee1-7360a15c561a }, name: Name("nexus-5b35dee7-890d-4eb6-8ee1-7360a15c561a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 10])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
42432024-10-04T22:19:05.102ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
42442024-10-04T22:19:05.153ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42452024-10-04T22:19:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42462024-10-04T22:19:05.155ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 544b0af3-4a18-4467-8697-af690997796e, time_created: 2024-10-04T22:14:35.672250Z, time_modified: 2024-10-04T22:14:35.672250Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
42472024-10-04T22:19:05.156ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
42482024-10-04T22:19:05.156ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42492024-10-04T22:19:05.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42502024-10-04T22:19:05.156ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
42512024-10-04T22:19:05.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42522024-10-04T22:19:05.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42532024-10-04T22:19:05.158ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42542024-10-04T22:19:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42552024-10-04T22:19:05.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42562024-10-04T22:19:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
42572024-10-04T22:19:05.164ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42582024-10-04T22:19:05.165ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb1a301-5da0-4fb8-8264-42ecb3f085d2", "content-length": "121", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} })
42592024-10-04T22:19:05.165ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
42602024-10-04T22:19:05.165ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
42612024-10-04T22:19:05.165ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42622024-10-04T22:19:05.165ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42632024-10-04T22:19:05.165ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
42642024-10-04T22:19:05.165ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
42652024-10-04T22:19:05.165ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
42662024-10-04T22:19:05.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42672024-10-04T22:19:05.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42682024-10-04T22:19:05.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42692024-10-04T22:19:05.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "847ddd00-4784-453f-8c1d-459f9a26946a", "content-length": "2", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} })
42702024-10-04T22:19:05.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42712024-10-04T22:19:05.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2e1973e-43c6-462c-b0d9-9728dc63ac8e", "content-length": "52", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} })
42722024-10-04T22:19:05.167ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
42732024-10-04T22:19:05.167ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42742024-10-04T22:19:05.194ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
42752024-10-04T22:19:05.242ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "63d4cc8f-a659-47fd-975b-bd9fe13fed30", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} })
42762024-10-04T22:19:05.244ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
42772024-10-04T22:19:05.244ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 662.887361ms
42782024-10-04T22:19:05.244ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 662.896582ms iteration = 2 status = {}
42792024-10-04T22:19:05.328ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "08db3933-0595-4651-bda5-b2212b1ea9db", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} })
42802024-10-04T22:19:05.328ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
42812024-10-04T22:19:05.328ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42822024-10-04T22:19:05.329ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0872b5cd-eb97-4fc7-9118-4fa733a6c73d", "content-length": "667", "date": "Fri, 04 Oct 2024 22:19:05 GMT"} })
42832024-10-04T22:19:05.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42842024-10-04T22:19:05.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42852024-10-04T22:19:05.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42862024-10-04T22:19:05.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42872024-10-04T22:19:05.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42882024-10-04T22:19:05.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42892024-10-04T22:19:05.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42902024-10-04T22:19:05.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42912024-10-04T22:19:05.345ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 763.681985ms iteration = 11 status = {}
42922024-10-04T22:19:05.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 533fa8c1-7c2b-4be7-aa92-0e8ab1ec0dcc roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
42932024-10-04T22:19:05.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 533fa8c1-7c2b-4be7-aa92-0e8ab1ec0dcc resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
42942024-10-04T22:19:05.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 533fa8c1-7c2b-4be7-aa92-0e8ab1ec0dcc response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
42952024-10-04T22:19:06.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d7b50df8-2640-495c-a325-2b5417f3ef71 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
42962024-10-04T22:19:06.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d7b50df8-2640-495c-a325-2b5417f3ef71 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
42972024-10-04T22:19:06.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d7b50df8-2640-495c-a325-2b5417f3ef71 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
42982024-10-04T22:19:07.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e5f67575-483b-4cf7-83b3-9670efce6ea2 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
42992024-10-04T22:19:07.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e5f67575-483b-4cf7-83b3-9670efce6ea2 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43002024-10-04T22:19:07.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e5f67575-483b-4cf7-83b3-9670efce6ea2 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43012024-10-04T22:19:08.594ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40029
43022024-10-04T22:19:08.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40029 req_id = 55b6ed94-8d34-4614-a70c-63e93724acf7 roles = RoleSet { roles: {} } uri = /metrics/producers
43032024-10-04T22:19:08.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40029 req_id = 55b6ed94-8d34-4614-a70c-63e93724acf7 resource = Database result = Ok(()) uri = /metrics/producers
43042024-10-04T22:19:08.627ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
43052024-10-04T22:19:08.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40029 req_id = 55b6ed94-8d34-4614-a70c-63e93724acf7 roles = RoleSet { roles: {} } uri = /metrics/producers
43062024-10-04T22:19:08.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40029 req_id = 55b6ed94-8d34-4614-a70c-63e93724acf7 resource = Database result = Ok(()) uri = /metrics/producers
43072024-10-04T22:19:08.656ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
43082024-10-04T22:19:08.656ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "02f03731-3b9d-41db-86ba-c027722ccd7e", "date": "Fri, 04 Oct 2024 22:19:08 GMT"} })
43092024-10-04T22:19:08.656ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = e003a4f9-367c-4ba5-b4e7-8e2206c9a111
43102024-10-04T22:19:08.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62809 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40029 req_id = 55b6ed94-8d34-4614-a70c-63e93724acf7 response_code = 201 uri = /metrics/producers
43112024-10-04T22:19:08.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 88beb001-7722-4156-b243-55f00d9701a7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43122024-10-04T22:19:08.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 88beb001-7722-4156-b243-55f00d9701a7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43132024-10-04T22:19:08.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 88beb001-7722-4156-b243-55f00d9701a7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43142024-10-04T22:19:09.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2e992761-cc0c-4c1a-9313-4f3f03870d36 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43152024-10-04T22:19:09.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2e992761-cc0c-4c1a-9313-4f3f03870d36 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43162024-10-04T22:19:09.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2e992761-cc0c-4c1a-9313-4f3f03870d36 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43172024-10-04T22:19:10.765ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:61477
43182024-10-04T22:19:10.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61477 req_id = 1f0c5e33-ec28-4c84-bed6-ae20f2f5f63f roles = RoleSet { roles: {} } uri = /metrics/producers
43192024-10-04T22:19:10.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61477 req_id = 1f0c5e33-ec28-4c84-bed6-ae20f2f5f63f resource = Database result = Ok(()) uri = /metrics/producers
43202024-10-04T22:19:10.798ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
43212024-10-04T22:19:10.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61477 req_id = 1f0c5e33-ec28-4c84-bed6-ae20f2f5f63f roles = RoleSet { roles: {} } uri = /metrics/producers
43222024-10-04T22:19:10.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61477 req_id = 1f0c5e33-ec28-4c84-bed6-ae20f2f5f63f resource = Database result = Ok(()) uri = /metrics/producers
43232024-10-04T22:19:10.829ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
43242024-10-04T22:19:10.830ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "cbed29b9-6d0b-4e99-b60d-85c5a3492833", "date": "Fri, 04 Oct 2024 22:19:10 GMT"} })
43252024-10-04T22:19:10.830ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 267536c4-b0ca-40c9-ba2b-798521f99028
43262024-10-04T22:19:10.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66973 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61477 req_id = 1f0c5e33-ec28-4c84-bed6-ae20f2f5f63f response_code = 201 uri = /metrics/producers
43272024-10-04T22:19:10.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8cd718ab-1712-42e0-9f39-8547187e8579 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43282024-10-04T22:19:10.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8cd718ab-1712-42e0-9f39-8547187e8579 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43292024-10-04T22:19:10.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8cd718ab-1712-42e0-9f39-8547187e8579 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43302024-10-04T22:19:10.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 89c3cc96-647b-4d38-b549-51497c2a441c response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
43312024-10-04T22:19:11.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ba662b1e-0e0c-44e8-82c1-bcc71a898fdb roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43322024-10-04T22:19:11.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ba662b1e-0e0c-44e8-82c1-bcc71a898fdb resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43332024-10-04T22:19:11.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2315 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ba662b1e-0e0c-44e8-82c1-bcc71a898fdb response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43342024-10-04T22:19:12.068ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33701
43352024-10-04T22:19:12.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33701 req_id = 467c610f-9451-4f15-8a9d-d17931e51907 roles = RoleSet { roles: {} } uri = /metrics/producers
43362024-10-04T22:19:12.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33701 req_id = 467c610f-9451-4f15-8a9d-d17931e51907 resource = Database result = Ok(()) uri = /metrics/producers
43372024-10-04T22:19:12.101ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
43382024-10-04T22:19:12.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33701 req_id = 467c610f-9451-4f15-8a9d-d17931e51907 roles = RoleSet { roles: {} } uri = /metrics/producers
43392024-10-04T22:19:12.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33701 req_id = 467c610f-9451-4f15-8a9d-d17931e51907 resource = Database result = Ok(()) uri = /metrics/producers
43402024-10-04T22:19:12.135ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
43412024-10-04T22:19:12.135ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "35566d21-ce5a-4569-8962-eeebbec382e2", "date": "Fri, 04 Oct 2024 22:19:12 GMT"} })
43422024-10-04T22:19:12.135ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 424e4c9a-473d-43a4-aed1-77de951357f7
43432024-10-04T22:19:12.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69530 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33701 req_id = 467c610f-9451-4f15-8a9d-d17931e51907 response_code = 201 uri = /metrics/producers
43442024-10-04T22:19:12.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 62c78122-90cb-44a6-8452-f5f9314e0f5c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43452024-10-04T22:19:12.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 62c78122-90cb-44a6-8452-f5f9314e0f5c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43462024-10-04T22:19:13.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 62c78122-90cb-44a6-8452-f5f9314e0f5c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43472024-10-04T22:19:14.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96e8dce2-fbc0-4317-8ff1-1b85bf396cda roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43482024-10-04T22:19:14.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96e8dce2-fbc0-4317-8ff1-1b85bf396cda resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43492024-10-04T22:19:14.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 96e8dce2-fbc0-4317-8ff1-1b85bf396cda response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43502024-10-04T22:19:14.112ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:37798
43512024-10-04T22:19:14.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37798 req_id = 8fbf082b-4eee-4198-a87b-18e2fbcc2ea1 roles = RoleSet { roles: {} } uri = /metrics/producers
43522024-10-04T22:19:14.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37798 req_id = 8fbf082b-4eee-4198-a87b-18e2fbcc2ea1 resource = Database result = Ok(()) uri = /metrics/producers
43532024-10-04T22:19:14.146ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
43542024-10-04T22:19:14.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37798 req_id = 8fbf082b-4eee-4198-a87b-18e2fbcc2ea1 roles = RoleSet { roles: {} } uri = /metrics/producers
43552024-10-04T22:19:14.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37798 req_id = 8fbf082b-4eee-4198-a87b-18e2fbcc2ea1 resource = Database result = Ok(()) uri = /metrics/producers
43562024-10-04T22:19:14.175ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
43572024-10-04T22:19:14.176ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "805a3fe9-8189-454c-95bd-9ad5327de4a4", "date": "Fri, 04 Oct 2024 22:19:14 GMT"} })
43582024-10-04T22:19:14.176ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = adfc6ece-c25a-427e-af7d-fef3dd24e379
43592024-10-04T22:19:14.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 64013 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37798 req_id = 8fbf082b-4eee-4198-a87b-18e2fbcc2ea1 response_code = 201 uri = /metrics/producers
43602024-10-04T22:19:14.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
43612024-10-04T22:19:14.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
43622024-10-04T22:19:14.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43632024-10-04T22:19:14.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43642024-10-04T22:19:14.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43652024-10-04T22:19:14.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43662024-10-04T22:19:14.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43672024-10-04T22:19:14.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43682024-10-04T22:19:14.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43692024-10-04T22:19:14.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43702024-10-04T22:19:14.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43712024-10-04T22:19:14.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43722024-10-04T22:19:14.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43732024-10-04T22:19:14.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
43742024-10-04T22:19:14.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43752024-10-04T22:19:14.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43762024-10-04T22:19:14.598ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
43772024-10-04T22:19:14.598ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.187003ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
43782024-10-04T22:19:14.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43792024-10-04T22:19:14.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43802024-10-04T22:19:14.609ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.045621ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43812024-10-04T22:19:15.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d40d697c-34e1-42c6-82aa-10ba91ca3c8c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43822024-10-04T22:19:15.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d40d697c-34e1-42c6-82aa-10ba91ca3c8c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43832024-10-04T22:19:15.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d40d697c-34e1-42c6-82aa-10ba91ca3c8c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43842024-10-04T22:19:16.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d7f588ea-4d48-44b6-a401-07405ab9fb07 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43852024-10-04T22:19:16.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d7f588ea-4d48-44b6-a401-07405ab9fb07 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43862024-10-04T22:19:16.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d7f588ea-4d48-44b6-a401-07405ab9fb07 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43872024-10-04T22:19:17.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1f21ed74-a1fa-4eb8-b937-988f5bc7db0c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43882024-10-04T22:19:17.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1f21ed74-a1fa-4eb8-b937-988f5bc7db0c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43892024-10-04T22:19:17.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1f21ed74-a1fa-4eb8-b937-988f5bc7db0c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43902024-10-04T22:19:18.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 40074f6e-e98c-4c3d-bc69-9726619389f9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43912024-10-04T22:19:18.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 40074f6e-e98c-4c3d-bc69-9726619389f9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43922024-10-04T22:19:18.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 40074f6e-e98c-4c3d-bc69-9726619389f9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43932024-10-04T22:19:19.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4f061e48-0a01-44df-9733-07dbf57a2b3b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43942024-10-04T22:19:19.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4f061e48-0a01-44df-9733-07dbf57a2b3b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43952024-10-04T22:19:19.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4f061e48-0a01-44df-9733-07dbf57a2b3b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43962024-10-04T22:19:20.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3ee3842-e07d-4fd9-9d7a-75720cd315e8 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43972024-10-04T22:19:20.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3ee3842-e07d-4fd9-9d7a-75720cd315e8 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43982024-10-04T22:19:20.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f3ee3842-e07d-4fd9-9d7a-75720cd315e8 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
43992024-10-04T22:19:20.982ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1319 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = eed66bd0-d8e8-4335-9569-802b22616aa7 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
44002024-10-04T22:19:21.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a475b19-1b32-4aba-881e-21572d9e41a3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44012024-10-04T22:19:21.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a475b19-1b32-4aba-881e-21572d9e41a3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44022024-10-04T22:19:21.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a475b19-1b32-4aba-881e-21572d9e41a3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44032024-10-04T22:19:21.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = cb2d7e53-0e9f-48b0-98b5-4a865772b033 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
44042024-10-04T22:19:21.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = cb2d7e53-0e9f-48b0-98b5-4a865772b033 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
44052024-10-04T22:19:21.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = cb2d7e53-0e9f-48b0-98b5-4a865772b033 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
44062024-10-04T22:19:22.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ddf98b6c-c2d0-4797-bf47-b0cda1592d4d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44072024-10-04T22:19:22.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ddf98b6c-c2d0-4797-bf47-b0cda1592d4d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44082024-10-04T22:19:22.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ddf98b6c-c2d0-4797-bf47-b0cda1592d4d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44092024-10-04T22:19:23.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81a64add-b819-4fdf-a001-ec48cf9f7536 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44102024-10-04T22:19:23.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81a64add-b819-4fdf-a001-ec48cf9f7536 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44112024-10-04T22:19:23.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 81a64add-b819-4fdf-a001-ec48cf9f7536 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44122024-10-04T22:19:23.774ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50504
44132024-10-04T22:19:23.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50504 req_id = 11361a2c-8040-47c7-82c5-48c2e23c380d roles = RoleSet { roles: {} } uri = /metrics/producers
44142024-10-04T22:19:23.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50504 req_id = 11361a2c-8040-47c7-82c5-48c2e23c380d resource = Database result = Ok(()) uri = /metrics/producers
44152024-10-04T22:19:23.807ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
44162024-10-04T22:19:23.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50504 req_id = 11361a2c-8040-47c7-82c5-48c2e23c380d roles = RoleSet { roles: {} } uri = /metrics/producers
44172024-10-04T22:19:23.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50504 req_id = 11361a2c-8040-47c7-82c5-48c2e23c380d resource = Database result = Ok(()) uri = /metrics/producers
44182024-10-04T22:19:23.812ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
44192024-10-04T22:19:23.813ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "58072451-6377-46e6-a366-2afb7f30c788", "date": "Fri, 04 Oct 2024 22:19:23 GMT"} })
44202024-10-04T22:19:23.813ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = c799734e-ac9f-438c-a36e-667112d684ca
44212024-10-04T22:19:23.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40771 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50504 req_id = 11361a2c-8040-47c7-82c5-48c2e23c380d response_code = 201 uri = /metrics/producers
44222024-10-04T22:19:24.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6e8d3d7e-9380-4a58-bd2e-99007853cbb2 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44232024-10-04T22:19:24.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6e8d3d7e-9380-4a58-bd2e-99007853cbb2 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44242024-10-04T22:19:24.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 6e8d3d7e-9380-4a58-bd2e-99007853cbb2 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44252024-10-04T22:19:24.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
44262024-10-04T22:19:24.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44272024-10-04T22:19:24.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
44282024-10-04T22:19:24.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44292024-10-04T22:19:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44302024-10-04T22:19:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44312024-10-04T22:19:24.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44322024-10-04T22:19:24.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44332024-10-04T22:19:24.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44342024-10-04T22:19:24.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.387108ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44352024-10-04T22:19:24.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44362024-10-04T22:19:24.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44372024-10-04T22:19:24.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44382024-10-04T22:19:24.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44392024-10-04T22:19:24.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44402024-10-04T22:19:24.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44412024-10-04T22:19:24.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
44422024-10-04T22:19:24.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44432024-10-04T22:19:24.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44442024-10-04T22:19:24.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
44452024-10-04T22:19:24.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.929458ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
44462024-10-04T22:19:25.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f96de52-4a45-41af-a134-78e4c0162f98 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44472024-10-04T22:19:25.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f96de52-4a45-41af-a134-78e4c0162f98 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44482024-10-04T22:19:25.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7f96de52-4a45-41af-a134-78e4c0162f98 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44492024-10-04T22:19:26.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e695dab1-547b-46cd-9ee9-18a65870a335 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44502024-10-04T22:19:26.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e695dab1-547b-46cd-9ee9-18a65870a335 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44512024-10-04T22:19:26.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e695dab1-547b-46cd-9ee9-18a65870a335 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44522024-10-04T22:19:27.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c7ec792-79c3-4853-9ba5-7ce3feb74ae2 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44532024-10-04T22:19:27.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c7ec792-79c3-4853-9ba5-7ce3feb74ae2 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44542024-10-04T22:19:27.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c7ec792-79c3-4853-9ba5-7ce3feb74ae2 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44552024-10-04T22:19:28.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e4df4d2f-4d87-4aab-b9f6-a7889e6e04c0 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44562024-10-04T22:19:28.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e4df4d2f-4d87-4aab-b9f6-a7889e6e04c0 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44572024-10-04T22:19:28.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e4df4d2f-4d87-4aab-b9f6-a7889e6e04c0 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44582024-10-04T22:19:29.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 666f041c-cc2e-4850-b7a6-0f8234958b40 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44592024-10-04T22:19:29.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 666f041c-cc2e-4850-b7a6-0f8234958b40 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44602024-10-04T22:19:29.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 666f041c-cc2e-4850-b7a6-0f8234958b40 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44612024-10-04T22:19:30.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 480b64c5-00b1-473f-82b5-fe2f1ef1411c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44622024-10-04T22:19:30.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 480b64c5-00b1-473f-82b5-fe2f1ef1411c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44632024-10-04T22:19:30.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 480b64c5-00b1-473f-82b5-fe2f1ef1411c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44642024-10-04T22:19:30.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = a6c03439-c704-44af-80ec-c714b4c48cc5 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
44652024-10-04T22:19:31.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 09059c08-efc8-4db3-9402-a72019cff24f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44662024-10-04T22:19:31.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 09059c08-efc8-4db3-9402-a72019cff24f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44672024-10-04T22:19:31.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 09059c08-efc8-4db3-9402-a72019cff24f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44682024-10-04T22:19:32.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c7b86ac4-0065-46d0-83dd-a7f3a3cb283b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44692024-10-04T22:19:32.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c7b86ac4-0065-46d0-83dd-a7f3a3cb283b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44702024-10-04T22:19:32.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c7b86ac4-0065-46d0-83dd-a7f3a3cb283b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44712024-10-04T22:19:33.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3c25b91e-8ae1-4570-ab2f-3fae82ec2f0d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44722024-10-04T22:19:33.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3c25b91e-8ae1-4570-ab2f-3fae82ec2f0d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44732024-10-04T22:19:33.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3c25b91e-8ae1-4570-ab2f-3fae82ec2f0d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44742024-10-04T22:19:34.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2c60a2cf-3de5-42f2-ad8a-bd6a0372aa2e roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44752024-10-04T22:19:34.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2c60a2cf-3de5-42f2-ad8a-bd6a0372aa2e resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44762024-10-04T22:19:34.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 2c60a2cf-3de5-42f2-ad8a-bd6a0372aa2e response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
44772024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
44782024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44792024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
44802024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
44812024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44822024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44832024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
44842024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
44852024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.111\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
44862024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44872024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
44882024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44892024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
44902024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
44912024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
44922024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44932024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44942024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
44952024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44962024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.03\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44972024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
44982024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
44992024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45002024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
45012024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45022024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45032024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
45042024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.77\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
45052024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
45062024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
45072024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.59\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45082024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45092024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
45102024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45112024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45122024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45132024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45142024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45152024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45162024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45172024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45182024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45192024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45202024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45212024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45222024-10-04T22:19:34.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45232024-10-04T22:19:34.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45242024-10-04T22:19:34.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45252024-10-04T22:19:34.582ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.704534ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45262024-10-04T22:19:34.583ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45272024-10-04T22:19:34.583ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45282024-10-04T22:19:34.583ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45292024-10-04T22:19:34.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45302024-10-04T22:19:34.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312024-10-04T22:19:34.585ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322024-10-04T22:19:34.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332024-10-04T22:19:34.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45342024-10-04T22:19:34.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45352024-10-04T22:19:34.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45362024-10-04T22:19:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45372024-10-04T22:19:34.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45382024-10-04T22:19:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45392024-10-04T22:19:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45402024-10-04T22:19:34.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45412024-10-04T22:19:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45422024-10-04T22:19:34.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1172, tv_nsec: 892088193 } })
45432024-10-04T22:19:34.590ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
45442024-10-04T22:19:34.593ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1172, tv_nsec: 894994491 } })
45452024-10-04T22:19:34.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45462024-10-04T22:19:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45472024-10-04T22:19:34.594ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
45482024-10-04T22:19:34.594ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45492024-10-04T22:19:34.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45502024-10-04T22:19:34.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45512024-10-04T22:19:34.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45522024-10-04T22:19:34.599ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45532024-10-04T22:19:34.599ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.217514ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45542024-10-04T22:19:34.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45552024-10-04T22:19:34.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45562024-10-04T22:19:34.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45572024-10-04T22:19:34.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45582024-10-04T22:19:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45592024-10-04T22:19:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45602024-10-04T22:19:34.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45612024-10-04T22:19:34.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45622024-10-04T22:19:34.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45632024-10-04T22:19:34.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45642024-10-04T22:19:34.626ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1172, tv_nsec: 927889608 } })
45652024-10-04T22:19:34.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45662024-10-04T22:19:34.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45672024-10-04T22:19:34.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45682024-10-04T22:19:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45692024-10-04T22:19:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45702024-10-04T22:19:34.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.882777ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45712024-10-04T22:19:34.627ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
45722024-10-04T22:19:34.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45732024-10-04T22:19:34.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45742024-10-04T22:19:34.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45752024-10-04T22:19:34.627ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45762024-10-04T22:19:34.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45772024-10-04T22:19:34.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45782024-10-04T22:19:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45792024-10-04T22:19:34.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45802024-10-04T22:19:34.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45812024-10-04T22:19:34.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45822024-10-04T22:19:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
45832024-10-04T22:19:34.634ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45842024-10-04T22:19:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45852024-10-04T22:19:34.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45862024-10-04T22:19:34.636ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 56.226523ms iteration = 12 status = 0
45872024-10-04T22:19:34.636ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45882024-10-04T22:19:34.636ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45892024-10-04T22:19:34.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45902024-10-04T22:19:34.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45912024-10-04T22:19:34.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
45922024-10-04T22:19:34.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45932024-10-04T22:19:34.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45942024-10-04T22:19:34.645ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45952024-10-04T22:19:34.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45962024-10-04T22:19:34.649ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972024-10-04T22:19:34.650ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45982024-10-04T22:19:34.650ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45992024-10-04T22:19:34.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46002024-10-04T22:19:34.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46012024-10-04T22:19:34.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46022024-10-04T22:19:34.654ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46032024-10-04T22:19:34.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46042024-10-04T22:19:34.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
46052024-10-04T22:19:34.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.289004ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
46062024-10-04T22:19:34.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.943277ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46072024-10-04T22:19:34.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46082024-10-04T22:19:34.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46092024-10-04T22:19:34.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46102024-10-04T22:19:34.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46112024-10-04T22:19:34.682ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46122024-10-04T22:19:34.682ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46132024-10-04T22:19:34.682ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 102.613619ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46142024-10-04T22:19:34.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
46152024-10-04T22:19:34.735ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46162024-10-04T22:19:34.735ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "adfc9d2a-4555-43eb-b97f-26bcdb17d3f5", "content-length": "26", "date": "Fri, 04 Oct 2024 22:19:33 GMT"} })
46172024-10-04T22:19:34.735ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46182024-10-04T22:19:34.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
46192024-10-04T22:19:34.767ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 186.806562ms iteration = 15 status = {"physical_disks_added":0}
46202024-10-04T22:19:34.782ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
46212024-10-04T22:19:34.782ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46222024-10-04T22:19:34.782ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "369c67a5-b098-4492-9494-3d9036c4dae3", "content-length": "26", "date": "Fri, 04 Oct 2024 22:19:33 GMT"} })
46232024-10-04T22:19:34.782ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46242024-10-04T22:19:34.783ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46252024-10-04T22:19:34.793ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
46262024-10-04T22:19:34.793ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46272024-10-04T22:19:34.794ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8e0c390-3c8b-4b5a-a447-1c71d5e9fea2", "content-length": "26", "date": "Fri, 04 Oct 2024 22:19:33 GMT"} })
46282024-10-04T22:19:34.794ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46292024-10-04T22:19:34.795ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46302024-10-04T22:19:34.805ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46312024-10-04T22:19:34.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "145183cc-2c68-4583-8f3c-d975def18bb0", "content-length": "372", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46322024-10-04T22:19:34.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46332024-10-04T22:19:34.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46342024-10-04T22:19:34.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46352024-10-04T22:19:34.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46362024-10-04T22:19:34.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46372024-10-04T22:19:34.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46382024-10-04T22:19:34.814ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46392024-10-04T22:19:34.814ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6b2dbd65-0ef2-4710-ba8b-7b656dc24773", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46402024-10-04T22:19:34.815ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 235.77759ms iteration = 14 status = {}
46412024-10-04T22:19:34.842ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46422024-10-04T22:19:34.889ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46432024-10-04T22:19:34.890ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed5d5d93-b7f5-456a-8d25-5fcc05a8d04d", "content-length": "2", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46442024-10-04T22:19:34.890ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46452024-10-04T22:19:34.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46462024-10-04T22:19:34.893ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 312.709677ms iteration = 12 status = null
46472024-10-04T22:19:34.895ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 314.824929ms iteration = 12 status = {}
46482024-10-04T22:19:34.925ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca256512-ca2f-4607-962d-9830b8586890", "content-length": "691", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46492024-10-04T22:19:34.925ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46502024-10-04T22:19:34.925ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46512024-10-04T22:19:34.925ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46522024-10-04T22:19:34.926ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 346.305768ms iteration = 13 status = {}
46532024-10-04T22:19:34.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46542024-10-04T22:19:34.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46552024-10-04T22:19:34.948ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
46562024-10-04T22:19:34.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46572024-10-04T22:19:34.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46582024-10-04T22:19:34.961ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46592024-10-04T22:19:34.961ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ede0510-7fa2-4880-855f-264cadc2df82", "content-length": "121", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46602024-10-04T22:19:34.961ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
46612024-10-04T22:19:34.961ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
46622024-10-04T22:19:34.962ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46632024-10-04T22:19:34.962ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46642024-10-04T22:19:34.962ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
46652024-10-04T22:19:34.962ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
46662024-10-04T22:19:34.962ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
46672024-10-04T22:19:34.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46682024-10-04T22:19:34.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46692024-10-04T22:19:34.963ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46702024-10-04T22:19:34.963ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff433497-4a92-4a6e-8085-02bc6eeed1e2", "content-length": "2", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46712024-10-04T22:19:34.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46722024-10-04T22:19:34.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f942bbbd-7293-4b38-b833-1ab29bc08a82", "content-length": "52", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46732024-10-04T22:19:34.964ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
46742024-10-04T22:19:34.964ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46752024-10-04T22:19:35.058ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "059dc61c-45c6-4b99-b542-174f394d72b3", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46762024-10-04T22:19:35.058ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
46772024-10-04T22:19:35.058ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46782024-10-04T22:19:35.058ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "86fa5a95-9ce2-42c3-b692-3f51b1aff342", "content-length": "667", "date": "Fri, 04 Oct 2024 22:19:34 GMT"} })
46792024-10-04T22:19:35.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46802024-10-04T22:19:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46812024-10-04T22:19:35.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46822024-10-04T22:19:35.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46832024-10-04T22:19:35.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46842024-10-04T22:19:35.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46852024-10-04T22:19:35.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46862024-10-04T22:19:35.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46872024-10-04T22:19:35.076ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 496.10696ms iteration = 12 status = {}
46882024-10-04T22:19:35.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a42a105-91b2-40fd-8725-cdb375ed2ba1 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46892024-10-04T22:19:35.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a42a105-91b2-40fd-8725-cdb375ed2ba1 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46902024-10-04T22:19:35.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4a42a105-91b2-40fd-8725-cdb375ed2ba1 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46912024-10-04T22:19:36.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ad16686f-5ac7-4b99-9762-5b83336fac9d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46922024-10-04T22:19:36.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ad16686f-5ac7-4b99-9762-5b83336fac9d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46932024-10-04T22:19:36.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ad16686f-5ac7-4b99-9762-5b83336fac9d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46942024-10-04T22:19:37.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bdfcc409-16df-4ac0-a0e1-a6d70c8c4db3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46952024-10-04T22:19:37.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bdfcc409-16df-4ac0-a0e1-a6d70c8c4db3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46962024-10-04T22:19:37.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bdfcc409-16df-4ac0-a0e1-a6d70c8c4db3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46972024-10-04T22:19:38.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d5024073-b5aa-4dde-a660-0c95f646e442 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46982024-10-04T22:19:38.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d5024073-b5aa-4dde-a660-0c95f646e442 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
46992024-10-04T22:19:38.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d5024073-b5aa-4dde-a660-0c95f646e442 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47002024-10-04T22:19:39.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ce02b4b0-0d6b-48f0-a7cd-4453e2db7474 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47012024-10-04T22:19:39.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ce02b4b0-0d6b-48f0-a7cd-4453e2db7474 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47022024-10-04T22:19:39.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ce02b4b0-0d6b-48f0-a7cd-4453e2db7474 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47032024-10-04T22:19:40.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c85719ce-7e75-428c-9f31-3e842fdcf2c0 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47042024-10-04T22:19:40.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c85719ce-7e75-428c-9f31-3e842fdcf2c0 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47052024-10-04T22:19:40.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c85719ce-7e75-428c-9f31-3e842fdcf2c0 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47062024-10-04T22:19:40.983ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1481 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 9f04ce72-c8e1-49fe-82cd-a7e44d7377c9 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
47072024-10-04T22:19:40.984ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
47082024-10-04T22:19:40.984ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
47092024-10-04T22:19:41.014ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
47102024-10-04T22:19:41.014ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:52961
47112024-10-04T22:19:41.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52961 req_id = 497caee1-28fd-4be2-a87b-8cabb0792538 roles = RoleSet { roles: {} } uri = /metrics/producers
47122024-10-04T22:19:41.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52961 req_id = 497caee1-28fd-4be2-a87b-8cabb0792538 resource = Database result = Ok(()) uri = /metrics/producers
47132024-10-04T22:19:41.047ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:371 id = 75036a45-c39d-44e7-9208-1799441e9ebf
47142024-10-04T22:19:41.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52961 req_id = 497caee1-28fd-4be2-a87b-8cabb0792538 roles = RoleSet { roles: {} } uri = /metrics/producers
47152024-10-04T22:19:41.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52961 req_id = 497caee1-28fd-4be2-a87b-8cabb0792538 resource = Database result = Ok(()) uri = /metrics/producers
47162024-10-04T22:19:41.081ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf uri = http://[fd00:1122:3344:101::d]:12223/producers
47172024-10-04T22:19:41.081ZDEBGnexus: client response oximeter-collector = 75036a45-c39d-44e7-9208-1799441e9ebf result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "8a50fe2d-92f2-4494-a99e-6262dc80e779", "date": "Fri, 04 Oct 2024 22:19:41 GMT"} })
47182024-10-04T22:19:41.081ZINFOnexus: assigned collector to new producer collector_id = 75036a45-c39d-44e7-9208-1799441e9ebf file = nexus/src/app/oximeter.rs:156 producer_id = 46d21628-a828-4b09-b280-d1af35f56206
47192024-10-04T22:19:41.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67629 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52961 req_id = 497caee1-28fd-4be2-a87b-8cabb0792538 response_code = 201 uri = /metrics/producers
47202024-10-04T22:19:41.082ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "497caee1-28fd-4be2-a87b-8cabb0792538", "content-length": "41", "date": "Fri, 04 Oct 2024 22:19:40 GMT"} })
47212024-10-04T22:19:41.084ZDEBGnexus (producer-registration-task): registered with nexus successfully
47222024-10-04T22:19:41.084ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
47232024-10-04T22:19:41.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4b5c9b93-85d0-492d-afd8-7119bfce6332 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47242024-10-04T22:19:41.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4b5c9b93-85d0-492d-afd8-7119bfce6332 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47252024-10-04T22:19:41.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 4b5c9b93-85d0-492d-afd8-7119bfce6332 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47262024-10-04T22:19:42.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e2e512a8-e4eb-4258-b06f-a37b56ed1234 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47272024-10-04T22:19:42.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e2e512a8-e4eb-4258-b06f-a37b56ed1234 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47282024-10-04T22:19:42.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e2e512a8-e4eb-4258-b06f-a37b56ed1234 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47292024-10-04T22:19:43.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e6ce4e45-c26f-471a-9703-bccc7d44d30f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47302024-10-04T22:19:43.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e6ce4e45-c26f-471a-9703-bccc7d44d30f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47312024-10-04T22:19:43.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = e6ce4e45-c26f-471a-9703-bccc7d44d30f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47322024-10-04T22:19:44.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
47332024-10-04T22:19:44.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
47342024-10-04T22:19:44.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47352024-10-04T22:19:44.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47362024-10-04T22:19:44.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47372024-10-04T22:19:44.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47382024-10-04T22:19:44.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47392024-10-04T22:19:44.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47402024-10-04T22:19:44.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47412024-10-04T22:19:44.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.255345ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47422024-10-04T22:19:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47432024-10-04T22:19:44.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47442024-10-04T22:19:44.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47452024-10-04T22:19:44.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47462024-10-04T22:19:44.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47472024-10-04T22:19:44.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47482024-10-04T22:19:44.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
47492024-10-04T22:19:44.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47502024-10-04T22:19:44.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47512024-10-04T22:19:44.597ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
47522024-10-04T22:19:44.597ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.795935ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
47532024-10-04T22:19:44.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b7d634fb-528d-49e5-81c1-0b598079bdd3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47542024-10-04T22:19:44.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b7d634fb-528d-49e5-81c1-0b598079bdd3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47552024-10-04T22:19:44.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b7d634fb-528d-49e5-81c1-0b598079bdd3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47562024-10-04T22:19:45.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 86178436-b213-4b5f-9f1b-1c46416effa9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47572024-10-04T22:19:45.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 86178436-b213-4b5f-9f1b-1c46416effa9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47582024-10-04T22:19:45.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 86178436-b213-4b5f-9f1b-1c46416effa9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47592024-10-04T22:19:46.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5fb45c53-28b6-4711-8c4e-49f1c61a3b12 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47602024-10-04T22:19:46.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5fb45c53-28b6-4711-8c4e-49f1c61a3b12 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47612024-10-04T22:19:46.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5fb45c53-28b6-4711-8c4e-49f1c61a3b12 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47622024-10-04T22:19:47.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 15645e55-82ae-4d20-b472-4e31e924ec13 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47632024-10-04T22:19:47.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 15645e55-82ae-4d20-b472-4e31e924ec13 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47642024-10-04T22:19:47.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 15645e55-82ae-4d20-b472-4e31e924ec13 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47652024-10-04T22:19:48.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ec0b86b5-d3ea-48a8-9ef1-1dc1d5489e2c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47662024-10-04T22:19:48.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ec0b86b5-d3ea-48a8-9ef1-1dc1d5489e2c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47672024-10-04T22:19:48.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ec0b86b5-d3ea-48a8-9ef1-1dc1d5489e2c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47682024-10-04T22:19:49.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = edc44d6c-34cb-448c-8c5e-a62bd2a1f058 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47692024-10-04T22:19:49.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = edc44d6c-34cb-448c-8c5e-a62bd2a1f058 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47702024-10-04T22:19:49.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = edc44d6c-34cb-448c-8c5e-a62bd2a1f058 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47712024-10-04T22:19:50.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d46f68b8-7cdf-43eb-a042-4a527ae07a0d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47722024-10-04T22:19:50.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d46f68b8-7cdf-43eb-a042-4a527ae07a0d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47732024-10-04T22:19:50.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d46f68b8-7cdf-43eb-a042-4a527ae07a0d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47742024-10-04T22:19:51.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1369 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = d4ca6b82-1ca5-4cad-9082-5307f00d4e2d response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
47752024-10-04T22:19:51.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 11c32096-dce2-43a9-aa27-cbfdd2264533 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
47762024-10-04T22:19:51.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 11c32096-dce2-43a9-aa27-cbfdd2264533 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
47772024-10-04T22:19:51.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 11c32096-dce2-43a9-aa27-cbfdd2264533 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
47782024-10-04T22:19:51.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 67f4423d-a6a1-4284-961c-1e863175b943 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47792024-10-04T22:19:51.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 67f4423d-a6a1-4284-961c-1e863175b943 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47802024-10-04T22:19:51.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2462 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 67f4423d-a6a1-4284-961c-1e863175b943 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47812024-10-04T22:19:52.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a792a696-4817-424e-9cfe-52bb74908635 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47822024-10-04T22:19:52.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a792a696-4817-424e-9cfe-52bb74908635 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47832024-10-04T22:19:52.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = a792a696-4817-424e-9cfe-52bb74908635 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47842024-10-04T22:19:53.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1148e498-920c-4a80-a8cb-e9b8d7a73b15 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47852024-10-04T22:19:53.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1148e498-920c-4a80-a8cb-e9b8d7a73b15 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47862024-10-04T22:19:53.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1148e498-920c-4a80-a8cb-e9b8d7a73b15 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
47872024-10-04T22:19:54.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
47882024-10-04T22:19:54.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47892024-10-04T22:19:54.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
47902024-10-04T22:19:54.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47912024-10-04T22:19:54.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47922024-10-04T22:19:54.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47932024-10-04T22:19:54.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47942024-10-04T22:19:54.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47952024-10-04T22:19:54.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47962024-10-04T22:19:54.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47972024-10-04T22:19:54.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47982024-10-04T22:19:54.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47992024-10-04T22:19:54.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48002024-10-04T22:19:54.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48012024-10-04T22:19:54.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48022024-10-04T22:19:54.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
48032024-10-04T22:19:54.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48042024-10-04T22:19:54.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48052024-10-04T22:19:54.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
48062024-10-04T22:19:54.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.932468ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
48072024-10-04T22:19:54.605ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.675484ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48082024-10-04T22:19:54.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ff8ab454-0b17-4b52-91f2-b440fbb36ced roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48092024-10-04T22:19:54.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ff8ab454-0b17-4b52-91f2-b440fbb36ced resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48102024-10-04T22:19:54.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ff8ab454-0b17-4b52-91f2-b440fbb36ced response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48112024-10-04T22:19:55.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 69725266-a695-4805-8d54-811b7adc9ef9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48122024-10-04T22:19:55.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 69725266-a695-4805-8d54-811b7adc9ef9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48132024-10-04T22:19:55.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 69725266-a695-4805-8d54-811b7adc9ef9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48142024-10-04T22:19:56.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c6a62904-73a1-44ff-9741-564e8abbfb6d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48152024-10-04T22:19:56.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c6a62904-73a1-44ff-9741-564e8abbfb6d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48162024-10-04T22:19:56.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c6a62904-73a1-44ff-9741-564e8abbfb6d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48172024-10-04T22:19:57.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8cbc410e-485a-4a97-bcca-db6b5a2cb148 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48182024-10-04T22:19:57.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8cbc410e-485a-4a97-bcca-db6b5a2cb148 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48192024-10-04T22:19:57.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8cbc410e-485a-4a97-bcca-db6b5a2cb148 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48202024-10-04T22:19:58.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 34a0dbd6-69cd-4a24-bf98-612b9f7fa8cb roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48212024-10-04T22:19:58.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 34a0dbd6-69cd-4a24-bf98-612b9f7fa8cb resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48222024-10-04T22:19:58.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 34a0dbd6-69cd-4a24-bf98-612b9f7fa8cb response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48232024-10-04T22:19:59.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d010fdf9-362b-4e9b-91fc-9973f4edee56 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48242024-10-04T22:19:59.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d010fdf9-362b-4e9b-91fc-9973f4edee56 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48252024-10-04T22:19:59.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d010fdf9-362b-4e9b-91fc-9973f4edee56 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48262024-10-04T22:20:01.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10c6fbe4-6eb2-4e21-b6bf-484e93aa5ccb roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48272024-10-04T22:20:01.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10c6fbe4-6eb2-4e21-b6bf-484e93aa5ccb resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48282024-10-04T22:20:01.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 10c6fbe4-6eb2-4e21-b6bf-484e93aa5ccb response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48292024-10-04T22:20:01.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1373 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = cd9517eb-128d-4562-8337-7b81b98beb8f response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
48302024-10-04T22:20:02.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3cdb695d-0e7d-42be-9b26-4c71d1dea022 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48312024-10-04T22:20:02.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3cdb695d-0e7d-42be-9b26-4c71d1dea022 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48322024-10-04T22:20:02.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3cdb695d-0e7d-42be-9b26-4c71d1dea022 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48332024-10-04T22:20:03.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b54dbe6b-fcf6-40f4-897e-cf246113bf30 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48342024-10-04T22:20:03.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b54dbe6b-fcf6-40f4-897e-cf246113bf30 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48352024-10-04T22:20:03.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2708 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = b54dbe6b-fcf6-40f4-897e-cf246113bf30 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48362024-10-04T22:20:04.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f1e56132-3c5d-4042-8f93-57b45d556579 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48372024-10-04T22:20:04.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f1e56132-3c5d-4042-8f93-57b45d556579 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48382024-10-04T22:20:04.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f1e56132-3c5d-4042-8f93-57b45d556579 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
48392024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
48402024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48412024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
48422024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
48432024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48442024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
48452024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
48462024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
48472024-10-04T22:20:04.581ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 568e0899-5775-47c6-8a59-2b161d236a0c
48482024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.301\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
48492024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
48502024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
48512024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.88\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"568e0899-5775-47c6-8a59-2b161d236a0c"}
48522024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48532024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
48542024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
48552024-10-04T22:20:04.581ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-04 22:10:04.581153061 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
48562024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48572024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
48582024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
48592024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48602024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
48612024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48622024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48632024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
48642024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48652024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
48662024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
48672024-10-04T22:20:04.581ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
48682024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48692024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48702024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
48712024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
48722024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48732024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
48742024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48752024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.04\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
48762024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
48772024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48782024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
48792024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
48802024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48812024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
48822024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
48832024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48842024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
48852024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.991\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48862024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
48872024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
48882024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48892024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48902024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
48912024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48922024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
48932024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
48942024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48952024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
48962024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48972024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
48982024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
48992024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.33\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49002024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49012024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49022024-10-04T22:20:04.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49032024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49042024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49052024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49062024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49072024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49082024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49092024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49102024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49112024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49122024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49132024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49142024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49152024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49162024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49172024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49182024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49192024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49202024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49212024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49222024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49232024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49242024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49252024-10-04T22:20:04.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e5972f58-0215-4789-9de6-8c745fc8691c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fcb39657-4027-45f8-9b5b-fc09e764f468.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1202, tv_nsec: 883780627 } })
49262024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49272024-10-04T22:20:04.582ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("173a8178-efd5-4ec1-9f4c-a05bc972d94c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2cceb95f-37ad-478b-be36-e32fb96c3dd0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("8184f7df-5baa-40ae-9a32-5ef324ff5be3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1202, tv_nsec: 883780547 } })
49282024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49292024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49302024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49312024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49322024-10-04T22:20:04.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49332024-10-04T22:20:04.584ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49342024-10-04T22:20:04.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49352024-10-04T22:20:04.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
49362024-10-04T22:20:04.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.353627ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
49372024-10-04T22:20:04.585ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
49382024-10-04T22:20:04.585ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.689513ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
49392024-10-04T22:20:04.586ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.315256ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49402024-10-04T22:20:04.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49412024-10-04T22:20:04.592ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49422024-10-04T22:20:04.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49432024-10-04T22:20:04.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49442024-10-04T22:20:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49452024-10-04T22:20:04.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49462024-10-04T22:20:04.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49472024-10-04T22:20:04.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49482024-10-04T22:20:04.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49492024-10-04T22:20:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49502024-10-04T22:20:04.597ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49512024-10-04T22:20:04.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49522024-10-04T22:20:04.599ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-04 22:10:04.581153061 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49532024-10-04T22:20:04.599ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.49312ms iteration = 7 status = {"expiration":"2024-10-04T22:10:04.581153061Z","pruned":[]}
49542024-10-04T22:20:04.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49552024-10-04T22:20:04.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49562024-10-04T22:20:04.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49572024-10-04T22:20:04.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49582024-10-04T22:20:04.602ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49592024-10-04T22:20:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49602024-10-04T22:20:04.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49612024-10-04T22:20:04.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49622024-10-04T22:20:04.603ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1202, tv_nsec: 905290757 } })
49632024-10-04T22:20:04.604ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
49642024-10-04T22:20:04.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49652024-10-04T22:20:04.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49662024-10-04T22:20:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49672024-10-04T22:20:04.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49682024-10-04T22:20:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49692024-10-04T22:20:04.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49702024-10-04T22:20:04.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49712024-10-04T22:20:04.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49722024-10-04T22:20:04.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1202, tv_nsec: 911921119 } })
49732024-10-04T22:20:04.612ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
49742024-10-04T22:20:04.615ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 34.171522ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
49752024-10-04T22:20:04.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49762024-10-04T22:20:04.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49772024-10-04T22:20:04.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49782024-10-04T22:20:04.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49792024-10-04T22:20:04.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49802024-10-04T22:20:04.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49812024-10-04T22:20:04.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49822024-10-04T22:20:04.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49832024-10-04T22:20:04.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49842024-10-04T22:20:04.652ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49852024-10-04T22:20:04.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49862024-10-04T22:20:04.654ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49872024-10-04T22:20:04.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
49882024-10-04T22:20:04.655ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49892024-10-04T22:20:04.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49902024-10-04T22:20:04.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49912024-10-04T22:20:04.657ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49922024-10-04T22:20:04.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
49932024-10-04T22:20:04.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
49942024-10-04T22:20:04.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
49952024-10-04T22:20:04.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49962024-10-04T22:20:04.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49972024-10-04T22:20:04.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49982024-10-04T22:20:04.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49992024-10-04T22:20:04.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.696712ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50002024-10-04T22:20:04.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50012024-10-04T22:20:04.662ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50022024-10-04T22:20:04.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50032024-10-04T22:20:04.665ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50042024-10-04T22:20:04.665ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50052024-10-04T22:20:04.665ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50062024-10-04T22:20:04.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50072024-10-04T22:20:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
50082024-10-04T22:20:04.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
50092024-10-04T22:20:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
50102024-10-04T22:20:04.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50112024-10-04T22:20:04.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50122024-10-04T22:20:04.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50132024-10-04T22:20:04.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50142024-10-04T22:20:04.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50152024-10-04T22:20:04.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50162024-10-04T22:20:04.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50172024-10-04T22:20:04.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50182024-10-04T22:20:04.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50192024-10-04T22:20:04.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50202024-10-04T22:20:04.669ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50212024-10-04T22:20:04.669ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50222024-10-04T22:20:04.669ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50232024-10-04T22:20:04.669ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 88.087949ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50242024-10-04T22:20:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
50252024-10-04T22:20:04.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
50262024-10-04T22:20:04.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
50272024-10-04T22:20:04.671ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50282024-10-04T22:20:04.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50292024-10-04T22:20:04.672ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1202, tv_nsec: 974300355 } })
50302024-10-04T22:20:04.673ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50312024-10-04T22:20:04.673ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50322024-10-04T22:20:04.673ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50332024-10-04T22:20:04.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50342024-10-04T22:20:04.674ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
50352024-10-04T22:20:04.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
50362024-10-04T22:20:04.674ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
50372024-10-04T22:20:04.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
50382024-10-04T22:20:04.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50392024-10-04T22:20:04.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50402024-10-04T22:20:04.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50412024-10-04T22:20:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
50422024-10-04T22:20:04.677ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
50432024-10-04T22:20:04.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
50442024-10-04T22:20:04.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50452024-10-04T22:20:04.684ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 102.840165ms iteration = 4 status = {"nsuccess":5}
50462024-10-04T22:20:04.684ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50472024-10-04T22:20:04.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50482024-10-04T22:20:04.685ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50492024-10-04T22:20:04.685ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 104.019368ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50502024-10-04T22:20:04.702ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50512024-10-04T22:20:04.703ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
50522024-10-04T22:20:04.703ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 121.730762ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50532024-10-04T22:20:04.706ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50542024-10-04T22:20:04.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50552024-10-04T22:20:04.707ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50562024-10-04T22:20:04.707ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50572024-10-04T22:20:04.707ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50582024-10-04T22:20:04.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50592024-10-04T22:20:04.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50602024-10-04T22:20:04.711ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50612024-10-04T22:20:04.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50622024-10-04T22:20:04.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
50632024-10-04T22:20:04.716ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50642024-10-04T22:20:04.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50652024-10-04T22:20:04.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 135.790012ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50662024-10-04T22:20:04.718ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50672024-10-04T22:20:04.718ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50682024-10-04T22:20:04.718ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50692024-10-04T22:20:04.718ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50702024-10-04T22:20:04.718ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50712024-10-04T22:20:04.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50722024-10-04T22:20:04.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50732024-10-04T22:20:04.730ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50742024-10-04T22:20:04.730ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50752024-10-04T22:20:04.730ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.105339ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50762024-10-04T22:20:04.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50772024-10-04T22:20:04.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50782024-10-04T22:20:04.758ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
50792024-10-04T22:20:04.758ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50802024-10-04T22:20:04.759ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "01ff2ae1-427b-4fcc-9bc3-420d2025b9d3", "content-length": "26", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} })
50812024-10-04T22:20:04.759ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50822024-10-04T22:20:04.759ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
50832024-10-04T22:20:04.759ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50842024-10-04T22:20:04.760ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50852024-10-04T22:20:04.760ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc3cd3fb-b8ee-4cfe-82ce-fd009cc52b91", "content-length": "26", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} })
50862024-10-04T22:20:04.760ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50872024-10-04T22:20:04.761ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50882024-10-04T22:20:04.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50892024-10-04T22:20:04.790ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.608056ms iteration = 16 status = {"physical_disks_added":0}
50902024-10-04T22:20:04.875ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50912024-10-04T22:20:04.876ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4769e068-3926-4691-95ad-c4c3ebd05c99", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50922024-10-04T22:20:04.876ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50932024-10-04T22:20:04.878ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b1cd37f7-4d2f-4e57-894a-5ca4d1f7b1e7", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50942024-10-04T22:20:04.878ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50952024-10-04T22:20:04.880ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50962024-10-04T22:20:04.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 299.526123ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50972024-10-04T22:20:04.921ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50982024-10-04T22:20:04.921ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5a60981-233c-4147-a6ab-59b61735ae41", "content-length": "2", "date": "Fri, 04 Oct 2024 22:20:03 GMT"} })
50992024-10-04T22:20:04.922ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51002024-10-04T22:20:04.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51012024-10-04T22:20:04.958ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
51022024-10-04T22:20:04.958ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51032024-10-04T22:20:04.958ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd5b0656-b058-44e6-98f9-ac15d9fa6dac", "content-length": "26", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} })
51042024-10-04T22:20:04.958ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51052024-10-04T22:20:04.959ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
51062024-10-04T22:20:04.966ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51072024-10-04T22:20:04.966ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a936e04-dfc1-4607-b627-2ba3f81e2cbf", "content-length": "372", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} })
51082024-10-04T22:20:04.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51092024-10-04T22:20:04.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51102024-10-04T22:20:04.968ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51112024-10-04T22:20:04.970ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51122024-10-04T22:20:04.972ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51132024-10-04T22:20:04.972ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51142024-10-04T22:20:04.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
51152024-10-04T22:20:04.972ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51162024-10-04T22:20:04.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51172024-10-04T22:20:04.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51182024-10-04T22:20:04.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51192024-10-04T22:20:04.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51202024-10-04T22:20:04.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51212024-10-04T22:20:04.975ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 394.177494ms iteration = 13 status = null
51222024-10-04T22:20:04.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51232024-10-04T22:20:04.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51242024-10-04T22:20:04.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51252024-10-04T22:20:04.978ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 397.621183ms iteration = 13 status = 0
51262024-10-04T22:20:04.979ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
51272024-10-04T22:20:04.979ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 397.793066ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
51282024-10-04T22:20:04.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51292024-10-04T22:20:04.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51302024-10-04T22:20:04.983ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51312024-10-04T22:20:04.983ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ebd45d12-5c4c-4861-b884-27568e5520ec", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} })
51322024-10-04T22:20:04.984ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
51332024-10-04T22:20:04.985ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 404.747515ms iteration = 15 status = {}
51342024-10-04T22:20:04.986ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 404.97918ms iteration = 13 status = {}
51352024-10-04T22:20:04.999ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51362024-10-04T22:20:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51372024-10-04T22:20:05.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51382024-10-04T22:20:05.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51392024-10-04T22:20:05.006ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51402024-10-04T22:20:05.006ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 0 version = 2
51412024-10-04T22:20:05.006ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51422024-10-04T22:20:05.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51432024-10-04T22:20:05.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51442024-10-04T22:20:05.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51452024-10-04T22:20:05.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51462024-10-04T22:20:05.010ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-04T22:14:02.806172Z, time_modified: 2024-10-04T22:14:02.806172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5782a804-afa1-460e-b170-bf8495d7f170, db_silo: Silo { identity: SiloIdentity { id: 5782a804-afa1-460e-b170-bf8495d7f170, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-04T22:14:38.073736Z, time_modified: 2024-10-04T22:14:38.073736Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a" }] }) }
51472024-10-04T22:20:05.010ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 429.642733ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]}},"default_endpoint":{"silo_id":"5782a804-afa1-460e-b170-bf8495d7f170","tls_certs":["0ccd873ba34f33f85d31a40b1772ff947bff141de71c4487ce8d3975f380770a"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51482024-10-04T22:20:05.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51492024-10-04T22:20:05.012ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51502024-10-04T22:20:05.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51512024-10-04T22:20:05.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51522024-10-04T22:20:05.012ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51532024-10-04T22:20:05.012ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51542024-10-04T22:20:05.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51552024-10-04T22:20:05.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51562024-10-04T22:20:05.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51572024-10-04T22:20:05.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51582024-10-04T22:20:05.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51592024-10-04T22:20:05.014ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 80f5cb27-c38d-4b63-9877-f7934c22bf37 dns_zone_name = oxide.test found_so_far = 1 version = 2
51602024-10-04T22:20:05.014ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51612024-10-04T22:20:05.014ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-04 22:14:38.170044 UTC dns_group = external generation = 2
51622024-10-04T22:20:05.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 433.201684ms iteration = 8 status = {"generation":2}
51632024-10-04T22:20:05.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51642024-10-04T22:20:05.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51652024-10-04T22:20:05.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51662024-10-04T22:20:05.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51672024-10-04T22:20:05.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51682024-10-04T22:20:05.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51692024-10-04T22:20:05.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51702024-10-04T22:20:05.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51712024-10-04T22:20:05.020ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 77473140-f6cb-41e2-a33f-dd309e05790c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
51722024-10-04T22:20:05.020ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51732024-10-04T22:20:05.020ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-04 22:14:36.136216 UTC dns_group = internal generation = 1
51742024-10-04T22:20:05.020ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 439.384937ms iteration = 8 status = {"generation":1}
51752024-10-04T22:20:05.055ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
51762024-10-04T22:20:05.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 474.323315ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51772024-10-04T22:20:05.058ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51782024-10-04T22:20:05.058ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d706f034-8ecd-46f5-b1fc-f2a1951df43d", "date": "Fri, 04 Oct 2024 22:20:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51792024-10-04T22:20:05.058ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51802024-10-04T22:20:05.060ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3e9977fd-7793-4ba1-bf5d-904fbaf2dccd", "date": "Fri, 04 Oct 2024 22:20:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51812024-10-04T22:20:05.060ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51822024-10-04T22:20:05.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9d4b01f2-bee5-4e15-be5c-3eaa29e2e8f2", "date": "Fri, 04 Oct 2024 22:20:05 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51832024-10-04T22:20:05.062ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51842024-10-04T22:20:05.064ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
51852024-10-04T22:20:05.064ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 483.60524ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
51862024-10-04T22:20:05.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1dff11bf-f9bb-4619-bb45-3ef2ee8d28a1 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
51872024-10-04T22:20:05.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1dff11bf-f9bb-4619-bb45-3ef2ee8d28a1 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
51882024-10-04T22:20:05.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1dff11bf-f9bb-4619-bb45-3ef2ee8d28a1 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
51892024-10-04T22:20:05.111ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51902024-10-04T22:20:05.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51912024-10-04T22:20:05.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51922024-10-04T22:20:05.111ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c567cf8e-2d49-49be-82c3-945d1c9d7455", "content-length": "691", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} })
51932024-10-04T22:20:05.111ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51942024-10-04T22:20:05.111ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51952024-10-04T22:20:05.111ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51962024-10-04T22:20:05.113ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 531.944376ms iteration = 14 status = {}
51972024-10-04T22:20:05.113ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
51982024-10-04T22:20:05.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51992024-10-04T22:20:05.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52002024-10-04T22:20:05.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52012024-10-04T22:20:05.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f91dd26d-6c3c-42ba-ace8-57fc9a4df02e", "content-length": "121", "date": "Fri, 04 Oct 2024 22:20:05 GMT"} })
52022024-10-04T22:20:05.121ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
52032024-10-04T22:20:05.121ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
52042024-10-04T22:20:05.121ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52052024-10-04T22:20:05.121ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52062024-10-04T22:20:05.121ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
52072024-10-04T22:20:05.121ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
52082024-10-04T22:20:05.121ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
52092024-10-04T22:20:05.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52102024-10-04T22:20:05.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52112024-10-04T22:20:05.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52122024-10-04T22:20:05.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "99f2599f-12bc-4051-b0f0-5bd7c368d4a0", "content-length": "2", "date": "Fri, 04 Oct 2024 22:20:05 GMT"} })
52132024-10-04T22:20:05.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52142024-10-04T22:20:05.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ede4afa-b2a5-4f01-b9f3-232e13ae1286", "content-length": "52", "date": "Fri, 04 Oct 2024 22:20:05 GMT"} })
52152024-10-04T22:20:05.124ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
52162024-10-04T22:20:05.124ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52172024-10-04T22:20:05.210ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fbcc1f73-1e1c-4981-a97b-045616b82ae2", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} })
52182024-10-04T22:20:05.210ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
52192024-10-04T22:20:05.210ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52202024-10-04T22:20:05.211ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "711c2cc3-18ca-4c64-b958-9932490cbd62", "content-length": "667", "date": "Fri, 04 Oct 2024 22:20:04 GMT"} })
52212024-10-04T22:20:05.211ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52222024-10-04T22:20:05.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52232024-10-04T22:20:05.215ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52242024-10-04T22:20:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52252024-10-04T22:20:05.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52262024-10-04T22:20:05.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52272024-10-04T22:20:05.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52282024-10-04T22:20:05.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52292024-10-04T22:20:05.228ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 646.79078ms iteration = 13 status = {}
52302024-10-04T22:20:06.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c41fbfd1-2ec3-4fba-8027-661427eccd66 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52312024-10-04T22:20:06.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c41fbfd1-2ec3-4fba-8027-661427eccd66 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52322024-10-04T22:20:06.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c41fbfd1-2ec3-4fba-8027-661427eccd66 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52332024-10-04T22:20:07.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 45d532c0-f027-4568-9855-27775ad9abc8 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52342024-10-04T22:20:07.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 45d532c0-f027-4568-9855-27775ad9abc8 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52352024-10-04T22:20:07.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 45d532c0-f027-4568-9855-27775ad9abc8 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52362024-10-04T22:20:08.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bf157b66-fbfd-4d48-a064-39530cfdb93c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52372024-10-04T22:20:08.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bf157b66-fbfd-4d48-a064-39530cfdb93c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52382024-10-04T22:20:08.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bf157b66-fbfd-4d48-a064-39530cfdb93c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52392024-10-04T22:20:09.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1b924055-8d35-475c-8515-b84702797b9b roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52402024-10-04T22:20:09.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1b924055-8d35-475c-8515-b84702797b9b resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52412024-10-04T22:20:09.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1b924055-8d35-475c-8515-b84702797b9b response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52422024-10-04T22:20:10.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64942747-dd53-467a-abf9-bc0b1f19c283 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52432024-10-04T22:20:10.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64942747-dd53-467a-abf9-bc0b1f19c283 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52442024-10-04T22:20:10.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64942747-dd53-467a-abf9-bc0b1f19c283 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52452024-10-04T22:20:11.083ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1388 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 69f14586-6bac-41a4-ad1f-f91f6a80906f response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
52462024-10-04T22:20:11.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 60350925-64fe-4cde-a9fa-2d60e94107c7 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52472024-10-04T22:20:11.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 60350925-64fe-4cde-a9fa-2d60e94107c7 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52482024-10-04T22:20:11.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 60350925-64fe-4cde-a9fa-2d60e94107c7 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52492024-10-04T22:20:12.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5092bc27-fd97-4929-8eb4-a96b5e785a39 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52502024-10-04T22:20:12.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5092bc27-fd97-4929-8eb4-a96b5e785a39 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52512024-10-04T22:20:12.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5092bc27-fd97-4929-8eb4-a96b5e785a39 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52522024-10-04T22:20:13.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ca20ba27-578f-4c7d-bdab-3f7d81c99de6 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52532024-10-04T22:20:13.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ca20ba27-578f-4c7d-bdab-3f7d81c99de6 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52542024-10-04T22:20:13.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = ca20ba27-578f-4c7d-bdab-3f7d81c99de6 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52552024-10-04T22:20:14.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3d49af8e-97ab-480b-9ef5-d0f51f4c125e roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52562024-10-04T22:20:14.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3d49af8e-97ab-480b-9ef5-d0f51f4c125e resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52572024-10-04T22:20:14.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 3d49af8e-97ab-480b-9ef5-d0f51f4c125e response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52582024-10-04T22:20:14.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
52592024-10-04T22:20:14.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52602024-10-04T22:20:14.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
52612024-10-04T22:20:14.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52622024-10-04T22:20:14.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52632024-10-04T22:20:14.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52642024-10-04T22:20:14.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52652024-10-04T22:20:14.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52662024-10-04T22:20:14.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52672024-10-04T22:20:14.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52682024-10-04T22:20:14.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52692024-10-04T22:20:14.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52702024-10-04T22:20:14.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52712024-10-04T22:20:14.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
52722024-10-04T22:20:14.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52732024-10-04T22:20:14.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52742024-10-04T22:20:14.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
52752024-10-04T22:20:14.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.973749ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
52762024-10-04T22:20:14.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52772024-10-04T22:20:14.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52782024-10-04T22:20:14.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.436539ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52792024-10-04T22:20:15.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d72b6195-1edc-46ba-86d9-435e055b9907 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52802024-10-04T22:20:15.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d72b6195-1edc-46ba-86d9-435e055b9907 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52812024-10-04T22:20:15.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d72b6195-1edc-46ba-86d9-435e055b9907 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52822024-10-04T22:20:16.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5b3a4da5-7cd3-4c01-b80f-a198ec241a64 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52832024-10-04T22:20:16.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5b3a4da5-7cd3-4c01-b80f-a198ec241a64 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52842024-10-04T22:20:16.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5b3a4da5-7cd3-4c01-b80f-a198ec241a64 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52852024-10-04T22:20:17.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fac51e9c-99c4-4ccf-831f-be58d1a85c8c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52862024-10-04T22:20:17.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fac51e9c-99c4-4ccf-831f-be58d1a85c8c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52872024-10-04T22:20:17.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fac51e9c-99c4-4ccf-831f-be58d1a85c8c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52882024-10-04T22:20:18.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c6dcc8d5-0453-4143-91da-8b87f4ddcbbb roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52892024-10-04T22:20:18.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c6dcc8d5-0453-4143-91da-8b87f4ddcbbb resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52902024-10-04T22:20:18.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c6dcc8d5-0453-4143-91da-8b87f4ddcbbb response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52912024-10-04T22:20:19.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64da52d1-0549-4b18-ba0a-352face6f51d roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52922024-10-04T22:20:19.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64da52d1-0549-4b18-ba0a-352face6f51d resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52932024-10-04T22:20:19.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 64da52d1-0549-4b18-ba0a-352face6f51d response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52942024-10-04T22:20:20.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8b4d6a39-3297-48e1-bd9b-c57f997c640e roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52952024-10-04T22:20:20.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8b4d6a39-3297-48e1-bd9b-c57f997c640e resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52962024-10-04T22:20:20.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8b4d6a39-3297-48e1-bd9b-c57f997c640e response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52972024-10-04T22:20:21.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1564 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = d67ef880-6718-4fed-b9c5-d83ef746bedd response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
52982024-10-04T22:20:21.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8628787b-cb55-4b16-a80f-cbc3efacb9a9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
52992024-10-04T22:20:21.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8628787b-cb55-4b16-a80f-cbc3efacb9a9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53002024-10-04T22:20:21.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8628787b-cb55-4b16-a80f-cbc3efacb9a9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53012024-10-04T22:20:21.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 7f1c2cdb-5c34-4a2e-bb13-cfff53bfcd23 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
53022024-10-04T22:20:21.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 7f1c2cdb-5c34-4a2e-bb13-cfff53bfcd23 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
53032024-10-04T22:20:21.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:35179 req_id = 7f1c2cdb-5c34-4a2e-bb13-cfff53bfcd23 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
53042024-10-04T22:20:22.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fefda108-9a62-4f21-a35b-e441478e3e29 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53052024-10-04T22:20:22.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fefda108-9a62-4f21-a35b-e441478e3e29 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53062024-10-04T22:20:22.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = fefda108-9a62-4f21-a35b-e441478e3e29 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53072024-10-04T22:20:23.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f994f67-b0f9-4132-9bcd-97074974cdd6 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53082024-10-04T22:20:23.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f994f67-b0f9-4132-9bcd-97074974cdd6 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53092024-10-04T22:20:23.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8f994f67-b0f9-4132-9bcd-97074974cdd6 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53102024-10-04T22:20:24.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8b70247b-fd44-45d2-9afc-1df90c45a33e roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53112024-10-04T22:20:24.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8b70247b-fd44-45d2-9afc-1df90c45a33e resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53122024-10-04T22:20:24.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8b70247b-fd44-45d2-9afc-1df90c45a33e response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53132024-10-04T22:20:24.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
53142024-10-04T22:20:24.580ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
53152024-10-04T22:20:24.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53162024-10-04T22:20:24.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53172024-10-04T22:20:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53182024-10-04T22:20:24.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53192024-10-04T22:20:24.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53202024-10-04T22:20:24.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53212024-10-04T22:20:24.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53222024-10-04T22:20:24.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53232024-10-04T22:20:24.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53242024-10-04T22:20:24.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53252024-10-04T22:20:24.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262024-10-04T22:20:24.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
53272024-10-04T22:20:24.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53282024-10-04T22:20:24.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53292024-10-04T22:20:24.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
53302024-10-04T22:20:24.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.001739ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
53312024-10-04T22:20:24.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53322024-10-04T22:20:24.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53332024-10-04T22:20:24.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.690513ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53342024-10-04T22:20:25.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c0720ab-f830-497a-966f-fb7aefacf3a6 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53352024-10-04T22:20:25.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c0720ab-f830-497a-966f-fb7aefacf3a6 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53362024-10-04T22:20:25.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1c0720ab-f830-497a-966f-fb7aefacf3a6 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53372024-10-04T22:20:26.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7cffc040-1b27-4a1e-b2b2-a538a11133bd roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53382024-10-04T22:20:26.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7cffc040-1b27-4a1e-b2b2-a538a11133bd resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53392024-10-04T22:20:26.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 7cffc040-1b27-4a1e-b2b2-a538a11133bd response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53402024-10-04T22:20:27.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 497f8ea7-76a4-466f-b67a-153b977920c9 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53412024-10-04T22:20:27.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 497f8ea7-76a4-466f-b67a-153b977920c9 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53422024-10-04T22:20:27.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 497f8ea7-76a4-466f-b67a-153b977920c9 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53432024-10-04T22:20:28.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d576e285-4048-4773-8df4-9c8be98f8ac4 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53442024-10-04T22:20:28.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d576e285-4048-4773-8df4-9c8be98f8ac4 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53452024-10-04T22:20:28.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = d576e285-4048-4773-8df4-9c8be98f8ac4 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53462024-10-04T22:20:29.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bebc53b9-a117-4eea-a6ab-26ae0ef00c0c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53472024-10-04T22:20:29.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bebc53b9-a117-4eea-a6ab-26ae0ef00c0c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53482024-10-04T22:20:29.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = bebc53b9-a117-4eea-a6ab-26ae0ef00c0c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53492024-10-04T22:20:30.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c16894b8-5c4b-4733-bde2-9e75115ff1d3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53502024-10-04T22:20:30.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c16894b8-5c4b-4733-bde2-9e75115ff1d3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53512024-10-04T22:20:30.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = c16894b8-5c4b-4733-bde2-9e75115ff1d3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53522024-10-04T22:20:31.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 479e2024-e5e7-4436-bda7-2fa250c07d21 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
53532024-10-04T22:20:31.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1947b558-2b02-4157-924e-9f89411b9203 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53542024-10-04T22:20:31.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1947b558-2b02-4157-924e-9f89411b9203 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53552024-10-04T22:20:31.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1947b558-2b02-4157-924e-9f89411b9203 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53562024-10-04T22:20:32.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5af8f614-9016-497c-a57f-073e36d29163 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53572024-10-04T22:20:32.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5af8f614-9016-497c-a57f-073e36d29163 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53582024-10-04T22:20:32.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 5af8f614-9016-497c-a57f-073e36d29163 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53592024-10-04T22:20:33.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66368cac-5214-46f8-ad97-8ba6ec0f91e6 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53602024-10-04T22:20:33.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66368cac-5214-46f8-ad97-8ba6ec0f91e6 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53612024-10-04T22:20:33.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 66368cac-5214-46f8-ad97-8ba6ec0f91e6 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
53622024-10-04T22:20:34.580ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
53632024-10-04T22:20:34.580ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
53642024-10-04T22:20:34.580ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53652024-10-04T22:20:34.580ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53662024-10-04T22:20:34.580ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53672024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
53682024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
53692024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.29\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
53702024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
53712024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53722024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
53732024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.961\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
53742024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
53752024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
53762024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53772024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53782024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53792024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
53802024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53812024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
53822024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
53832024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.491\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
53842024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.7\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
53852024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
53862024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
53872024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53882024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
53892024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
53902024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
53912024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53922024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53932024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
53942024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53952024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53962024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53972024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53982024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53992024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54002024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54012024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54022024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54032024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54042024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54052024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54062024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54072024-10-04T22:20:34.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54082024-10-04T22:20:34.583ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.430518ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54092024-10-04T22:20:34.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1232, tv_nsec: 885362318 } })
54102024-10-04T22:20:34.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54112024-10-04T22:20:34.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54122024-10-04T22:20:34.584ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
54132024-10-04T22:20:34.585ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54142024-10-04T22:20:34.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54152024-10-04T22:20:34.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54162024-10-04T22:20:34.586ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54172024-10-04T22:20:34.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54182024-10-04T22:20:34.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54192024-10-04T22:20:34.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54202024-10-04T22:20:34.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54212024-10-04T22:20:34.588ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222024-10-04T22:20:34.590ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1232, tv_nsec: 891832988 } })
54232024-10-04T22:20:34.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54242024-10-04T22:20:34.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
54252024-10-04T22:20:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54262024-10-04T22:20:34.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54272024-10-04T22:20:34.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54282024-10-04T22:20:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54292024-10-04T22:20:34.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54302024-10-04T22:20:34.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54312024-10-04T22:20:34.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54322024-10-04T22:20:34.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.435048ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54332024-10-04T22:20:34.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54342024-10-04T22:20:34.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54352024-10-04T22:20:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54362024-10-04T22:20:34.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54372024-10-04T22:20:34.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54382024-10-04T22:20:34.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54392024-10-04T22:20:34.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54402024-10-04T22:20:34.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54412024-10-04T22:20:34.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54422024-10-04T22:20:34.605ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54432024-10-04T22:20:34.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54442024-10-04T22:20:34.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54452024-10-04T22:20:34.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54462024-10-04T22:20:34.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-544b0af3-4a18-4467-8697-af690997796e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1232, tv_nsec: 910973690 } })
54472024-10-04T22:20:34.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
54482024-10-04T22:20:34.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54492024-10-04T22:20:34.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54502024-10-04T22:20:34.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54512024-10-04T22:20:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54522024-10-04T22:20:34.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54532024-10-04T22:20:34.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54542024-10-04T22:20:34.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54552024-10-04T22:20:34.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54562024-10-04T22:20:34.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54572024-10-04T22:20:34.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54582024-10-04T22:20:34.631ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54592024-10-04T22:20:34.631ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54602024-10-04T22:20:34.631ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54612024-10-04T22:20:34.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54622024-10-04T22:20:34.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-10-04T22:20:34.634ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54642024-10-04T22:20:34.634ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54652024-10-04T22:20:34.634ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54662024-10-04T22:20:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54672024-10-04T22:20:34.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54682024-10-04T22:20:34.635ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54692024-10-04T22:20:34.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54702024-10-04T22:20:34.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54712024-10-04T22:20:34.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54722024-10-04T22:20:34.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54732024-10-04T22:20:34.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.802944ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54742024-10-04T22:20:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 568e0899-5775-47c6-8a59-2b161d236a0c, lookup_type: ById(568e0899-5775-47c6-8a59-2b161d236a0c) } result = Ok(())
54752024-10-04T22:20:34.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54762024-10-04T22:20:34.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54772024-10-04T22:20:34.643ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54782024-10-04T22:20:34.643ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.772054ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54792024-10-04T22:20:34.652ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 568e0899-5775-47c6-8a59-2b161d236a0c original_time_created = 2024-10-04 22:13:55.162669 UTC target_id = 568e0899-5775-47c6-8a59-2b161d236a0c time_created = 2024-10-04 22:13:55.162669 UTC
54802024-10-04T22:20:34.652ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.609161ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"568e0899-5775-47c6-8a59-2b161d236a0c","time_created":"2024-10-04T22:13:55.162669Z"}
54812024-10-04T22:20:34.653ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 72.436867ms iteration = 17 status = {"physical_disks_added":0}
54822024-10-04T22:20:34.653ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
54832024-10-04T22:20:34.653ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54842024-10-04T22:20:34.653ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "986bbdc2-da4b-404f-9ca7-b89d957eb585", "content-length": "26", "date": "Fri, 04 Oct 2024 22:20:33 GMT"} })
54852024-10-04T22:20:34.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54862024-10-04T22:20:34.655ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54872024-10-04T22:20:34.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54882024-10-04T22:20:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 544b0af3-4a18-4467-8697-af690997796e, lookup_type: ById(544b0af3-4a18-4467-8697-af690997796e) } result = Ok(())
54892024-10-04T22:20:34.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54902024-10-04T22:20:34.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54912024-10-04T22:20:34.673ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 92.427746ms iteration = 14 status = 0
54922024-10-04T22:20:34.677ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54932024-10-04T22:20:34.677ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54942024-10-04T22:20:34.677ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.754263ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54952024-10-04T22:20:34.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54962024-10-04T22:20:34.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54972024-10-04T22:20:34.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54982024-10-04T22:20:34.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54992024-10-04T22:20:34.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55002024-10-04T22:20:34.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55012024-10-04T22:20:34.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55022024-10-04T22:20:34.721ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55032024-10-04T22:20:34.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55042024-10-04T22:20:34.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55052024-10-04T22:20:34.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 91cf64af-f8bb-45c3-bb29-3211d523b69c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55062024-10-04T22:20:34.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 91cf64af-f8bb-45c3-bb29-3211d523b69c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55072024-10-04T22:20:34.780ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55082024-10-04T22:20:34.780ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d30a7e6-a676-4be6-bbce-f9ff6349fe36", "content-length": "2", "date": "Fri, 04 Oct 2024 22:20:33 GMT"} })
55092024-10-04T22:20:34.781ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55102024-10-04T22:20:34.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55112024-10-04T22:20:34.801ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
55122024-10-04T22:20:34.801ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55132024-10-04T22:20:34.801ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b10ece5-3ffe-42dd-8064-19e7da75aaf7", "content-length": "26", "date": "Fri, 04 Oct 2024 22:20:33 GMT"} })
55142024-10-04T22:20:34.801ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55152024-10-04T22:20:34.803ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55162024-10-04T22:20:34.865ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 zone_address = fd00:1122:3344:101::2
55172024-10-04T22:20:34.865ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55182024-10-04T22:20:34.866ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47a19a2d-1db4-4cb0-a849-dc9dce114d43", "content-length": "26", "date": "Fri, 04 Oct 2024 22:20:33 GMT"} })
55192024-10-04T22:20:34.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55202024-10-04T22:20:34.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
55212024-10-04T22:20:34.898ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 317.827209ms iteration = 14 status = {}
55222024-10-04T22:20:34.915ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55232024-10-04T22:20:34.916ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2644d693-3c16-4307-9053-e5d1147001c1", "content-length": "372", "date": "Fri, 04 Oct 2024 22:20:34 GMT"} })
55242024-10-04T22:20:34.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55252024-10-04T22:20:34.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55262024-10-04T22:20:34.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 195254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 91cf64af-f8bb-45c3-bb29-3211d523b69c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55272024-10-04T22:20:34.918ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 337.992621ms iteration = 14 status = null
55282024-10-04T22:20:34.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55292024-10-04T22:20:34.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55302024-10-04T22:20:34.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55312024-10-04T22:20:34.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55322024-10-04T22:20:34.925ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55332024-10-04T22:20:34.926ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "91a308ae-fd4f-4b18-951e-a660087f4141", "date": "Fri, 04 Oct 2024 22:20:34 GMT"} })
55342024-10-04T22:20:34.928ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 347.327648ms iteration = 16 status = {}
55352024-10-04T22:20:35.056ZDEBGnexus (BackgroundTasks): client request SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55362024-10-04T22:20:35.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55372024-10-04T22:20:35.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55382024-10-04T22:20:35.061ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 27f14747-4e9b-45e4-a5f0-e4201aabf2b5, rack_id: 4cb5ec19-6817-424a-9a2f-064289331fa0, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5) } rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
55392024-10-04T22:20:35.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55402024-10-04T22:20:35.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55412024-10-04T22:20:35.071ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55422024-10-04T22:20:35.072ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8818994f-6260-4e49-9bd6-62ebe969abc2", "content-length": "121", "date": "Fri, 04 Oct 2024 22:20:34 GMT"} })
55432024-10-04T22:20:35.072ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
55442024-10-04T22:20:35.072ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 0a68c84a-a9c4-4647-8f3c-0f6d1b7347f5
55452024-10-04T22:20:35.072ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55462024-10-04T22:20:35.072ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55472024-10-04T22:20:35.072ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
55482024-10-04T22:20:35.072ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 routes = {}
55492024-10-04T22:20:35.072ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0
55502024-10-04T22:20:35.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55512024-10-04T22:20:35.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55522024-10-04T22:20:35.075ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55532024-10-04T22:20:35.075ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0613bbd9-79d1-4d47-80ef-325d881109b1", "content-length": "2", "date": "Fri, 04 Oct 2024 22:20:34 GMT"} })
55542024-10-04T22:20:35.075ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55552024-10-04T22:20:35.075ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aae5948d-6f9e-486f-98e5-456788d5caea", "content-length": "52", "date": "Fri, 04 Oct 2024 22:20:34 GMT"} })
55562024-10-04T22:20:35.075ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch_location = Switch0
55572024-10-04T22:20:35.075ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55582024-10-04T22:20:35.121ZDEBGnexus (BackgroundTasks): client response SledAgent = 544b0af3-4a18-4467-8697-af690997796e background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59ead360-6f8b-491d-81a7-328a28a6c63d", "content-length": "691", "date": "Fri, 04 Oct 2024 22:20:35 GMT"} })
55592024-10-04T22:20:35.121ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55602024-10-04T22:20:35.121ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55612024-10-04T22:20:35.121ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55622024-10-04T22:20:35.123ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 542.17331ms iteration = 15 status = {}
55632024-10-04T22:20:35.205ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e01d0ecc-ed40-48f4-9520-599528513782", "date": "Fri, 04 Oct 2024 22:20:34 GMT"} })
55642024-10-04T22:20:35.205ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 switch = Switch0
55652024-10-04T22:20:35.205ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55662024-10-04T22:20:35.205ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 4cb5ec19-6817-424a-9a2f-064289331fa0 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "02c26ef7-16d5-4248-a3e6-0652f1a11145", "content-length": "667", "date": "Fri, 04 Oct 2024 22:20:35 GMT"} })
55672024-10-04T22:20:35.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55682024-10-04T22:20:35.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55692024-10-04T22:20:35.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55702024-10-04T22:20:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55712024-10-04T22:20:35.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55722024-10-04T22:20:35.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55732024-10-04T22:20:35.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55742024-10-04T22:20:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55752024-10-04T22:20:35.222ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.131767ms iteration = 14 status = {}
55762024-10-04T22:20:35.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 48df712b-f879-445b-bf80-e0be29434a2f roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55772024-10-04T22:20:35.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 48df712b-f879-445b-bf80-e0be29434a2f resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55782024-10-04T22:20:35.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 48df712b-f879-445b-bf80-e0be29434a2f response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55792024-10-04T22:20:36.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 32aba0e5-adb0-489c-82d5-c82cb0776352 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55802024-10-04T22:20:36.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 32aba0e5-adb0-489c-82d5-c82cb0776352 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55812024-10-04T22:20:36.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 32aba0e5-adb0-489c-82d5-c82cb0776352 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55822024-10-04T22:20:37.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = be874907-61f1-4566-bf3a-bcaa6e9a264e roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55832024-10-04T22:20:37.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = be874907-61f1-4566-bf3a-bcaa6e9a264e resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55842024-10-04T22:20:37.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = be874907-61f1-4566-bf3a-bcaa6e9a264e response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55852024-10-04T22:20:39.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8bad5ac2-65a9-492d-a698-eec31f8fdea1 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55862024-10-04T22:20:39.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8bad5ac2-65a9-492d-a698-eec31f8fdea1 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55872024-10-04T22:20:39.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 8bad5ac2-65a9-492d-a698-eec31f8fdea1 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55882024-10-04T22:20:40.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9abb1b7e-8841-4084-b71b-67c8c42edea6 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55892024-10-04T22:20:40.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9abb1b7e-8841-4084-b71b-67c8c42edea6 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55902024-10-04T22:20:40.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 9abb1b7e-8841-4084-b71b-67c8c42edea6 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55912024-10-04T22:20:41.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f1719d0b-d62c-4ae4-83f9-4d4cb90245b3 roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55922024-10-04T22:20:41.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f1719d0b-d62c-4ae4-83f9-4d4cb90245b3 resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55932024-10-04T22:20:41.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = f1719d0b-d62c-4ae4-83f9-4d4cb90245b3 response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55942024-10-04T22:20:41.084ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1607 local_addr = [fd00:1122:3344:101::c]:50804 method = GET remote_addr = [fd00:1122:3344:101::d]:41656 req_id = 32b6d0be-16ef-4a52-b53c-273fea472ad8 response_code = 200 uri = /46d21628-a828-4b09-b280-d1af35f56206
55952024-10-04T22:20:42.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1b57a841-70cb-448a-b99b-b6db12919c0c roles = RoleSet { roles: {} } uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55962024-10-04T22:20:42.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1b57a841-70cb-448a-b99b-b6db12919c0c resource = Database result = Ok(()) uri = /probes/544b0af3-4a18-4467-8697-af690997796e
55972024-10-04T22:20:42.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:63560 req_id = 1b57a841-70cb-448a-b99b-b6db12919c0c response_code = 200 uri = /probes/544b0af3-4a18-4467-8697-af690997796e