Max level shown:
1 [ Oct 31 20:17:02 Enabled. ]
2 [ Oct 31 20:17:02 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Oct 31 20:17:02 Method "start" exited with status 0. ]
4 [ Oct 31 20:17:02 Rereading configuration. ]
5 [ Oct 31 20:17:02 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-10-31T20:17:02.442ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-10-31T20:17:02.442ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-10-31T20:17:02.496ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-10-31T20:17:02.496ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-10-31T20:17:02.611ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-10-31T20:17:02.621ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-10-31T20:17:02.628ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-10-31T20:17:03.230ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-10-31T20:17:03.371ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-10-31T20:17:03.371ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-10-31T20:17:03.371ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-10-31T20:17:03.371ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-10-31T20:17:03.371ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-10-31T20:17:03.371ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-10-31T20:17:03.374ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-10-31T20:17:03.374ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-10-31T20:17:03.374ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-10-31T20:17:03.374ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-10-31T20:17:03.374ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-10-31T20:17:03.374ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-10-31T20:17:03.374ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
282024-10-31T20:17:03.374ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-10-31T20:17:03.374ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-10-31T20:17:03.385ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-10-31T20:17:03.385ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool)
322024-10-31T20:17:03.484ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal }
332024-10-31T20:17:03.868ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
342024-10-31T20:17:03.868ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-10-31T20:17:03.868ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-10-31T20:17:03.868ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-10-31T20:17:03.868ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
382024-10-31T20:17:03.868ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-10-31T20:17:03.868ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-10-31T20:17:03.876ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-10-31T20:17:03.876ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool)
422024-10-31T20:17:03.959ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal }
432024-10-31T20:17:04.339ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-10-31T20:17:04.339ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-10-31T20:17:04.339ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
462024-10-31T20:17:04.339ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
472024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
482024-10-31T20:17:04.339ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
492024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
502024-10-31T20:17:04.339ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
512024-10-31T20:17:04.339ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
522024-10-31T20:17:04.339ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
532024-10-31T20:17:04.339ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
542024-10-31T20:17:04.339ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
552024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
562024-10-31T20:17:04.339ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
572024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
582024-10-31T20:17:04.339ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
592024-10-31T20:17:04.339ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
602024-10-31T20:17:04.339ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
612024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
622024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
632024-10-31T20:17:04.339ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-10-31T20:17:04.339ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
652024-10-31T20:17:04.339ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
662024-10-31T20:17:04.339ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
672024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
682024-10-31T20:17:04.339ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
692024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
702024-10-31T20:17:04.339ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
712024-10-31T20:17:04.339ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
722024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
732024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
742024-10-31T20:17:04.339ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
752024-10-31T20:17:04.339ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-10-31T20:17:04.339ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
772024-10-31T20:17:04.339ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
782024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
792024-10-31T20:17:04.339ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
802024-10-31T20:17:04.339ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
812024-10-31T20:17:04.339ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822024-10-31T20:17:04.339ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
832024-10-31T20:17:04.340ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
842024-10-31T20:17:04.340ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
852024-10-31T20:17:04.340ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
862024-10-31T20:17:04.340ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
872024-10-31T20:17:04.340ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-10-31T20:17:04.340ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-10-31T20:17:04.340ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:451
902024-10-31T20:17:04.340ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
912024-10-31T20:17:04.340ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
922024-10-31T20:17:04.340ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
932024-10-31T20:17:04.340ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942024-10-31T20:17:04.340ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
952024-10-31T20:17:04.340ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
962024-10-31T20:17:04.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
972024-10-31T20:17:04.340ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
982024-10-31T20:17:04.340ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992024-10-31T20:17:04.340ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-10-31T20:17:04.340ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012024-10-31T20:17:04.340ZINFOSledAgent (bootstore): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1022024-10-31T20:17:04.340ZINFOSledAgent (bootstore): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1032024-10-31T20:17:04.340ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1042024-10-31T20:17:04.340ZINFOSledAgent (bootstore): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-10-31T20:17:04.340ZINFOSledAgent (bootstore): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-10-31T20:17:04.340ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1072024-10-31T20:17:04.340ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082024-10-31T20:17:04.340ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092024-10-31T20:17:04.351ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:733
1102024-10-31T20:17:04.351ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1337, tv_nsec: 454591189 } time_to_next_cleanup = 599.999923178s
1112024-10-31T20:17:04.351ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
1122024-10-31T20:17:04.351ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1132024-10-31T20:17:04.351ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/sled-agent-request.json file = common/src/ledger.rs:188
1142024-10-31T20:17:04.351ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/sled-agent-request.json file = common/src/ledger.rs:188
1152024-10-31T20:17:04.355ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1162024-10-31T20:17:04.356ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1172024-10-31T20:17:04.357ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1074
1182024-10-31T20:17:04.357ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1192024-10-31T20:17:04.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1202024-10-31T20:17:04.357ZINFOSledAgent (RSS): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1212024-10-31T20:17:04.357ZINFOSledAgent (RSS): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1222024-10-31T20:17:04.357ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1137
1232024-10-31T20:17:04.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1242024-10-31T20:17:04.357ZINFOSledAgent (RSS): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/rss-sled-plan.json file = common/src/ledger.rs:188
1252024-10-31T20:17:04.357ZINFOSledAgent (RSS): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/rss-sled-plan.json file = common/src/ledger.rs:188
1262024-10-31T20:17:04.357ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1179
1272024-10-31T20:17:04.357ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1282024-10-31T20:17:04.357ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1292024-10-31T20:17:04.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1302024-10-31T20:17:04.357ZINFOSledAgent (RSS): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1312024-10-31T20:17:04.357ZINFOSledAgent (RSS): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1322024-10-31T20:17:04.357ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 622abb78-eb68-41c1-ac52-e7a263024e57 (sled), rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:176
1332024-10-31T20:17:04.357ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1213
1342024-10-31T20:17:04.357ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1352024-10-31T20:17:04.357ZINFOSledAgent (bootstore): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1362024-10-31T20:17:04.357ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372024-10-31T20:17:04.358ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1382024-10-31T20:17:04.358ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 622abb78-eb68-41c1-ac52-e7a263024e57 (sled), rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1392024-10-31T20:17:04.359ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4206
1402024-10-31T20:17:04.359ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4588
1412024-10-31T20:17:04.363ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1422024-10-31T20:17:04.369ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1432024-10-31T20:17:04.369ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1442024-10-31T20:17:04.374ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1452024-10-31T20:17:04.374ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1462024-10-31T20:17:04.374ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:44961
1472024-10-31T20:17:04.374ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 622abb78-eb68-41c1-ac52-e7a263024e57 (sled), rack_id: cf9a2d24-88ed-47a2-a402-0cbbba2d1439, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1482024-10-31T20:17:04.374ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1492024-10-31T20:17:04.374ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1502024-10-31T20:17:04.374ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1512024-10-31T20:17:04.374ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:451
1522024-10-31T20:17:04.374ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:644
1532024-10-31T20:17:04.374ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1542024-10-31T20:17:04.374ZINFOSledAgent (StorageManager): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-10-31T20:17:04.374ZINFOSledAgent (StorageManager): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562024-10-31T20:17:04.374ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:633
1572024-10-31T20:17:04.374ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:661
1582024-10-31T20:17:04.374ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:440
1592024-10-31T20:17:04.374ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1602024-10-31T20:17:04.374ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:532 result = DisksManagementResult { status: [] }
1612024-10-31T20:17:04.391ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1622024-10-31T20:17:04.412ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1632024-10-31T20:17:04.428ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1642024-10-31T20:17:04.435ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:401 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
1652024-10-31T20:17:04.435ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
1662024-10-31T20:17:04.435ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:413 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
1672024-10-31T20:17:04.435ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1682024-10-31T20:17:04.438ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 73.087625ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3c8d9f07-bd7d-48fc-a4f4-6c8b542d6d52", "content-length": "124", "date": "Thu, 31 Oct 2024 20:17:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3c8d9f07-bd7d-48fc-a4f4-6c8b542d6d52" } file = clients/ddm-admin-client/src/lib.rs:177
1692024-10-31T20:17:04.450ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_1861475f-867e-45e6-a81b-af152ebe9a55/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1702024-10-31T20:17:04.475ZINFOSledAgent: successfully created encrypted zvol: name="oxi_1861475f-867e-45e6-a81b-af152ebe9a55/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1712024-10-31T20:17:04.475ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_1861475f-867e-45e6-a81b-af152ebe9a55/swap" file = sled-agent/src/swap_device.rs:96
1722024-10-31T20:17:04.480ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:428 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
1732024-10-31T20:17:04.480ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1742024-10-31T20:17:04.480ZINFOSledAgent (BackingFs): Ensuring dataset oxi_1861475f-867e-45e6-a81b-af152ebe9a55/backing/fmd file = sled-agent/src/backing_fs.rs:138
1752024-10-31T20:17:04.513ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1762024-10-31T20:17:04.514ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 123.565088ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e812bf8c-4781-41b1-8da5-fc543bfa7740", "content-length": "124", "date": "Thu, 31 Oct 2024 20:17:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e812bf8c-4781-41b1-8da5-fc543bfa7740" } file = clients/ddm-admin-client/src/lib.rs:177
1772024-10-31T20:17:04.559ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1782024-10-31T20:17:04.639ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-10-31T20:17:04.639ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 177.589329ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7ecd1b28-ab4b-47c8-974c-bd83ca175a8f", "content-length": "124", "date": "Thu, 31 Oct 2024 20:17:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7ecd1b28-ab4b-47c8-974c-bd83ca175a8f" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-10-31T20:17:04.777ZINFOSledAgent (BackingFs): Mounting oxi_1861475f-867e-45e6-a81b-af152ebe9a55/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1812024-10-31T20:17:04.789ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1822024-10-31T20:17:04.789ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1832024-10-31T20:17:04.789ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1842024-10-31T20:17:04.789ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1852024-10-31T20:17:04.818ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-10-31T20:17:04.819ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 126.06143ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1991a5c0-6111-4d3e-8e2b-3bbfd8714c72", "content-length": "124", "date": "Thu, 31 Oct 2024 20:17:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1991a5c0-6111-4d3e-8e2b-3bbfd8714c72" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-10-31T20:17:04.946ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-10-31T20:17:04.946ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 179.731792ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9a1b6a96-7e7b-41b3-bd06-78681e73f233", "content-length": "124", "date": "Thu, 31 Oct 2024 20:17:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9a1b6a96-7e7b-41b3-bd06-78681e73f233" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-10-31T20:17:05.127ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-10-31T20:17:05.128ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 151.150901ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2ac87548-94bc-43d1-843d-98de3009d0ed", "content-length": "124", "date": "Thu, 31 Oct 2024 20:17:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2ac87548-94bc-43d1-843d-98de3009d0ed" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-10-31T20:17:05.280ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1922024-10-31T20:17:05.280ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 150.991787ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "013024e5-50bd-4700-bd2d-6a9e3d204237", "content-length": "124", "date": "Thu, 31 Oct 2024 20:17:04 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "013024e5-50bd-4700-bd2d-6a9e3d204237" } file = clients/ddm-admin-client/src/lib.rs:177
1932024-10-31T20:17:05.431ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1942024-10-31T20:17:05.432ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 196.095762ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "79c2dc14-80b3-44d9-9eda-46e73a8f4e61", "content-length": "124", "date": "Thu, 31 Oct 2024 20:17:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "79c2dc14-80b3-44d9-9eda-46e73a8f4e61" } file = clients/ddm-admin-client/src/lib.rs:177
1952024-10-31T20:17:05.514ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
1962024-10-31T20:17:05.519ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:38736 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
1972024-10-31T20:17:05.519ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
1982024-10-31T20:17:05.519ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:38736 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = 622abb78-eb68-41c1-ac52-e7a263024e57 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
1992024-10-31T20:17:05.520ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 211.036624ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2002024-10-31T20:17:05.521ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2012024-10-31T20:17:05.521ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2022024-10-31T20:17:05.521ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:917 underlay_address = fd00:1122:3344:101::1
2032024-10-31T20:17:05.521ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2042024-10-31T20:17:05.628ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2052024-10-31T20:17:05.734ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 276.800895ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2062024-10-31T20:17:06.012ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.20366234s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2072024-10-31T20:17:07.217ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.548104653s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2082024-10-31T20:17:07.986ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2664
2092024-10-31T20:17:07.986ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2882
2102024-10-31T20:17:07.986ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2534
2112024-10-31T20:17:07.986ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2581
2122024-10-31T20:17:07.986ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2963
2132024-10-31T20:17:07.986ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3005
2142024-10-31T20:17:07.989ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2807
2152024-10-31T20:17:07.990ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2575
2162024-10-31T20:17:07.990ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='8e92f635-c267-4817-ab48-5ce3a797cb1d'/> <propval type="astring" name="rack_id" value='cf9a2d24-88ed-47a2-a402-0cbbba2d1439'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:feb5:9f17'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='622abb78-eb68-41c1-ac52-e7a263024e57'/> <propval type="astring" name="rack_id" value='cf9a2d24-88ed-47a2-a402-0cbbba2d1439'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='622abb78-eb68-41c1-ac52-e7a263024e57'/> <propval type="astring" name="rack_uuid" value='cf9a2d24-88ed-47a2-a402-0cbbba2d1439'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='622abb78-eb68-41c1-ac52-e7a263024e57'/> <propval type="astring" name="rack_uuid" value='cf9a2d24-88ed-47a2-a402-0cbbba2d1439'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2172024-10-31T20:17:07.990ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2182024-10-31T20:17:08.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 32.925915ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-10-31T20:17:08.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 52.586041ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-10-31T20:17:08.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 136.24052ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-10-31T20:17:08.767ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.331861972s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2222024-10-31T20:17:08.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 431.958447ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-10-31T20:17:09.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 544.58144ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-10-31T20:17:10.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 880.164332ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-10-31T20:17:10.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.449670216s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-10-31T20:17:12.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 611.630075ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-10-31T20:17:13.102ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 7.077512602s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2282024-10-31T20:17:13.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 881.309108ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-10-31T20:17:14.491ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::1]:12345
2302024-10-31T20:17:14.491ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312024-10-31T20:17:14.491ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2322024-10-31T20:17:14.491ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-10-31T20:17:14.491ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-10-31T20:17:14.491ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352024-10-31T20:17:14.491ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None }], bgp: [], bfd: [] })))
2362024-10-31T20:17:14.491ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3909
2372024-10-31T20:17:14.491ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:44961
2382024-10-31T20:17:14.736ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2392024-10-31T20:17:14.736ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2402024-10-31T20:17:14.736ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2412024-10-31T20:17:14.737ZINFOSledAgent (RSS): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2422024-10-31T20:17:14.737ZINFOSledAgent (RSS): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/rss-service-plan-v5.json file = common/src/ledger.rs:188
2432024-10-31T20:17:14.737ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2442024-10-31T20:17:14.737ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2452024-10-31T20:17:14.737ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2462024-10-31T20:17:14.737ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2472024-10-31T20:17:14.742ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4230 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2482024-10-31T20:17:14.742ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4246
2492024-10-31T20:17:14.742ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2502024-10-31T20:17:14.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40128
2512024-10-31T20:17:14.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2522024-10-31T20:17:14.984ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2532024-10-31T20:17:14.984ZINFOSledAgent (ServiceManager): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:188
2542024-10-31T20:17:14.984ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:188
2552024-10-31T20:17:14.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40128 req_id = 27de346f-cbfb-4b92-85a5-a38f6f93ad6e response_code = 200 uri = /inventory
2562024-10-31T20:17:15.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35024
2572024-10-31T20:17:15.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35024 req_id = 8f12afe0-7423-45e8-b2af-670e52b7e5b1 response_code = 200 uri = /sled-role
2582024-10-31T20:17:15.017ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
2592024-10-31T20:17:15.017ZINFOSledAgent (RSS): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2602024-10-31T20:17:15.017ZINFOSledAgent (RSS): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.rss-service-plan-v5.json.tmp file = common/src/ledger.rs:199
2612024-10-31T20:17:15.017ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:886
2622024-10-31T20:17:15.047ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 296e80c0-65e4-4a3b-a4bc-536977f42d6c, pool_id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 586fad50-5135-43a2-8243-50187553da85, pool_id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 86fc7dc9-56de-4358-9193-14b43c6e750b, pool_id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4164abf3-3fbd-40c3-8d09-8e3d6505d853, pool_id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: d93cb44e-56f1-4520-8c4d-b48345f3b1c7, pool_id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 88abc3fa-196d-4d07-ad86-f3cd2d9b7059, pool_id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: dd370751-db91-41a4-adc5-296beaf30677, pool_id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0b97261e-6c91-4469-b024-7bebb7b172c5, pool_id: 29756246-aa82-409a-9346-5743a657eff3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ec54d7e3-a7a1-4d42-9b12-af99f0bdd199, pool_id: fc2aad54-033d-4218-806a-7c669bd520a9 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:376 sled_address = [fd00:1122:3344:101::1]:12345
2632024-10-31T20:17:15.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40486
2642024-10-31T20:17:15.047ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:874 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2652024-10-31T20:17:15.047ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 296e80c0-65e4-4a3b-a4bc-536977f42d6c, pool_id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 586fad50-5135-43a2-8243-50187553da85, pool_id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 86fc7dc9-56de-4358-9193-14b43c6e750b, pool_id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4164abf3-3fbd-40c3-8d09-8e3d6505d853, pool_id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: d93cb44e-56f1-4520-8c4d-b48345f3b1c7, pool_id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 88abc3fa-196d-4d07-ad86-f3cd2d9b7059, pool_id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: dd370751-db91-41a4-adc5-296beaf30677, pool_id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 0b97261e-6c91-4469-b024-7bebb7b172c5, pool_id: 29756246-aa82-409a-9346-5743a657eff3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: ec54d7e3-a7a1-4d42-9b12-af99f0bdd199, pool_id: fc2aad54-033d-4218-806a-7c669bd520a9 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:451
2662024-10-31T20:17:15.048ZINFOSledAgent (StorageManager): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2672024-10-31T20:17:15.048ZINFOSledAgent (StorageManager): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2682024-10-31T20:17:15.048ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:866 request = omicron_physical_disks_ensure
2692024-10-31T20:17:15.048ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2702024-10-31T20:17:15.048ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2712024-10-31T20:17:15.048ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2722024-10-31T20:17:15.048ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2732024-10-31T20:17:15.194ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2742024-10-31T20:17:15.194ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool)
2752024-10-31T20:17:15.644ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2762024-10-31T20:17:15.646ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2772024-10-31T20:17:15.646ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2782024-10-31T20:17:15.647ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/probe_manager.rs:231 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
2792024-10-31T20:17:15.708ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }
2802024-10-31T20:17:15.717ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:217
2812024-10-31T20:17:15.717ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:219
2822024-10-31T20:17:15.717ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:223
2832024-10-31T20:17:15.717ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:225
2842024-10-31T20:17:15.717ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2852024-10-31T20:17:15.717ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-10-31T20:17:15.717ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
2872024-10-31T20:17:15.756ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2882024-10-31T20:17:15.764ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c58d846a-5713-40f9-b784-2f738bd83bc2/crypt/zone file = sled-storage/src/dataset.rs:280
2892024-10-31T20:17:15.932ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c58d846a-5713-40f9-b784-2f738bd83bc2 file = sled-storage/src/dataset.rs:366
2902024-10-31T20:17:15.939ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2912024-10-31T20:17:15.939ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2922024-10-31T20:17:15.939ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2932024-10-31T20:17:15.939ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2942024-10-31T20:17:15.939ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2952024-10-31T20:17:15.949ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2962024-10-31T20:17:15.949ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool)
2972024-10-31T20:17:16.041ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }
2982024-10-31T20:17:16.050ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:217
2992024-10-31T20:17:16.050ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:219
3002024-10-31T20:17:16.050ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:223
3012024-10-31T20:17:16.050ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:225
3022024-10-31T20:17:16.050ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3032024-10-31T20:17:16.050ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3042024-10-31T20:17:16.050ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
3052024-10-31T20:17:16.085ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3062024-10-31T20:17:16.093ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6cdabbea-dfea-4c4a-a6f2-7df6bde97f34/crypt/zone file = sled-storage/src/dataset.rs:280
3072024-10-31T20:17:16.264ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 file = sled-storage/src/dataset.rs:366
3082024-10-31T20:17:16.272ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3092024-10-31T20:17:16.272ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3102024-10-31T20:17:16.272ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3112024-10-31T20:17:16.272ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3122024-10-31T20:17:16.272ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3132024-10-31T20:17:16.281ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3142024-10-31T20:17:16.281ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool)
3152024-10-31T20:17:16.378ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }
3162024-10-31T20:17:16.386ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:217
3172024-10-31T20:17:16.386ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:219
3182024-10-31T20:17:16.386ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:223
3192024-10-31T20:17:16.386ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:225
3202024-10-31T20:17:16.386ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3212024-10-31T20:17:16.386ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3222024-10-31T20:17:16.386ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
3232024-10-31T20:17:16.421ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3242024-10-31T20:17:16.429ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_90a5cbc6-ee3d-4de0-9a29-814842f60db6/crypt/zone file = sled-storage/src/dataset.rs:280
3252024-10-31T20:17:16.608ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_90a5cbc6-ee3d-4de0-9a29-814842f60db6 file = sled-storage/src/dataset.rs:366
3262024-10-31T20:17:16.616ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3272024-10-31T20:17:16.616ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3282024-10-31T20:17:16.616ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3292024-10-31T20:17:16.616ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3302024-10-31T20:17:16.616ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3312024-10-31T20:17:16.626ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3322024-10-31T20:17:16.626ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool)
3332024-10-31T20:17:16.723ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }
3342024-10-31T20:17:16.732ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:217
3352024-10-31T20:17:16.732ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:219
3362024-10-31T20:17:16.732ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:223
3372024-10-31T20:17:16.732ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:225
3382024-10-31T20:17:16.732ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3392024-10-31T20:17:16.732ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3402024-10-31T20:17:16.732ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
3412024-10-31T20:17:16.735ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/probe_manager.rs:231 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
3422024-10-31T20:17:16.766ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3432024-10-31T20:17:16.774ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c0da9f47-3ba9-44de-b97b-4854847926e3/crypt/zone file = sled-storage/src/dataset.rs:280
3442024-10-31T20:17:16.946ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c0da9f47-3ba9-44de-b97b-4854847926e3 file = sled-storage/src/dataset.rs:366
3452024-10-31T20:17:16.954ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3462024-10-31T20:17:16.954ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3472024-10-31T20:17:16.954ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3482024-10-31T20:17:16.954ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3492024-10-31T20:17:16.954ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3502024-10-31T20:17:16.965ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3512024-10-31T20:17:16.965ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool)
3522024-10-31T20:17:17.059ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }
3532024-10-31T20:17:17.068ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:217
3542024-10-31T20:17:17.068ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:219
3552024-10-31T20:17:17.068ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:223
3562024-10-31T20:17:17.068ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:225
3572024-10-31T20:17:17.068ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3582024-10-31T20:17:17.068ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3592024-10-31T20:17:17.068ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
3602024-10-31T20:17:17.104ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3612024-10-31T20:17:17.112ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d94d1e41-79ad-434a-a5c0-f6dedadc31a6/crypt/zone file = sled-storage/src/dataset.rs:280
3622024-10-31T20:17:17.286ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d94d1e41-79ad-434a-a5c0-f6dedadc31a6 file = sled-storage/src/dataset.rs:366
3632024-10-31T20:17:17.294ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3642024-10-31T20:17:17.294ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3652024-10-31T20:17:17.294ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3662024-10-31T20:17:17.294ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3672024-10-31T20:17:17.294ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3682024-10-31T20:17:17.303ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3692024-10-31T20:17:17.303ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b02e5273-d830-439b-a210-08a4dffedb6c (zpool)
3702024-10-31T20:17:17.398ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool), kind: External }
3712024-10-31T20:17:17.406ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:217
3722024-10-31T20:17:17.406ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:219
3732024-10-31T20:17:17.406ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:223
3742024-10-31T20:17:17.406ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:225
3752024-10-31T20:17:17.406ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3762024-10-31T20:17:17.406ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3772024-10-31T20:17:17.406ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
3782024-10-31T20:17:17.442ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3792024-10-31T20:17:17.451ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b02e5273-d830-439b-a210-08a4dffedb6c/crypt/zone file = sled-storage/src/dataset.rs:280
3802024-10-31T20:17:17.626ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b02e5273-d830-439b-a210-08a4dffedb6c file = sled-storage/src/dataset.rs:366
3812024-10-31T20:17:17.634ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3822024-10-31T20:17:17.634ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3832024-10-31T20:17:17.634ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3842024-10-31T20:17:17.634ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3852024-10-31T20:17:17.634ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3862024-10-31T20:17:17.644ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3872024-10-31T20:17:17.644ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool)
3882024-10-31T20:17:17.748ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool), kind: External }
3892024-10-31T20:17:17.758ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:217
3902024-10-31T20:17:17.758ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:219
3912024-10-31T20:17:17.758ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:223
3922024-10-31T20:17:17.758ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:225
3932024-10-31T20:17:17.758ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3942024-10-31T20:17:17.758ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3952024-10-31T20:17:17.758ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
3962024-10-31T20:17:17.762ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/probe_manager.rs:231 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
3972024-10-31T20:17:17.795ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3982024-10-31T20:17:17.802ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d69c81fd-1038-4573-af8f-d97c9e6eb958/crypt/zone file = sled-storage/src/dataset.rs:280
3992024-10-31T20:17:17.977ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d69c81fd-1038-4573-af8f-d97c9e6eb958 file = sled-storage/src/dataset.rs:366
4002024-10-31T20:17:17.985ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
4012024-10-31T20:17:17.985ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
4022024-10-31T20:17:17.985ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
4032024-10-31T20:17:17.985ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4042024-10-31T20:17:17.985ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4052024-10-31T20:17:17.995ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4062024-10-31T20:17:17.995ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 29756246-aa82-409a-9346-5743a657eff3 (zpool)
4072024-10-31T20:17:18.088ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: 29756246-aa82-409a-9346-5743a657eff3 (zpool), kind: External }
4082024-10-31T20:17:18.096ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:217
4092024-10-31T20:17:18.096ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:219
4102024-10-31T20:17:18.096ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:223
4112024-10-31T20:17:18.096ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:225
4122024-10-31T20:17:18.096ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4132024-10-31T20:17:18.096ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4142024-10-31T20:17:18.096ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
4152024-10-31T20:17:18.133ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4162024-10-31T20:17:18.141ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_29756246-aa82-409a-9346-5743a657eff3/crypt/zone file = sled-storage/src/dataset.rs:280
4172024-10-31T20:17:18.313ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_29756246-aa82-409a-9346-5743a657eff3 file = sled-storage/src/dataset.rs:366
4182024-10-31T20:17:18.321ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4192024-10-31T20:17:18.321ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4202024-10-31T20:17:18.321ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4212024-10-31T20:17:18.321ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4222024-10-31T20:17:18.321ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4232024-10-31T20:17:18.331ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4242024-10-31T20:17:18.331ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fc2aad54-033d-4218-806a-7c669bd520a9 (zpool)
4252024-10-31T20:17:18.459ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:173 zpool = ZpoolName { id: fc2aad54-033d-4218-806a-7c669bd520a9 (zpool), kind: External }
4262024-10-31T20:17:18.468ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:217
4272024-10-31T20:17:18.468ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:219
4282024-10-31T20:17:18.468ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:223
4292024-10-31T20:17:18.468ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:225
4302024-10-31T20:17:18.468ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4312024-10-31T20:17:18.468ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4322024-10-31T20:17:18.468ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:237
4332024-10-31T20:17:18.505ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4342024-10-31T20:17:18.513ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fc2aad54-033d-4218-806a-7c669bd520a9/crypt/zone file = sled-storage/src/dataset.rs:280
4352024-10-31T20:17:18.692ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fc2aad54-033d-4218-806a-7c669bd520a9 file = sled-storage/src/dataset.rs:366
4362024-10-31T20:17:18.699ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4372024-10-31T20:17:18.699ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4382024-10-31T20:17:18.699ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4392024-10-31T20:17:18.700ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1861475f-867e-45e6-a81b-af152ebe9a55 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6d5de02b-0b31-45f6-8a53-13e937cfb977 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 29756246-aa82-409a-9346-5743a657eff3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fc2aad54-033d-4218-806a-7c669bd520a9 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4402024-10-31T20:17:18.700ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4412024-10-31T20:17:18.700ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4422024-10-31T20:17:18.700ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4432024-10-31T20:17:18.700ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:878 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4442024-10-31T20:17:18.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4452024-10-31T20:17:18.700ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:904 generation = Generation(1) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4462024-10-31T20:17:18.700ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:909 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4472024-10-31T20:17:18.700ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:914 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4482024-10-31T20:17:18.700ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(1) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4492024-10-31T20:17:18.700ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:920 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4502024-10-31T20:17:18.700ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(1)
4512024-10-31T20:17:18.700ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:925 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4522024-10-31T20:17:18.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3653086 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40486 req_id = 9bfc9919-893c-4668-87d0-c68116b6e93f response_code = 200 uri = /omicron-physical-disks
4532024-10-31T20:17:18.732ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 8e750a05-d6dd-412d-aac1-b776b5e7757f (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f87fba37-8eb7-413a-91fe-8caa94515963 (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
4542024-10-31T20:17:18.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53743
4552024-10-31T20:17:18.732ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e750a05-d6dd-412d-aac1-b776b5e7757f, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4562024-10-31T20:17:18.732ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e750a05-d6dd-412d-aac1-b776b5e7757f, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4572024-10-31T20:17:18.763ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/probe_manager.rs:231 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4582024-10-31T20:17:18.782ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f87fba37-8eb7-413a-91fe-8caa94515963, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4592024-10-31T20:17:18.782ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f87fba37-8eb7-413a-91fe-8caa94515963, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4602024-10-31T20:17:18.831ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
4612024-10-31T20:17:18.831ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4622024-10-31T20:17:18.880ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4632024-10-31T20:17:18.880ZINFOSledAgent (ServiceManager): No ledger in /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:188
4642024-10-31T20:17:18.880ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:188
4652024-10-31T20:17:18.880ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4662024-10-31T20:17:18.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4672024-10-31T20:17:18.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4682024-10-31T20:17:18.926ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
4692024-10-31T20:17:18.979ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b file = illumos-utils/src/zone.rs:325
4702024-10-31T20:17:18.983ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f file = illumos-utils/src/zone.rs:325
4712024-10-31T20:17:18.987ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963 file = illumos-utils/src/zone.rs:325
4722024-10-31T20:17:18.999ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b file = illumos-utils/src/zone.rs:363
4732024-10-31T20:17:19.004ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f file = illumos-utils/src/zone.rs:363
4742024-10-31T20:17:19.008ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963 file = illumos-utils/src/zone.rs:363
4752024-10-31T20:17:19.767ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/probe_manager.rs:231 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
4762024-10-31T20:17:20.600ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4772024-10-31T20:17:20.600ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4782024-10-31T20:17:20.600ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
4792024-10-31T20:17:21.083ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4802024-10-31T20:17:21.564ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4812024-10-31T20:17:21.564ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4822024-10-31T20:17:21.564ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4832024-10-31T20:17:21.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 59.283798ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
4842024-10-31T20:17:21.572ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
4852024-10-31T20:17:21.576ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
4862024-10-31T20:17:21.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 52.311242ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
4872024-10-31T20:17:21.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 239.877272ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
4882024-10-31T20:17:21.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 37.250559ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
4892024-10-31T20:17:21.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963") failed: Property not found. retry in 65.220963ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
4902024-10-31T20:17:21.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 92.647123ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
4912024-10-31T20:17:22.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963") failed: Property not found. retry in 68.896603ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
4922024-10-31T20:17:22.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 512.215945ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
4932024-10-31T20:17:22.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 288.031021ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
4942024-10-31T20:17:22.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963") failed: Property not found. retry in 243.789139ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
4952024-10-31T20:17:22.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 571.76488ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
4962024-10-31T20:17:22.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963") failed: Property not found. retry in 362.297977ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
4972024-10-31T20:17:22.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 614.951191ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
4982024-10-31T20:17:22.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963") failed: Property not found. retry in 996.208266ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
4992024-10-31T20:17:22.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 642.642142ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
5002024-10-31T20:17:23.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 837.877195ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
5012024-10-31T20:17:23.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 612.405197ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
5022024-10-31T20:17:23.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963") failed: Property not found. retry in 854.161857ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
5032024-10-31T20:17:24.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 930.346587ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
5042024-10-31T20:17:24.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 707.754696ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
5052024-10-31T20:17:24.305ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4254
5062024-10-31T20:17:24.305ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4264 gateway = fd00:1122:3344:101::1
5072024-10-31T20:17:24.311ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4343
5082024-10-31T20:17:24.420ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4391
5092024-10-31T20:17:24.420ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4418
5102024-10-31T20:17:24.461ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4431
5112024-10-31T20:17:24.461ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4295
5122024-10-31T20:17:24.496ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 608795555885094059 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
5132024-10-31T20:17:24.497ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6678492511364975773 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
5142024-10-31T20:17:24.515ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4337
5152024-10-31T20:17:24.515ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4398 rack_subnet = fd00:1122:3344::
5162024-10-31T20:17:24.535ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4409
5172024-10-31T20:17:24.535ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4451
5182024-10-31T20:17:24.607ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4483
5192024-10-31T20:17:24.607ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4489
5202024-10-31T20:17:24.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963") failed: Property not found. retry in 1.490446255s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
5212024-10-31T20:17:24.700ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4530
5222024-10-31T20:17:24.700ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5232024-10-31T20:17:24.732ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/nexus.rs:527 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
5242024-10-31T20:17:24.732ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 45.896879ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5252024-10-31T20:17:24.779ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 76.982559ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5262024-10-31T20:17:24.858ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 280.558485ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5272024-10-31T20:17:24.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 869.759635ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
5282024-10-31T20:17:24.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 1.155362937s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
5292024-10-31T20:17:25.139ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 250.332239ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
5302024-10-31T20:17:25.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:57861
5312024-10-31T20:17:25.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:57861 req_id = 4b4265de-df61-4598-afd2-70002b4de608 response_code = 200 uri = /sled-identifiers
5322024-10-31T20:17:25.392ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:418
5332024-10-31T20:17:25.424ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:686
5342024-10-31T20:17:25.424ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:724
5352024-10-31T20:17:25.425ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:727 uptime = 0
5362024-10-31T20:17:25.425ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:440
5372024-10-31T20:17:25.462ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
5382024-10-31T20:17:25.514ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:451
5392024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5402024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5412024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5422024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5432024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5442024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5452024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5462024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5472024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5482024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5492024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5502024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5512024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5522024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5532024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5542024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5552024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5562024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5572024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5582024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5592024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5602024-10-31T20:17:25.514ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5612024-10-31T20:17:25.648ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
5622024-10-31T20:17:25.648ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
5632024-10-31T20:17:25.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f") failed: Property not found. retry in 758.154403ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
5642024-10-31T20:17:26.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963") failed: Property not found. retry in 824.98224ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
5652024-10-31T20:17:26.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b") failed: Property not found. retry in 1.397746034s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
5662024-10-31T20:17:27.576ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_8e764cc9-00d9-46ed-80f0-316c9e4e0a2b
5672024-10-31T20:17:27.576ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_8e750a05-d6dd-412d-aac1-b776b5e7757f
5682024-10-31T20:17:27.576ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_internal_dns_f87fba37-8eb7-413a-91fe-8caa94515963
5692024-10-31T20:17:27.576ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5702024-10-31T20:17:27.576ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5712024-10-31T20:17:27.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8844772 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53743 req_id = b2f074ec-80ab-4004-b69f-a9cb625e0261 response_code = 204 uri = /omicron-zones
5722024-10-31T20:17:27.578ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5732024-10-31T20:17:27.624ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5742024-10-31T20:17:27.669ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:576
5752024-10-31T20:17:27.720ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:612
5762024-10-31T20:17:27.720ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5772024-10-31T20:17:27.751ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5782024-10-31T20:17:27.752ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5792024-10-31T20:17:27.752ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5802024-10-31T20:17:27.781ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 8e750a05-d6dd-412d-aac1-b776b5e7757f (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f87fba37-8eb7-413a-91fe-8caa94515963 (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 224bd9fe-8e1a-4f23-9604-b2cf690ced7b (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3ad06602-170b-4b56-a420-10c1efc17b20, kind: Service { id: 224bd9fe-8e1a-4f23-9604-b2cf690ced7b }, name: Name("ntp-224bd9fe-8e1a-4f23-9604-b2cf690ced7b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 45])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
5812024-10-31T20:17:27.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58558
5822024-10-31T20:17:27.781ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e750a05-d6dd-412d-aac1-b776b5e7757f, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5832024-10-31T20:17:27.781ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e750a05-d6dd-412d-aac1-b776b5e7757f, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5842024-10-31T20:17:27.803ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f87fba37-8eb7-413a-91fe-8caa94515963, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5852024-10-31T20:17:27.803ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f87fba37-8eb7-413a-91fe-8caa94515963, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5862024-10-31T20:17:27.822ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
5872024-10-31T20:17:27.823ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5882024-10-31T20:17:27.841ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5892024-10-31T20:17:27.841ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
5902024-10-31T20:17:27.841ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
5912024-10-31T20:17:27.841ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
5922024-10-31T20:17:27.852ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
5932024-10-31T20:17:27.884ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
5942024-10-31T20:17:27.885ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
5952024-10-31T20:17:27.885ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
5962024-10-31T20:17:27.915ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 137, 45]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5972024-10-31T20:17:27.915ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = boundary_ntp
5982024-10-31T20:17:27.915ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5992024-10-31T20:17:27.915ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
6002024-10-31T20:17:27.915ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
6012024-10-31T20:17:27.917ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
6022024-10-31T20:17:27.939ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b file = illumos-utils/src/zone.rs:325
6032024-10-31T20:17:27.957ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b file = illumos-utils/src/zone.rs:363
6042024-10-31T20:17:28.577ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6052024-10-31T20:17:28.578ZINFOSledAgent (ServiceManager): Booting oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6062024-10-31T20:17:28.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b") failed: Property not found. retry in 54.882972ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6072024-10-31T20:17:28.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b") failed: Property not found. retry in 97.652515ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6082024-10-31T20:17:28.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b") failed: Property not found. retry in 139.631133ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6092024-10-31T20:17:29.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b") failed: Property not found. retry in 544.358317ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6102024-10-31T20:17:29.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b") failed: Property not found. retry in 666.642987ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6112024-10-31T20:17:30.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b") failed: Property not found. retry in 942.197783ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6122024-10-31T20:17:31.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b") failed: Property not found. retry in 916.634929ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6132024-10-31T20:17:32.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b") failed: Property not found. retry in 1.426217078s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6142024-10-31T20:17:33.618ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b
6152024-10-31T20:17:33.618ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6162024-10-31T20:17:33.618ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6172024-10-31T20:17:33.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5837562 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58558 req_id = d632aa42-cbb4-4039-b6a8-89b7ca51185f response_code = 204 uri = /omicron-zones
6182024-10-31T20:17:33.622ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:653
6192024-10-31T20:17:33.653ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6202024-10-31T20:17:33.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40164
6212024-10-31T20:17:33.662ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6222024-10-31T20:17:33.663ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 9370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40164 req_id = ffa71654-b85a-4b5e-a024-c20ad056e185 response_code = 500 uri = /timesync
6232024-10-31T20:17:33.665ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6242024-10-31T20:17:33.811ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6252024-10-31T20:17:33.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61143
6262024-10-31T20:17:34.498ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 608795555885094059 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6272024-10-31T20:17:34.498ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6678492511364975773 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6282024-10-31T20:17:35.649ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6292024-10-31T20:17:35.650ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6302024-10-31T20:17:36.604ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8610702146004672843 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6312024-10-31T20:17:36.972ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11471155705308466722 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6322024-10-31T20:17:37.578ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 876384208827005751 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6332024-10-31T20:17:37.820ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6342024-10-31T20:17:37.820ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4009093 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61143 req_id = 8f6f7442-ad2b-4d63-8fcc-d5d7d98ccac9 response_code = 500 uri = /timesync
6352024-10-31T20:17:37.823ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6362024-10-31T20:17:37.979ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6372024-10-31T20:17:37.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47268
6382024-10-31T20:17:37.988ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6392024-10-31T20:17:37.988ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 8745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47268 req_id = 1e8affdb-0f63-45ba-9ba4-67b8981edb33 response_code = 500 uri = /timesync
6402024-10-31T20:17:37.992ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6412024-10-31T20:17:38.107ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6422024-10-31T20:17:38.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64900
6432024-10-31T20:17:42.181ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_224bd9fe-8e1a-4f23-9604-b2cf690ced7b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3862
6442024-10-31T20:17:42.181ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 4008013 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64900 req_id = 96a25cb0-a3d9-418d-80c2-5ce95a52ac73 response_code = 500 uri = /timesync
6452024-10-31T20:17:42.184ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6462024-10-31T20:17:42.424ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6472024-10-31T20:17:42.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52594
6482024-10-31T20:17:42.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8962 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52594 req_id = 103dcbef-e643-44df-a92c-db156d125d4b response_code = 200 uri = /timesync
6492024-10-31T20:17:42.436ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730405861.0642858, correction: 0.371384472 } file = sled-agent/src/rack_setup/service.rs:661
6502024-10-31T20:17:42.436ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6512024-10-31T20:17:42.686ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6522024-10-31T20:17:42.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50806
6532024-10-31T20:17:42.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8562 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50806 req_id = fa0fd62f-1491-4717-97e5-3aaec17fdd2d response_code = 200 uri = /timesync
6542024-10-31T20:17:42.697ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730405861.0642858, correction: 0.370677203 } file = sled-agent/src/rack_setup/service.rs:661
6552024-10-31T20:17:42.697ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6562024-10-31T20:17:42.933ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6572024-10-31T20:17:42.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45028
6582024-10-31T20:17:42.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45028 req_id = d6f359cb-ba58-45e7-8680-38c9a4f43a4d response_code = 200 uri = /timesync
6592024-10-31T20:17:42.945ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405863.0107386, correction: 0.37066564 } file = sled-agent/src/rack_setup/service.rs:661
6602024-10-31T20:17:42.945ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6612024-10-31T20:17:43.216ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6622024-10-31T20:17:43.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63937
6632024-10-31T20:17:43.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8992 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63937 req_id = 1c071a0d-5c82-4e79-a9ff-ef2498902de7 response_code = 200 uri = /timesync
6642024-10-31T20:17:43.227ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730405861.0642858, correction: 0.369900107 } file = sled-agent/src/rack_setup/service.rs:661
6652024-10-31T20:17:43.227ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6662024-10-31T20:17:43.601ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6672024-10-31T20:17:43.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63549
6682024-10-31T20:17:43.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9969 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63549 req_id = d731c50e-d239-49c8-824b-066a50821f7f response_code = 200 uri = /timesync
6692024-10-31T20:17:43.614ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730405861.0642858, correction: 0.368854702 } file = sled-agent/src/rack_setup/service.rs:661
6702024-10-31T20:17:43.614ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6712024-10-31T20:17:43.690ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16173008732784745577 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6722024-10-31T20:17:43.690ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14056085528021808678 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6732024-10-31T20:17:44.016ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6742024-10-31T20:17:44.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55900
6752024-10-31T20:17:44.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7407 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55900 req_id = 1596b46d-90dd-49ac-af26-75c1ff16f0d3 response_code = 200 uri = /timesync
6762024-10-31T20:17:44.026ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730405861.0642858, correction: 0.367829412 } file = sled-agent/src/rack_setup/service.rs:661
6772024-10-31T20:17:44.026ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6782024-10-31T20:17:44.487ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6792024-10-31T20:17:44.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57297
6802024-10-31T20:17:44.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57297 req_id = 6dd10100-8c95-4e18-bbcf-2e3f63d916a0 response_code = 200 uri = /timesync
6812024-10-31T20:17:44.497ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1730405861.0642858, correction: 0.366556764 } file = sled-agent/src/rack_setup/service.rs:661
6822024-10-31T20:17:44.497ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6832024-10-31T20:17:44.572ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 608795555885094059 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6842024-10-31T20:17:44.572ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6678492511364975773 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6852024-10-31T20:17:44.934ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6862024-10-31T20:17:44.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53871
6872024-10-31T20:17:44.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53871 req_id = 97ced3f0-c873-4171-bc21-947ac5ee76e5 response_code = 200 uri = /timesync
6882024-10-31T20:17:44.944ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405864.7547708, correction: 0.365355462 } file = sled-agent/src/rack_setup/service.rs:661
6892024-10-31T20:17:44.944ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6902024-10-31T20:17:45.718ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 241.092612ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6912024-10-31T20:17:45.727ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6922024-10-31T20:17:45.727ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
6932024-10-31T20:17:45.817ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6942024-10-31T20:17:45.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44145
6952024-10-31T20:17:45.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8762 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44145 req_id = 93741507-ebed-47cb-9bed-5c8242133ec1 response_code = 200 uri = /timesync
6962024-10-31T20:17:45.828ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405864.7547708, correction: 0.362966329 } file = sled-agent/src/rack_setup/service.rs:661
6972024-10-31T20:17:45.828ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
6982024-10-31T20:17:46.609ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
6992024-10-31T20:17:46.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42733
7002024-10-31T20:17:46.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42733 req_id = 1f94f448-0630-4cc1-baeb-d47f85e2c273 response_code = 200 uri = /timesync
7012024-10-31T20:17:46.620ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405866.1348891, correction: 0.360684991 } file = sled-agent/src/rack_setup/service.rs:661
7022024-10-31T20:17:46.620ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7032024-10-31T20:17:46.685ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8610702146004672843 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7042024-10-31T20:17:47.052ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11471155705308466722 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7052024-10-31T20:17:47.660ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 876384208827005751 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7062024-10-31T20:17:47.979ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7072024-10-31T20:17:47.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51817
7082024-10-31T20:17:47.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8465 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51817 req_id = 65fec133-d128-4b34-84e9-288671fc89fb response_code = 200 uri = /timesync
7092024-10-31T20:17:47.990ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405867.9163835, correction: 0.356707931 } file = sled-agent/src/rack_setup/service.rs:661
7102024-10-31T20:17:47.990ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7112024-10-31T20:17:49.085ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7122024-10-31T20:17:49.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45464
7132024-10-31T20:17:49.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7738 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45464 req_id = c8378d29-1ed5-467d-b8c9-febdf7febdb0 response_code = 200 uri = /timesync
7142024-10-31T20:17:49.095ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405868.7249804, correction: 0.353596449 } file = sled-agent/src/rack_setup/service.rs:661
7152024-10-31T20:17:49.095ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7162024-10-31T20:17:51.218ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7172024-10-31T20:17:51.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57310
7182024-10-31T20:17:51.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8652 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57310 req_id = a70c19f5-4db1-4802-b1b8-a0cd1714f3f2 response_code = 200 uri = /timesync
7192024-10-31T20:17:51.229ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405871.1031766, correction: 0.34784016 } file = sled-agent/src/rack_setup/service.rs:661
7202024-10-31T20:17:51.229ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7212024-10-31T20:17:52.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7222024-10-31T20:17:52.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59448
7232024-10-31T20:17:53.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8489 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59448 req_id = 8e6b87bf-455a-41a9-863e-085b486bd0a2 response_code = 200 uri = /timesync
7242024-10-31T20:17:53.006ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405872.99501, correction: 0.343078315 } file = sled-agent/src/rack_setup/service.rs:661
7252024-10-31T20:17:53.006ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7262024-10-31T20:17:53.720ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16173008732784745577 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7272024-10-31T20:17:53.720ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14056085528021808678 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7282024-10-31T20:17:54.582ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36319
7292024-10-31T20:17:54.582ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36319 req_id = a421efa4-47be-4dad-81dd-e7e14fc5f423 response_code = 200 uri = /baseboard
7302024-10-31T20:17:54.601ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 608795555885094059 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7312024-10-31T20:17:54.601ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6678492511364975773 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7322024-10-31T20:17:55.686ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7332024-10-31T20:17:55.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65340
7342024-10-31T20:17:55.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8401 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65340 req_id = de4eeb46-68e2-4011-a1d1-9fbd1dc23d02 response_code = 200 uri = /timesync
7352024-10-31T20:17:55.697ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405874.454921, correction: 0.335766405 } file = sled-agent/src/rack_setup/service.rs:661
7362024-10-31T20:17:55.697ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7372024-10-31T20:17:55.757ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7382024-10-31T20:17:55.757ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7392024-10-31T20:17:56.714ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8610702146004672843 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7402024-10-31T20:17:57.081ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11471155705308466722 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7412024-10-31T20:17:57.550ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7422024-10-31T20:17:57.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49523
7432024-10-31T20:17:57.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49523 req_id = 8daab54b-6a60-4631-951c-e3366179d15d response_code = 200 uri = /timesync
7442024-10-31T20:17:57.561ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405876.8807254, correction: 0.330700636 } file = sled-agent/src/rack_setup/service.rs:661
7452024-10-31T20:17:57.561ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7462024-10-31T20:17:57.690ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 876384208827005751 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7472024-10-31T20:18:01.038ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 506.642159ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7482024-10-31T20:18:01.651ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7492024-10-31T20:18:01.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37702
7502024-10-31T20:18:01.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8803 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37702 req_id = 78cdee53-7802-4b47-9b97-578b4161e8d8 response_code = 200 uri = /timesync
7512024-10-31T20:18:01.662ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405881.0275297, correction: 0.319613814 } file = sled-agent/src/rack_setup/service.rs:661
7522024-10-31T20:18:01.662ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7532024-10-31T20:18:03.750ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16173008732784745577 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7542024-10-31T20:18:03.750ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14056085528021808678 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7552024-10-31T20:18:04.356ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7562024-10-31T20:18:04.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55953
7572024-10-31T20:18:04.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8870 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55953 req_id = e954f596-4508-4608-a79c-5dd6f9d9c475 response_code = 200 uri = /timesync
7582024-10-31T20:18:04.368ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405884.159535, correction: 0.312341362 } file = sled-agent/src/rack_setup/service.rs:661
7592024-10-31T20:18:04.368ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7602024-10-31T20:18:04.631ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 608795555885094059 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7612024-10-31T20:18:04.631ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 6678492511364975773 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7622024-10-31T20:18:05.787ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7632024-10-31T20:18:05.787ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7642024-10-31T20:18:06.743ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8610702146004672843 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7652024-10-31T20:18:07.110ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11471155705308466722 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7662024-10-31T20:18:07.718ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 876384208827005751 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7672024-10-31T20:18:08.525ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7682024-10-31T20:18:08.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38426
7692024-10-31T20:18:08.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38426 req_id = 12b6cf11-27d5-44d6-9aa3-fe0adb379a07 response_code = 200 uri = /timesync
7702024-10-31T20:18:08.536ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405888.0299587, correction: 0.301062256 } file = sled-agent/src/rack_setup/service.rs:661
7712024-10-31T20:18:08.536ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7722024-10-31T20:18:13.779ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16173008732784745577 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7732024-10-31T20:18:13.779ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14056085528021808678 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7742024-10-31T20:18:14.661ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 608795555885094059 reason = Duration(60s) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7752024-10-31T20:18:14.662ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 6678492511364975773 reason = Duration(60s) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7762024-10-31T20:18:15.711ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7772024-10-31T20:18:15.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59614
7782024-10-31T20:18:15.720ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59614 req_id = e5458185-2f59-417c-b6cb-83acb97e58af response_code = 200 uri = /timesync
7792024-10-31T20:18:15.723ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405891.9373562, correction: 0.281654328 } file = sled-agent/src/rack_setup/service.rs:661
7802024-10-31T20:18:15.723ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7812024-10-31T20:18:15.817ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7822024-10-31T20:18:15.817ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7832024-10-31T20:18:16.623ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 717.01205ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7842024-10-31T20:18:16.772ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8610702146004672843 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7852024-10-31T20:18:17.139ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11471155705308466722 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7862024-10-31T20:18:17.746ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 876384208827005751 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7872024-10-31T20:18:23.809ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16173008732784745577 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7882024-10-31T20:18:23.809ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14056085528021808678 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7892024-10-31T20:18:24.696ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61029
7902024-10-31T20:18:24.696ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61029 req_id = b23b8762-7618-4fa8-8577-dafdc3fd6a66 response_code = 200 uri = /baseboard
7912024-10-31T20:18:24.932ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
7922024-10-31T20:18:24.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58913
7932024-10-31T20:18:24.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8529 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58913 req_id = 9b350f99-d676-402b-9d7c-a6feef04b249 response_code = 200 uri = /timesync
7942024-10-31T20:18:24.942ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405904.46638, correction: 0.256742299 } file = sled-agent/src/rack_setup/service.rs:661
7952024-10-31T20:18:24.942ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
7962024-10-31T20:18:25.846ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7972024-10-31T20:18:25.846ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7982024-10-31T20:18:26.801ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8610702146004672843 reason = Duration(60s) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
7992024-10-31T20:18:27.168ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 11471155705308466722 reason = Duration(60s) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8002024-10-31T20:18:27.774ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 876384208827005751 reason = Duration(60s) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8012024-10-31T20:18:32.418ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.044972895s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8022024-10-31T20:18:33.358ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8032024-10-31T20:18:33.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38941
8042024-10-31T20:18:33.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8782 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38941 req_id = d26f2534-e5ef-4bc1-a53d-af5e644e68a8 response_code = 200 uri = /timesync
8052024-10-31T20:18:33.370ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405911.665417, correction: 0.233949065 } file = sled-agent/src/rack_setup/service.rs:661
8062024-10-31T20:18:33.370ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8072024-10-31T20:18:33.837ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16173008732784745577 reason = Duration(60s) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8082024-10-31T20:18:33.838ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14056085528021808678 reason = Duration(60s) sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8092024-10-31T20:18:35.875ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8102024-10-31T20:18:35.875ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8112024-10-31T20:18:44.019ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8122024-10-31T20:18:44.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39014
8132024-10-31T20:18:44.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39014 req_id = 9527bc06-eaa8-47c6-b2a9-3b804c95ff02 response_code = 200 uri = /timesync
8142024-10-31T20:18:44.031ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405920.0240407, correction: 0.205157652 } file = sled-agent/src/rack_setup/service.rs:661
8152024-10-31T20:18:44.031ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8162024-10-31T20:18:45.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8172024-10-31T20:18:45.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8182024-10-31T20:18:49.544ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.649253613s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8192024-10-31T20:18:51.372ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8202024-10-31T20:18:51.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55699
8212024-10-31T20:18:51.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8550 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55699 req_id = 9da95360-4dd1-4e4b-a7cb-83b9dac83b55 response_code = 200 uri = /timesync
8222024-10-31T20:18:51.384ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405928.110209, correction: 0.185271874 } file = sled-agent/src/rack_setup/service.rs:661
8232024-10-31T20:18:51.384ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8242024-10-31T20:18:54.812ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35255
8252024-10-31T20:18:54.812ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35255 req_id = bcb34389-7b4e-483c-b395-95ba39df4f7a response_code = 200 uri = /baseboard
8262024-10-31T20:18:55.933ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8272024-10-31T20:18:55.934ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8282024-10-31T20:19:04.798ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8292024-10-31T20:19:04.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64574
8302024-10-31T20:19:04.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8894 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64574 req_id = 66de75e7-b866-40b1-8bb9-e2e3724883a4 response_code = 200 uri = /timesync
8312024-10-31T20:19:04.810ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2728380417, ip_addr: 162.159.200.1, stratum: 4, ref_time: 1730405944.512933, correction: 0.149078235 } file = sled-agent/src/rack_setup/service.rs:661
8322024-10-31T20:19:04.810ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8332024-10-31T20:19:05.963ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8342024-10-31T20:19:05.963ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8352024-10-31T20:19:08.281ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.623221906s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8362024-10-31T20:19:15.994ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8372024-10-31T20:19:15.994ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8382024-10-31T20:19:18.063ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8392024-10-31T20:19:18.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51964
8402024-10-31T20:19:18.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8406 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51964 req_id = f5cf0f91-3449-472b-a1c9-ea0198ef6ea4 response_code = 200 uri = /timesync
8412024-10-31T20:19:18.074ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1730405957.8964548, correction: 0.112085447 } file = sled-agent/src/rack_setup/service.rs:661
8422024-10-31T20:19:18.074ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:683
8432024-10-31T20:19:24.927ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56774
8442024-10-31T20:19:24.927ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56774 req_id = b45005b2-c919-431c-aede-59a2fb615e58 response_code = 200 uri = /baseboard
8452024-10-31T20:19:26.023ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8462024-10-31T20:19:26.023ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8472024-10-31T20:19:32.004ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 15.567486453s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8482024-10-31T20:19:36.053ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18135386546437739970 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8492024-10-31T20:19:36.053ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14001460566788742055 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8502024-10-31T20:19:42.089ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:633
8512024-10-31T20:19:42.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64700
8522024-10-31T20:19:42.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22951 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64700 req_id = ea5adca5-e58e-4bd9-b3ca-2f9597757e1c response_code = 200 uri = /timesync
8532024-10-31T20:19:42.113ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-10-31T20:18:27.774947637Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 876384208827005751 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8542024-10-31T20:19:42.114ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-10-31T20:18:14.661460791Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 608795555885094059 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8552024-10-31T20:19:42.114ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-10-31T20:18:33.838207694Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14056085528021808678 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8562024-10-31T20:19:42.115ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-10-31T20:18:26.801604683Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8610702146004672843 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8572024-10-31T20:19:42.115ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-10-31T20:18:14.662256564Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 6678492511364975773 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8582024-10-31T20:19:42.115ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-10-31T20:18:27.168862050Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 11471155705308466722 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8592024-10-31T20:19:42.115ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-10-31T20:18:33.837858571Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16173008732784745577 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
8602024-10-31T20:19:42.116ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1730405980.7135706, correction: 0.047252636 } file = sled-agent/src/rack_setup/service.rs:661
8612024-10-31T20:19:42.116ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1299
8622024-10-31T20:19:42.145ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 8e750a05-d6dd-412d-aac1-b776b5e7757f (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f87fba37-8eb7-413a-91fe-8caa94515963 (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 224bd9fe-8e1a-4f23-9604-b2cf690ced7b (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3ad06602-170b-4b56-a420-10c1efc17b20, kind: Service { id: 224bd9fe-8e1a-4f23-9604-b2cf690ced7b }, name: Name("ntp-224bd9fe-8e1a-4f23-9604-b2cf690ced7b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 45])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 73874fe3-61b1-4d68-bae6-7c4f17a34442 (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3fd2c678-326b-4230-926e-0c18d4a83e8d (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } } } }, OmicronZoneConfig { id: 44a3d639-c81d-45be-aaca-8f4495a4f845 (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External } } } }, OmicronZoneConfig { id: cc8822ef-cafc-406e-9f14-b015b856f60d (service), filesystem_pool: Some(ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1465cf53-8c70-426b-96c4-e674e36517d4 (service), filesystem_pool: Some(ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
8632024-10-31T20:19:42.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53637
8642024-10-31T20:19:42.146ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e750a05-d6dd-412d-aac1-b776b5e7757f, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8652024-10-31T20:19:42.146ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e750a05-d6dd-412d-aac1-b776b5e7757f, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8662024-10-31T20:19:42.167ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f87fba37-8eb7-413a-91fe-8caa94515963, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8672024-10-31T20:19:42.167ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f87fba37-8eb7-413a-91fe-8caa94515963, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8682024-10-31T20:19:42.185ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
8692024-10-31T20:19:42.185ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8702024-10-31T20:19:42.204ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 73874fe3-61b1-4d68-bae6-7c4f17a34442, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8712024-10-31T20:19:42.204ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 73874fe3-61b1-4d68-bae6-7c4f17a34442, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8722024-10-31T20:19:42.258ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3fd2c678-326b-4230-926e-0c18d4a83e8d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8732024-10-31T20:19:42.258ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3fd2c678-326b-4230-926e-0c18d4a83e8d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8742024-10-31T20:19:42.309ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 44a3d639-c81d-45be-aaca-8f4495a4f845, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8752024-10-31T20:19:42.309ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 44a3d639-c81d-45be-aaca-8f4495a4f845, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8762024-10-31T20:19:42.360ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc8822ef-cafc-406e-9f14-b015b856f60d, dataset_name: DatasetName { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8772024-10-31T20:19:42.360ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: cc8822ef-cafc-406e-9f14-b015b856f60d, dataset_name: DatasetName { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8782024-10-31T20:19:42.411ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1465cf53-8c70-426b-96c4-e674e36517d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
8792024-10-31T20:19:42.411ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1465cf53-8c70-426b-96c4-e674e36517d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8802024-10-31T20:19:42.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8812024-10-31T20:19:42.462ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
8822024-10-31T20:19:42.462ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
8832024-10-31T20:19:42.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8842024-10-31T20:19:42.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8852024-10-31T20:19:42.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8862024-10-31T20:19:42.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8872024-10-31T20:19:42.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8882024-10-31T20:19:42.546ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
8892024-10-31T20:19:42.640ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442 file = illumos-utils/src/zone.rs:325
8902024-10-31T20:19:42.644ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845 file = illumos-utils/src/zone.rs:325
8912024-10-31T20:19:42.648ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d file = illumos-utils/src/zone.rs:325
8922024-10-31T20:19:42.653ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d file = illumos-utils/src/zone.rs:325
8932024-10-31T20:19:42.657ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4 file = illumos-utils/src/zone.rs:325
8942024-10-31T20:19:42.662ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442 file = illumos-utils/src/zone.rs:363
8952024-10-31T20:19:42.667ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845 file = illumos-utils/src/zone.rs:363
8962024-10-31T20:19:42.671ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d file = illumos-utils/src/zone.rs:363
8972024-10-31T20:19:42.676ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d file = illumos-utils/src/zone.rs:363
8982024-10-31T20:19:42.681ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4 file = illumos-utils/src/zone.rs:363
8992024-10-31T20:19:45.561ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='73874fe3-61b1-4d68-bae6-7c4f17a34442'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9002024-10-31T20:19:45.561ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9012024-10-31T20:19:45.567ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1465cf53-8c70-426b-96c4-e674e36517d4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9022024-10-31T20:19:45.567ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9032024-10-31T20:19:45.626ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3fd2c678-326b-4230-926e-0c18d4a83e8d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9042024-10-31T20:19:45.626ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9052024-10-31T20:19:45.639ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='44a3d639-c81d-45be-aaca-8f4495a4f845'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9062024-10-31T20:19:45.639ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9072024-10-31T20:19:45.644ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='cc8822ef-cafc-406e-9f14-b015b856f60d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9082024-10-31T20:19:45.644ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9092024-10-31T20:19:45.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 40.095305ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9102024-10-31T20:19:45.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 30.786327ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9112024-10-31T20:19:45.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 146.929749ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9122024-10-31T20:19:45.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 125.609457ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9132024-10-31T20:19:45.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 61.136842ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9142024-10-31T20:19:45.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 58.666053ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9152024-10-31T20:19:46.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 52.798307ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9162024-10-31T20:19:46.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 287.443003ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9172024-10-31T20:19:46.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 125.712904ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9182024-10-31T20:19:46.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 67.719626ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9192024-10-31T20:19:46.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 286.132319ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9202024-10-31T20:19:46.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 203.407077ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9212024-10-31T20:19:47.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 138.262812ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9222024-10-31T20:19:47.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 68.677088ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9232024-10-31T20:19:47.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 275.739981ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9242024-10-31T20:19:47.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 353.510687ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9252024-10-31T20:19:48.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 1.086483847s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9262024-10-31T20:19:48.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 239.724717ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9272024-10-31T20:19:48.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 147.373209ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9282024-10-31T20:19:48.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 524.936281ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9292024-10-31T20:19:48.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 497.886627ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9302024-10-31T20:19:48.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 513.525312ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9312024-10-31T20:19:48.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 430.46084ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9322024-10-31T20:19:49.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 979.854262ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9332024-10-31T20:19:49.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 434.824439ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9342024-10-31T20:19:49.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 1.32283896s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9352024-10-31T20:19:49.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 1.007962912s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9362024-10-31T20:19:49.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 987.100311ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9372024-10-31T20:19:49.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 707.594418ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9382024-10-31T20:19:50.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 565.252296ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9392024-10-31T20:19:50.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 578.240844ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9402024-10-31T20:19:50.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 1.268866647s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9412024-10-31T20:19:50.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 783.354912ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9422024-10-31T20:19:50.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 1.289466242s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9432024-10-31T20:19:50.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 779.280416ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9442024-10-31T20:19:50.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 537.58715ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9452024-10-31T20:19:51.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 681.4113ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9462024-10-31T20:19:51.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 623.309852ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9472024-10-31T20:19:51.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 1.243691612s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9482024-10-31T20:19:51.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 796.756481ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9492024-10-31T20:19:51.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 737.48518ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9502024-10-31T20:19:51.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 1.177781754s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9512024-10-31T20:19:52.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 869.87922ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9522024-10-31T20:19:52.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 1.29118864s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9532024-10-31T20:19:52.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 692.413079ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9542024-10-31T20:19:52.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 684.480416ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9552024-10-31T20:19:52.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 649.039689ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9562024-10-31T20:19:53.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 1.053616796s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9572024-10-31T20:19:53.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 819.449921ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9582024-10-31T20:19:53.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 568.436187ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9592024-10-31T20:19:53.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 1.358762869s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9602024-10-31T20:19:53.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d") failed: Property not found. retry in 1.410927054s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
9612024-10-31T20:19:53.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4") failed: Property not found. retry in 1.287406975s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
9622024-10-31T20:19:54.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 1.45899147s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9632024-10-31T20:19:54.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 902.936787ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9642024-10-31T20:19:54.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 979.278446ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9652024-10-31T20:19:55.054ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54368
9662024-10-31T20:19:55.054ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 62 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54368 req_id = 39561563-36ef-42d3-86b7-909016c71324 response_code = 200 uri = /baseboard
9672024-10-31T20:19:55.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 1.211026079s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9682024-10-31T20:19:55.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 1.140937176s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9692024-10-31T20:19:55.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 1.121082126s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9702024-10-31T20:19:56.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 568.566707ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9712024-10-31T20:19:56.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 862.514445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9722024-10-31T20:19:57.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 801.708652ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9732024-10-31T20:19:57.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 904.801705ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9742024-10-31T20:19:57.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 1.263321587s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9752024-10-31T20:19:58.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 554.376393ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9762024-10-31T20:19:58.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 634.989276ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9772024-10-31T20:19:58.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 640.109352ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9782024-10-31T20:19:58.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 1.307503396s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9792024-10-31T20:19:58.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 814.843431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9802024-10-31T20:19:59.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 1.262223426s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9812024-10-31T20:19:59.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 1.090594018s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9822024-10-31T20:20:00.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 849.479529ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9832024-10-31T20:20:00.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 1.180425993s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9842024-10-31T20:20:00.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 1.205348011s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9852024-10-31T20:20:01.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 1.184543425s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9862024-10-31T20:20:01.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 1.002280128s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9872024-10-31T20:20:02.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 1.427299226s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9882024-10-31T20:20:02.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 600.154413ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9892024-10-31T20:20:02.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 802.031041ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9902024-10-31T20:20:02.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 861.75622ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9912024-10-31T20:20:03.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 743.55243ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9922024-10-31T20:20:03.592ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 25.941753733s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
9932024-10-31T20:20:03.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845") failed: Property not found. retry in 938.357596ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
9942024-10-31T20:20:03.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 1.036694407s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9952024-10-31T20:20:04.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 512.958223ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9962024-10-31T20:20:04.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442") failed: Property not found. retry in 957.419881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9972024-10-31T20:20:04.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d") failed: Property not found. retry in 1.159144983s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
9982024-10-31T20:20:05.980ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_73874fe3-61b1-4d68-bae6-7c4f17a34442
9992024-10-31T20:20:05.980ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_44a3d639-c81d-45be-aaca-8f4495a4f845
10002024-10-31T20:20:05.980ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_cc8822ef-cafc-406e-9f14-b015b856f60d
10012024-10-31T20:20:05.980ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_3fd2c678-326b-4230-926e-0c18d4a83e8d
10022024-10-31T20:20:05.980ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4
10032024-10-31T20:20:05.980ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10042024-10-31T20:20:05.981ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10052024-10-31T20:20:05.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 23787015 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53637 req_id = 0b37d5a0-05f2-48fb-92d8-7092837f8c33 response_code = 204 uri = /omicron-zones
10062024-10-31T20:20:06.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49880
10072024-10-31T20:20:06.043ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3705
10082024-10-31T20:20:07.663ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3723
10092024-10-31T20:20:20.902ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize CockroachDb: Error running command in zone 'oxz_cockroachdb_1465cf53-8c70-426b-96c4-e674e36517d4': Command [/opt/oxide/cockroachdb/bin/cockroach sql --insecure --host [fd00:1122:3344:101::7]:32221 --file /opt/oxide/cockroachdb/sql/dbinit.sql] executed and failed with status: exit status: 1 stdout: BEGIN\nCREATE DATABASE\nCREATE ROLE\nALTER DEFAULT PRIVILEGES\nCONFIGURE ZONE 1\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\n stderr: ERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_CLIENT_REJECT): "sql txn" meta={id=6f4393cd key=/NamespaceTable/30/1/106/0/"public"/4/1 pri=0.04740586 epo=0 ts=1730406017.673744576,2 min=1730406009.058163139,0 seq=122} lock=true stat=PENDING rts=1730406009.058163139,0 wto=false gul=1730406009.558163139,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_client_reject\nERROR: restart transaction: TransactionRetryWithProtoRefreshError: TransactionAbortedError(ABORT_REASON_CLIENT_REJECT): "sql txn" meta={id=6f4393cd key=/NamespaceTable/30/1/106/0/"public"/4/1 pri=0.04740586 epo=0 ts=1730406017.673744576,2 min=1730406009.058163139,0 seq=122} lock=true stat=PENDING rts=1730406009.058163139,0 wto=false gul=1730406009.558163139,0\nSQLSTATE: 40001\nHINT: See: https://www.cockroachlabs.com/docs/v22.1/transaction-retry-error-reference.html#abort_reason_client_reject\nFailed running "sql"\n file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 14890123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49880 req_id = 3df52028-c62a-44aa-8e6c-e3f7350ec22f response_code = 500 uri = /cockroachdb
10102024-10-31T20:20:20.915ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3df52028-c62a-44aa-8e6c-e3f7350ec22f", "content-length": "124", "date": "Thu, 31 Oct 2024 20:20:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3df52028-c62a-44aa-8e6c-e3f7350ec22f" } file = sled-agent/src/rack_setup/service.rs:1028 retry_after = 84.155813ms
10112024-10-31T20:20:21.051ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3705
10122024-10-31T20:20:21.747ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3723
10132024-10-31T20:20:32.058ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3746
10142024-10-31T20:20:32.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11054688 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49880 req_id = 33865950-6c29-4f19-9849-5c17b0cc2e0b response_code = 204 uri = /cockroachdb
10152024-10-31T20:20:32.058ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54802
10162024-10-31T20:20:32.059ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 849 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54802 req_id = 0c6c7a14-d36b-41c0-b32e-ed3d117790bb response_code = 200 uri = /baseboard
10172024-10-31T20:20:32.102ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 8e750a05-d6dd-412d-aac1-b776b5e7757f (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: f87fba37-8eb7-413a-91fe-8caa94515963 (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 224bd9fe-8e1a-4f23-9604-b2cf690ced7b (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 3ad06602-170b-4b56-a420-10c1efc17b20, kind: Service { id: 224bd9fe-8e1a-4f23-9604-b2cf690ced7b }, name: Name("ntp-224bd9fe-8e1a-4f23-9604-b2cf690ced7b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 45])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 73874fe3-61b1-4d68-bae6-7c4f17a34442 (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3fd2c678-326b-4230-926e-0c18d4a83e8d (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } } } }, OmicronZoneConfig { id: 44a3d639-c81d-45be-aaca-8f4495a4f845 (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External } } } }, OmicronZoneConfig { id: cc8822ef-cafc-406e-9f14-b015b856f60d (service), filesystem_pool: Some(ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1465cf53-8c70-426b-96c4-e674e36517d4 (service), filesystem_pool: Some(ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External } } } }, OmicronZoneConfig { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 02376501-3235-4cfe-a1cd-82b53358d277 (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd (service), filesystem_pool: Some(ZpoolName { id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6e71f19b-440f-4a40-bbbb-fa1de5a7e58c (service), filesystem_pool: Some(ZpoolName { id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: bf452e05-92f8-40c1-8120-1c28611203ec (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 354d0edd-618b-4d7b-8d2a-e25c77dc8947 (service), filesystem_pool: Some(ZpoolName { id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: e1b570ef-4401-482e-9954-f397372e20bc (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 96861afc-96ba-470a-8187-43b230af975d (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 813d541d-a3c6-48b8-9a79-e63ca69b0067 (service), filesystem_pool: Some(ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9fc7ca16-a383-4370-b289-ed5d97420f4c (service), filesystem_pool: Some(ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External } } } }, OmicronZoneConfig { id: 872ebba5-589f-4cb7-bd6b-4f337b831bc3 (service), filesystem_pool: Some(ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0 (service), filesystem_pool: Some(ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9b2044c8-71cb-4c59-aa8f-295f07770de6 (service), filesystem_pool: Some(ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External } } } }, OmicronZoneConfig { id: dc5a296b-b745-4a66-acfc-89cd3e7c8f38 (service), filesystem_pool: Some(ZpoolName { id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool), kind: External } } } }, OmicronZoneConfig { id: 5bd83b76-c1d4-47b1-a5e2-98a87aaa0209 (service), filesystem_pool: Some(ZpoolName { id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool), kind: External } } } }, OmicronZoneConfig { id: 092c2686-49d9-4e5c-a2dc-c32f613d6678 (service), filesystem_pool: Some(ZpoolName { id: 29756246-aa82-409a-9346-5743a657eff3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 29756246-aa82-409a-9346-5743a657eff3 (zpool), kind: External } } } }, OmicronZoneConfig { id: d532d900-a362-4c35-bf25-d282e189f9a6 (service), filesystem_pool: Some(ZpoolName { id: fc2aad54-033d-4218-806a-7c669bd520a9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fc2aad54-033d-4218-806a-7c669bd520a9 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:459 sled_address = [fd00:1122:3344:101::1]:12345
10182024-10-31T20:20:32.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44460
10192024-10-31T20:20:32.103ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e750a05-d6dd-412d-aac1-b776b5e7757f, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10202024-10-31T20:20:32.103ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e750a05-d6dd-412d-aac1-b776b5e7757f, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10212024-10-31T20:20:32.126ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f87fba37-8eb7-413a-91fe-8caa94515963, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10222024-10-31T20:20:32.126ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: f87fba37-8eb7-413a-91fe-8caa94515963, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10232024-10-31T20:20:32.146ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10242024-10-31T20:20:32.147ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 8e764cc9-00d9-46ed-80f0-316c9e4e0a2b, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10252024-10-31T20:20:32.165ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 73874fe3-61b1-4d68-bae6-7c4f17a34442, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10262024-10-31T20:20:32.165ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 73874fe3-61b1-4d68-bae6-7c4f17a34442, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10272024-10-31T20:20:32.184ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3fd2c678-326b-4230-926e-0c18d4a83e8d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10282024-10-31T20:20:32.184ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 3fd2c678-326b-4230-926e-0c18d4a83e8d, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10292024-10-31T20:20:32.203ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 44a3d639-c81d-45be-aaca-8f4495a4f845, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10302024-10-31T20:20:32.203ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 44a3d639-c81d-45be-aaca-8f4495a4f845, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10312024-10-31T20:20:32.222ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc8822ef-cafc-406e-9f14-b015b856f60d, dataset_name: DatasetName { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10322024-10-31T20:20:32.222ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: cc8822ef-cafc-406e-9f14-b015b856f60d, dataset_name: DatasetName { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10332024-10-31T20:20:32.240ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1465cf53-8c70-426b-96c4-e674e36517d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:451
10342024-10-31T20:20:32.240ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 1465cf53-8c70-426b-96c4-e674e36517d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10352024-10-31T20:20:32.258ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a8364658-9f18-48ec-a891-264e5c9fbbb6, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10362024-10-31T20:20:32.258ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: a8364658-9f18-48ec-a891-264e5c9fbbb6, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10372024-10-31T20:20:32.362ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 02376501-3235-4cfe-a1cd-82b53358d277, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:451
10382024-10-31T20:20:32.362ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 02376501-3235-4cfe-a1cd-82b53358d277, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10392024-10-31T20:20:32.438ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bf452e05-92f8-40c1-8120-1c28611203ec, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:451
10402024-10-31T20:20:32.438ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: bf452e05-92f8-40c1-8120-1c28611203ec, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10412024-10-31T20:20:32.508ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 813d541d-a3c6-48b8-9a79-e63ca69b0067, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10422024-10-31T20:20:32.508ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 813d541d-a3c6-48b8-9a79-e63ca69b0067, dataset_name: DatasetName { pool_name: ZpoolName { id: c58d846a-5713-40f9-b784-2f738bd83bc2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10432024-10-31T20:20:32.574ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9fc7ca16-a383-4370-b289-ed5d97420f4c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10442024-10-31T20:20:32.574ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 9fc7ca16-a383-4370-b289-ed5d97420f4c, dataset_name: DatasetName { pool_name: ZpoolName { id: 6cdabbea-dfea-4c4a-a6f2-7df6bde97f34 (zpool), kind: External }, kind: Crucible }, responder: ... }
10452024-10-31T20:20:32.648ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 872ebba5-589f-4cb7-bd6b-4f337b831bc3, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10462024-10-31T20:20:32.648ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 872ebba5-589f-4cb7-bd6b-4f337b831bc3, dataset_name: DatasetName { pool_name: ZpoolName { id: 90a5cbc6-ee3d-4de0-9a29-814842f60db6 (zpool), kind: External }, kind: Crucible }, responder: ... }
10472024-10-31T20:20:32.718ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0, dataset_name: DatasetName { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10482024-10-31T20:20:32.718ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0, dataset_name: DatasetName { pool_name: ZpoolName { id: c0da9f47-3ba9-44de-b97b-4854847926e3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10492024-10-31T20:20:32.808ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9b2044c8-71cb-4c59-aa8f-295f07770de6, dataset_name: DatasetName { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10502024-10-31T20:20:32.808ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 9b2044c8-71cb-4c59-aa8f-295f07770de6, dataset_name: DatasetName { pool_name: ZpoolName { id: d94d1e41-79ad-434a-a5c0-f6dedadc31a6 (zpool), kind: External }, kind: Crucible }, responder: ... }
10512024-10-31T20:20:32.891ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dc5a296b-b745-4a66-acfc-89cd3e7c8f38, dataset_name: DatasetName { pool_name: ZpoolName { id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10522024-10-31T20:20:32.891ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: dc5a296b-b745-4a66-acfc-89cd3e7c8f38, dataset_name: DatasetName { pool_name: ZpoolName { id: b02e5273-d830-439b-a210-08a4dffedb6c (zpool), kind: External }, kind: Crucible }, responder: ... }
10532024-10-31T20:20:32.960ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5bd83b76-c1d4-47b1-a5e2-98a87aaa0209, dataset_name: DatasetName { pool_name: ZpoolName { id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10542024-10-31T20:20:32.960ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 5bd83b76-c1d4-47b1-a5e2-98a87aaa0209, dataset_name: DatasetName { pool_name: ZpoolName { id: d69c81fd-1038-4573-af8f-d97c9e6eb958 (zpool), kind: External }, kind: Crucible }, responder: ... }
10552024-10-31T20:20:33.022ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 092c2686-49d9-4e5c-a2dc-c32f613d6678, dataset_name: DatasetName { pool_name: ZpoolName { id: 29756246-aa82-409a-9346-5743a657eff3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10562024-10-31T20:20:33.022ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: 092c2686-49d9-4e5c-a2dc-c32f613d6678, dataset_name: DatasetName { pool_name: ZpoolName { id: 29756246-aa82-409a-9346-5743a657eff3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10572024-10-31T20:20:33.092ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d532d900-a362-4c35-bf25-d282e189f9a6, dataset_name: DatasetName { pool_name: ZpoolName { id: fc2aad54-033d-4218-806a-7c669bd520a9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:451
10582024-10-31T20:20:33.092ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1059 request = NewFilesystemRequest { dataset_id: d532d900-a362-4c35-bf25-d282e189f9a6, dataset_name: DatasetName { pool_name: ZpoolName { id: fc2aad54-033d-4218-806a-7c669bd520a9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10592024-10-31T20:20:33.165ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10602024-10-31T20:20:33.166ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
10612024-10-31T20:20:33.166ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
10622024-10-31T20:20:33.167ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10632024-10-31T20:20:33.333ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10642024-10-31T20:20:33.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10652024-10-31T20:20:33.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10662024-10-31T20:20:33.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10672024-10-31T20:20:33.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10682024-10-31T20:20:33.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10692024-10-31T20:20:33.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10702024-10-31T20:20:33.333ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10712024-10-31T20:20:33.346ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10722024-10-31T20:20:33.346ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10732024-10-31T20:20:33.517ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10742024-10-31T20:20:33.518ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10752024-10-31T20:20:33.532ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10762024-10-31T20:20:33.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10772024-10-31T20:20:33.532ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10782024-10-31T20:20:33.546ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10792024-10-31T20:20:33.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10802024-10-31T20:20:33.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10812024-10-31T20:20:33.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
10822024-10-31T20:20:33.559ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d file = illumos-utils/src/zone.rs:325
10832024-10-31T20:20:33.564ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6 file = illumos-utils/src/zone.rs:325
10842024-10-31T20:20:33.568ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209 file = illumos-utils/src/zone.rs:325
10852024-10-31T20:20:33.573ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec file = illumos-utils/src/zone.rs:325
10862024-10-31T20:20:33.578ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0 file = illumos-utils/src/zone.rs:325
10872024-10-31T20:20:33.584ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947 file = illumos-utils/src/zone.rs:325
10882024-10-31T20:20:33.588ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067 file = illumos-utils/src/zone.rs:325
10892024-10-31T20:20:33.594ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678 file = illumos-utils/src/zone.rs:325
10902024-10-31T20:20:33.705ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d file = illumos-utils/src/zone.rs:363
10912024-10-31T20:20:33.710ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6 file = illumos-utils/src/zone.rs:363
10922024-10-31T20:20:33.715ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209 file = illumos-utils/src/zone.rs:363
10932024-10-31T20:20:33.719ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec file = illumos-utils/src/zone.rs:363
10942024-10-31T20:20:33.724ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0 file = illumos-utils/src/zone.rs:363
10952024-10-31T20:20:33.729ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947 file = illumos-utils/src/zone.rs:363
10962024-10-31T20:20:33.733ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067 file = illumos-utils/src/zone.rs:363
10972024-10-31T20:20:33.738ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678 file = illumos-utils/src/zone.rs:363
10982024-10-31T20:20:33.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6 file = illumos-utils/src/zone.rs:325
10992024-10-31T20:20:33.748ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc file = illumos-utils/src/zone.rs:325
11002024-10-31T20:20:33.754ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38 file = illumos-utils/src/zone.rs:325
11012024-10-31T20:20:33.759ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = illumos-utils/src/zone.rs:325
11022024-10-31T20:20:33.765ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3 file = illumos-utils/src/zone.rs:325
11032024-10-31T20:20:33.771ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c file = illumos-utils/src/zone.rs:325
11042024-10-31T20:20:33.816ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11052024-10-31T20:20:33.816ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6 file = illumos-utils/src/zone.rs:363
11062024-10-31T20:20:33.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc file = illumos-utils/src/zone.rs:363
11072024-10-31T20:20:33.829ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38 file = illumos-utils/src/zone.rs:363
11082024-10-31T20:20:33.835ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c file = illumos-utils/src/zone.rs:363
11092024-10-31T20:20:33.840ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3 file = illumos-utils/src/zone.rs:363
11102024-10-31T20:20:33.846ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c file = illumos-utils/src/zone.rs:363
11112024-10-31T20:20:33.915ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11122024-10-31T20:20:33.984ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11132024-10-31T20:20:33.988ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11142024-10-31T20:20:33.988ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11152024-10-31T20:20:34.042ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 176, 134]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11162024-10-31T20:20:34.042ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
11172024-10-31T20:20:34.044ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11182024-10-31T20:20:34.044ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11192024-10-31T20:20:34.098ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 211, 19]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11202024-10-31T20:20:34.098ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = external_dns
11212024-10-31T20:20:34.157ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11222024-10-31T20:20:34.282ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11232024-10-31T20:20:34.309ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11242024-10-31T20:20:34.309ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11252024-10-31T20:20:34.364ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 206, 159]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11262024-10-31T20:20:34.364ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11272024-10-31T20:20:34.365ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
11282024-10-31T20:20:34.365ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
11292024-10-31T20:20:34.365ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
11302024-10-31T20:20:34.365ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
11312024-10-31T20:20:34.367ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11322024-10-31T20:20:34.367ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11332024-10-31T20:20:34.424ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 180, 171]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11342024-10-31T20:20:34.424ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11352024-10-31T20:20:34.424ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
11362024-10-31T20:20:34.426ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
11372024-10-31T20:20:34.426ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
11382024-10-31T20:20:34.426ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
11392024-10-31T20:20:34.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11402024-10-31T20:20:34.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11412024-10-31T20:20:34.431ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11422024-10-31T20:20:34.431ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11432024-10-31T20:20:34.487ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 208, 8]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11442024-10-31T20:20:34.487ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1260 zone_type = nexus
11452024-10-31T20:20:34.525ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
11462024-10-31T20:20:34.556ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11472024-10-31T20:20:34.556ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6 file = illumos-utils/src/zone.rs:325
11482024-10-31T20:20:34.593ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277 file = illumos-utils/src/zone.rs:325
11492024-10-31T20:20:34.600ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
11502024-10-31T20:20:34.600ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
11512024-10-31T20:20:34.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6 file = illumos-utils/src/zone.rs:363
11522024-10-31T20:20:34.607ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
11532024-10-31T20:20:34.607ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
11542024-10-31T20:20:34.607ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
11552024-10-31T20:20:34.609ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11562024-10-31T20:20:34.609ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
11572024-10-31T20:20:34.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
11582024-10-31T20:20:34.644ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd file = illumos-utils/src/zone.rs:325
11592024-10-31T20:20:34.651ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277 file = illumos-utils/src/zone.rs:363
11602024-10-31T20:20:34.688ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8 file = illumos-utils/src/zone.rs:325
11612024-10-31T20:20:34.694ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd file = illumos-utils/src/zone.rs:363
11622024-10-31T20:20:34.706ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c file = illumos-utils/src/zone.rs:325
11632024-10-31T20:20:34.715ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8 file = illumos-utils/src/zone.rs:363
11642024-10-31T20:20:34.732ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c file = illumos-utils/src/zone.rs:363
11652024-10-31T20:20:35.692ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11662024-10-31T20:20:35.692ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
11672024-10-31T20:20:35.701ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11682024-10-31T20:20:35.701ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
11692024-10-31T20:20:35.783ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c0da9f47-3ba9-44de-b97b-4854847926e3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='656d411b-2b84-43e5-a509-aecd5007a0f7'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11702024-10-31T20:20:35.784ZINFOSledAgent (ServiceManager): Booting oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
11712024-10-31T20:20:35.791ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c58d846a-5713-40f9-b784-2f738bd83bc2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9a6db8c8-03e6-48ce-9f6f-54ea4951110d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11722024-10-31T20:20:35.791ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d94d1e41-79ad-434a-a5c0-f6dedadc31a6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='972eed5e-5091-452a-9aa9-88a735dfce71'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11732024-10-31T20:20:35.791ZINFOSledAgent (ServiceManager): Booting oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
11742024-10-31T20:20:35.798ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
11752024-10-31T20:20:35.805ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d69c81fd-1038-4573-af8f-d97c9e6eb958/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7ac96f62-60f8-42a0-af9a-bca145e83fcd'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11762024-10-31T20:20:35.806ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
11772024-10-31T20:20:35.823ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_29756246-aa82-409a-9346-5743a657eff3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='001cf4a4-70ff-44bc-9289-495169e1dba8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11782024-10-31T20:20:35.823ZINFOSledAgent (ServiceManager): Booting oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
11792024-10-31T20:20:35.853ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fc2aad54-033d-4218-806a-7c669bd520a9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bcd27bc4-594e-4071-83a3-c2c3dd22ff0d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11802024-10-31T20:20:35.854ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
11812024-10-31T20:20:36.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 49.468061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
11822024-10-31T20:20:36.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 27.403063ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
11832024-10-31T20:20:36.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 35.321151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
11842024-10-31T20:20:36.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 84.799806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
11852024-10-31T20:20:36.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 48.006196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
11862024-10-31T20:20:36.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 48.126648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
11872024-10-31T20:20:36.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 108.638599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
11882024-10-31T20:20:36.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 28.79005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
11892024-10-31T20:20:36.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 52.952256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
11902024-10-31T20:20:36.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 233.199746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
11912024-10-31T20:20:36.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 133.271863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
11922024-10-31T20:20:36.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 74.103525ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
11932024-10-31T20:20:37.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 155.899359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
11942024-10-31T20:20:37.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 123.298881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
11952024-10-31T20:20:37.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 56.212814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
11962024-10-31T20:20:37.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 78.282174ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
11972024-10-31T20:20:37.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 71.035306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
11982024-10-31T20:20:37.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 290.784831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
11992024-10-31T20:20:37.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 116.058172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
12002024-10-31T20:20:37.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 167.741108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
12012024-10-31T20:20:37.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 324.12611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
12022024-10-31T20:20:37.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 222.093981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
12032024-10-31T20:20:37.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 279.854173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
12042024-10-31T20:20:37.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 116.684778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
12052024-10-31T20:20:37.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 142.304369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
12062024-10-31T20:20:37.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 403.985356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
12072024-10-31T20:20:37.801ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b02e5273-d830-439b-a210-08a4dffedb6c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4bc26b6e-f656-42a9-9ad2-8110d74ffb72'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12082024-10-31T20:20:37.802ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
12092024-10-31T20:20:37.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 218.009782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
12102024-10-31T20:20:37.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 210.549954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
12112024-10-31T20:20:37.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 690.707247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
12122024-10-31T20:20:37.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 272.954216ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
12132024-10-31T20:20:37.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 533.684331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
12142024-10-31T20:20:38.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.061188347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
12152024-10-31T20:20:38.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 257.730396ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
12162024-10-31T20:20:38.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 459.56852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
12172024-10-31T20:20:38.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 818.778361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
12182024-10-31T20:20:38.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 46.369967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
12192024-10-31T20:20:38.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 448.872907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
12202024-10-31T20:20:38.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 307.22042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
12212024-10-31T20:20:38.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 60.790676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
12222024-10-31T20:20:38.261ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='6e71f19b-440f-4a40-bbbb-fa1de5a7e58c'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12232024-10-31T20:20:38.261ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
12242024-10-31T20:20:38.307ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12252024-10-31T20:20:38.307ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
12262024-10-31T20:20:38.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.187167217s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
12272024-10-31T20:20:38.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 283.351543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
12282024-10-31T20:20:38.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 32.736958ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
12292024-10-31T20:20:38.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 739.373534ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
12302024-10-31T20:20:38.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 76.099823ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
12312024-10-31T20:20:38.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 445.461313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
12322024-10-31T20:20:38.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 36.642968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
12332024-10-31T20:20:38.584ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_90a5cbc6-ee3d-4de0-9a29-814842f60db6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e14ec8ad-f09b-4294-98e2-a39f2bc28f16'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342024-10-31T20:20:38.584ZINFOSledAgent (ServiceManager): Booting oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
12352024-10-31T20:20:38.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 1.203035812s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
12362024-10-31T20:20:38.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 387.982953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
12372024-10-31T20:20:38.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 979.019597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
12382024-10-31T20:20:38.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 110.103124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
12392024-10-31T20:20:38.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 241.874832ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
12402024-10-31T20:20:38.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 1.386298589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
12412024-10-31T20:20:38.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 144.030895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
12422024-10-31T20:20:38.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 64.626055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
12432024-10-31T20:20:38.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 147.894374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
12442024-10-31T20:20:38.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 590.481495ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
12452024-10-31T20:20:38.933ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12462024-10-31T20:20:38.933ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
12472024-10-31T20:20:38.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 440.164539ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
12482024-10-31T20:20:38.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 1.326537823s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
12492024-10-31T20:20:39.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 793.290587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
12502024-10-31T20:20:39.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 681.688347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
12512024-10-31T20:20:39.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 175.927669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
12522024-10-31T20:20:39.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.013911191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
12532024-10-31T20:20:39.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 52.188013ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
12542024-10-31T20:20:39.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 102.306415ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
12552024-10-31T20:20:39.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 320.760001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
12562024-10-31T20:20:39.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 574.684272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
12572024-10-31T20:20:39.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 127.619506ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
12582024-10-31T20:20:39.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 962.905701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
12592024-10-31T20:20:39.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 425.644486ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
12602024-10-31T20:20:39.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.037004674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
12612024-10-31T20:20:39.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 1.184944343s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
12622024-10-31T20:20:39.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 1.121276256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
12632024-10-31T20:20:39.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 617.468699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
12642024-10-31T20:20:39.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 834.403663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
12652024-10-31T20:20:40.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 868.219936ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
12662024-10-31T20:20:40.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 657.524486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
12672024-10-31T20:20:40.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 1.475996542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
12682024-10-31T20:20:40.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 517.098018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
12692024-10-31T20:20:40.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 874.738644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
12702024-10-31T20:20:40.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 612.298319ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
12712024-10-31T20:20:40.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 1.370907949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
12722024-10-31T20:20:40.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 771.450045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
12732024-10-31T20:20:40.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 896.850871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
12742024-10-31T20:20:40.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.154088378s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
12752024-10-31T20:20:40.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 981.810433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
12762024-10-31T20:20:40.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 1.465278521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
12772024-10-31T20:20:40.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 896.815858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
12782024-10-31T20:20:40.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 818.480421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
12792024-10-31T20:20:40.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 1.073475347s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
12802024-10-31T20:20:41.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 1.336929036s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
12812024-10-31T20:20:41.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 1.174461958s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
12822024-10-31T20:20:41.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 1.021905165s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
12832024-10-31T20:20:41.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 1.207329708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
12842024-10-31T20:20:41.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 1.001467371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
12852024-10-31T20:20:41.565ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862024-10-31T20:20:41.565ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
12872024-10-31T20:20:41.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 1.370904068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
12882024-10-31T20:20:41.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 555.449263ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
12892024-10-31T20:20:41.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 556.736784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
12902024-10-31T20:20:41.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.310595779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
12912024-10-31T20:20:41.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 598.081908ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
12922024-10-31T20:20:41.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 1.332616548s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
12932024-10-31T20:20:41.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 69.891323ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
12942024-10-31T20:20:41.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 54.587418ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
12952024-10-31T20:20:41.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 289.032187ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
12962024-10-31T20:20:42.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 658.144071ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
12972024-10-31T20:20:42.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 514.221993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
12982024-10-31T20:20:42.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 1.434569993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
12992024-10-31T20:20:42.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 263.540646ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
13002024-10-31T20:20:42.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 887.438452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
13012024-10-31T20:20:42.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 915.681413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
13022024-10-31T20:20:42.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 1.019255918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
13032024-10-31T20:20:42.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 780.293154ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
13042024-10-31T20:20:42.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 725.496834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
13052024-10-31T20:20:42.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 1.259951103s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
13062024-10-31T20:20:42.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 1.052402892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
13072024-10-31T20:20:42.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 807.96957ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
13082024-10-31T20:20:42.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 816.624235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
13092024-10-31T20:20:42.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 764.723363ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
13102024-10-31T20:20:43.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 831.663452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
13112024-10-31T20:20:43.051ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13122024-10-31T20:20:43.052ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
13132024-10-31T20:20:43.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.253450581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
13142024-10-31T20:20:43.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.249054587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
13152024-10-31T20:20:43.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 1.209755714s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
13162024-10-31T20:20:43.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 1.113885903s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
13172024-10-31T20:20:43.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 902.437697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
13182024-10-31T20:20:43.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 607.487943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
13192024-10-31T20:20:43.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 1.267199712s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
13202024-10-31T20:20:43.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 949.702127ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
13212024-10-31T20:20:43.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 48.331744ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
13222024-10-31T20:20:43.484ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6cdabbea-dfea-4c4a-a6f2-7df6bde97f34/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cc03e3c3-d9b8-48f8-9946-3a8c131f6700'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13232024-10-31T20:20:43.485ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
13242024-10-31T20:20:43.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 1.051025326s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
13252024-10-31T20:20:43.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 95.186716ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
13262024-10-31T20:20:43.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 881.57671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
13272024-10-31T20:20:43.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 1.260847873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
13282024-10-31T20:20:43.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 615.919086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
13292024-10-31T20:20:43.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 770.086096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
13302024-10-31T20:20:43.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 173.299884ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
13312024-10-31T20:20:43.804ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13322024-10-31T20:20:43.808ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
13332024-10-31T20:20:43.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 55.755403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
13342024-10-31T20:20:43.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 1.289165462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
13352024-10-31T20:20:43.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 640.688073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
13362024-10-31T20:20:43.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 111.876119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
13372024-10-31T20:20:43.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 333.449781ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
13382024-10-31T20:20:44.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 169.314808ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
13392024-10-31T20:20:44.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 717.318154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
13402024-10-31T20:20:44.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 62.790525ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
13412024-10-31T20:20:44.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 114.987368ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
13422024-10-31T20:20:44.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 801.104662ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
13432024-10-31T20:20:44.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 567.691987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
13442024-10-31T20:20:44.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 668.790061ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
13452024-10-31T20:20:44.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 1.289765248s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
13462024-10-31T20:20:44.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 242.84883ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
13472024-10-31T20:20:44.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 572.05831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
13482024-10-31T20:20:44.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 1.146777476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
13492024-10-31T20:20:44.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 1.225849359s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
13502024-10-31T20:20:44.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 850.83093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
13512024-10-31T20:20:44.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.397573763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
13522024-10-31T20:20:44.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 1.383687034s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
13532024-10-31T20:20:44.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 739.786201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
13542024-10-31T20:20:44.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 1.173135607s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
13552024-10-31T20:20:44.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 661.810304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
13562024-10-31T20:20:44.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 582.817907ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
13572024-10-31T20:20:44.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 844.54306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
13582024-10-31T20:20:44.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 1.189009426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
13592024-10-31T20:20:44.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 896.363943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
13602024-10-31T20:20:45.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 1.142322617s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
13612024-10-31T20:20:45.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.153211943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
13622024-10-31T20:20:45.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 902.880119ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
13632024-10-31T20:20:45.130ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13642024-10-31T20:20:45.130ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
13652024-10-31T20:20:45.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 630.056124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
13662024-10-31T20:20:45.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 42.083644ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
13672024-10-31T20:20:45.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 56.967285ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
13682024-10-31T20:20:45.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 1.129604139s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
13692024-10-31T20:20:45.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 1.389828296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
13702024-10-31T20:20:45.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 773.317616ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
13712024-10-31T20:20:45.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 525.560628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
13722024-10-31T20:20:45.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 245.197047ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
13732024-10-31T20:20:45.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 1.364788231s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
13742024-10-31T20:20:45.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 903.135367ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
13752024-10-31T20:20:45.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 691.514562ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
13762024-10-31T20:20:45.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 1.044780582s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
13772024-10-31T20:20:45.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 1.484611445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
13782024-10-31T20:20:45.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 1.26966432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
13792024-10-31T20:20:45.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 1.296751587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
13802024-10-31T20:20:45.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 319.977214ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
13812024-10-31T20:20:46.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 1.464239937s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
13822024-10-31T20:20:46.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.1472016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
13832024-10-31T20:20:46.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 859.606308ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
13842024-10-31T20:20:46.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 1.361955085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
13852024-10-31T20:20:46.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 1.142207634s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
13862024-10-31T20:20:46.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 620.907095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
13872024-10-31T20:20:46.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.165792353s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
13882024-10-31T20:20:46.316ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13892024-10-31T20:20:46.316ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
13902024-10-31T20:20:46.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 424.473314ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
13912024-10-31T20:20:46.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 541.802942ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
13922024-10-31T20:20:46.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 955.091425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
13932024-10-31T20:20:46.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 1.250036635s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
13942024-10-31T20:20:46.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 42.963599ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
13952024-10-31T20:20:46.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 129.700018ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
13962024-10-31T20:20:46.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 801.771328ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
13972024-10-31T20:20:46.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 1.483660405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
13982024-10-31T20:20:46.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 778.607729ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
13992024-10-31T20:20:46.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 275.811001ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14002024-10-31T20:20:46.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 1.31191497s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
14012024-10-31T20:20:46.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 888.767692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
14022024-10-31T20:20:46.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 781.293114ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
14032024-10-31T20:20:46.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 560.697913ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
14042024-10-31T20:20:47.124ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 49.286448134s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:424 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
14052024-10-31T20:20:47.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 268.798452ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14062024-10-31T20:20:47.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 1.286642504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
14072024-10-31T20:20:47.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 526.390361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
14082024-10-31T20:20:47.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 1.257733729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
14092024-10-31T20:20:47.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 1.024730191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
14102024-10-31T20:20:47.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 1.432955009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
14112024-10-31T20:20:47.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 1.446196839s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
14122024-10-31T20:20:47.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 832.53646ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
14132024-10-31T20:20:47.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 911.542464ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14142024-10-31T20:20:47.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 575.671333ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
14152024-10-31T20:20:47.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 779.455224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
14162024-10-31T20:20:47.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 975.498623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
14172024-10-31T20:20:47.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 1.274868698s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
14182024-10-31T20:20:47.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 598.27441ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
14192024-10-31T20:20:47.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 659.091753ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
14202024-10-31T20:20:47.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.233862027s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
14212024-10-31T20:20:47.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 1.191071706s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
14222024-10-31T20:20:47.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 519.472086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
14232024-10-31T20:20:47.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 1.428008495s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
14242024-10-31T20:20:48.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 1.273529573s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
14252024-10-31T20:20:48.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 1.322942657s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
14262024-10-31T20:20:48.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 1.17005689s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
14272024-10-31T20:20:48.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.26011968s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
14282024-10-31T20:20:48.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 1.324327575s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
14292024-10-31T20:20:48.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 1.034477163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
14302024-10-31T20:20:48.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 559.855665ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
14312024-10-31T20:20:48.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 1.351864752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
14322024-10-31T20:20:48.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 1.028305206s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14332024-10-31T20:20:48.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 1.468007017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
14342024-10-31T20:20:48.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 1.440431327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
14352024-10-31T20:20:48.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 657.722872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
14362024-10-31T20:20:48.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 1.107254846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
14372024-10-31T20:20:48.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 1.271990983s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
14382024-10-31T20:20:48.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 1.240015445s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
14392024-10-31T20:20:48.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 716.436524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
14402024-10-31T20:20:48.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 1.4945112s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
14412024-10-31T20:20:48.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 1.069869684s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
14422024-10-31T20:20:49.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.287233567s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
14432024-10-31T20:20:49.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 1.232200525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
14442024-10-31T20:20:49.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 1.492902608s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
14452024-10-31T20:20:49.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 717.514753ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
14462024-10-31T20:20:49.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 1.463188901s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
14472024-10-31T20:20:49.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 606.759312ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14482024-10-31T20:20:49.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 968.91439ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
14492024-10-31T20:20:49.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.483324625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
14502024-10-31T20:20:49.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 679.942846ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
14512024-10-31T20:20:49.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 751.290013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
14522024-10-31T20:20:49.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 831.117481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
14532024-10-31T20:20:49.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 931.845574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
14542024-10-31T20:20:49.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 779.10601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
14552024-10-31T20:20:49.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 868.651685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
14562024-10-31T20:20:49.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 951.701423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
14572024-10-31T20:20:50.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 602.266602ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14582024-10-31T20:20:50.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 1.014099719s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
14592024-10-31T20:20:50.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 830.959865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
14602024-10-31T20:20:50.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 993.571811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
14612024-10-31T20:20:50.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 913.889662ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
14622024-10-31T20:20:50.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 1.261485337s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
14632024-10-31T20:20:50.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 812.000214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
14642024-10-31T20:20:50.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3") failed: Property not found. retry in 960.669599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
14652024-10-31T20:20:50.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 1.329186338s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
14662024-10-31T20:20:50.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 828.203085ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
14672024-10-31T20:20:50.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209") failed: Property not found. retry in 1.386190845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
14682024-10-31T20:20:50.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 1.295180918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
14692024-10-31T20:20:50.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 679.929618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
14702024-10-31T20:20:50.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6") failed: Property not found. retry in 825.353783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
14712024-10-31T20:20:50.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 999.596421ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14722024-10-31T20:20:50.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6") failed: Property not found. retry in 1.176536913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
14732024-10-31T20:20:50.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678") failed: Property not found. retry in 725.278968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
14742024-10-31T20:20:50.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 932.551934ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
14752024-10-31T20:20:50.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d") failed: Property not found. retry in 833.355879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
14762024-10-31T20:20:50.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947") failed: Property not found. retry in 1.373547868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
14772024-10-31T20:20:51.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c") failed: Property not found. retry in 637.191121ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
14782024-10-31T20:20:51.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0") failed: Property not found. retry in 1.371533696s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
14792024-10-31T20:20:51.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 1.486952497s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
14802024-10-31T20:20:51.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc") failed: Property not found. retry in 1.174277692s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
14812024-10-31T20:20:51.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067") failed: Property not found. retry in 1.366467897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
14822024-10-31T20:20:51.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38") failed: Property not found. retry in 889.887939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
14832024-10-31T20:20:51.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6") failed: Property not found. retry in 1.145770921s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
14842024-10-31T20:20:51.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd") failed: Property not found. retry in 919.761585ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
14852024-10-31T20:20:51.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 924.975738ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14862024-10-31T20:20:51.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 602.151213ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
14872024-10-31T20:20:51.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 962.32075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
14882024-10-31T20:20:51.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 650.994016ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
14892024-10-31T20:20:52.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 1.020556952s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
14902024-10-31T20:20:52.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277") failed: Property not found. retry in 1.319465027s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
14912024-10-31T20:20:52.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 1.058826588s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
14922024-10-31T20:20:52.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 1.33185748s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14932024-10-31T20:20:52.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c") failed: Property not found. retry in 1.241077197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
14942024-10-31T20:20:53.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 1.044665251s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
14952024-10-31T20:20:53.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 1.225073401s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
14962024-10-31T20:20:53.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 525.78716ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14972024-10-31T20:20:54.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 822.657532ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
14982024-10-31T20:20:54.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 1.37023345s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
14992024-10-31T20:20:54.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec") failed: Property not found. retry in 856.634705ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
15002024-10-31T20:20:55.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8") failed: Property not found. retry in 1.094018971s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
15012024-10-31T20:20:55.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c") failed: Property not found. retry in 784.571951ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
15022024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_96861afc-96ba-470a-8187-43b230af975d
15032024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_9b2044c8-71cb-4c59-aa8f-295f07770de6
15042024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_5bd83b76-c1d4-47b1-a5e2-98a87aaa0209
15052024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_clickhouse_bf452e05-92f8-40c1-8120-1c28611203ec
15062024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_69e807b0-7bd9-4e07-b5e9-ba38a38b4fc0
15072024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_354d0edd-618b-4d7b-8d2a-e25c77dc8947
15082024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_813d541d-a3c6-48b8-9a79-e63ca69b0067
15092024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_a8364658-9f18-48ec-a891-264e5c9fbbb6
15102024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_092c2686-49d9-4e5c-a2dc-c32f613d6678
15112024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd
15122024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_d532d900-a362-4c35-bf25-d282e189f9a6
15132024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_external_dns_02376501-3235-4cfe-a1cd-82b53358d277
15142024-10-31T20:20:56.715ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_pantry_e1b570ef-4401-482e-9954-f397372e20bc
15152024-10-31T20:20:56.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_dc5a296b-b745-4a66-acfc-89cd3e7c8f38
15162024-10-31T20:20:56.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_d7179265-27eb-4ac0-b81e-90f9c7b4c49c
15172024-10-31T20:20:56.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_oximeter_6e71f19b-440f-4a40-bbbb-fa1de5a7e58c
15182024-10-31T20:20:56.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_872ebba5-589f-4cb7-bd6b-4f337b831bc3
15192024-10-31T20:20:56.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_nexus_d9ba0639-2706-4be9-a317-acca09a0f0a8
15202024-10-31T20:20:56.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3273 zone = oxz_crucible_9fc7ca16-a383-4370-b289-ed5d97420f4c
15212024-10-31T20:20:56.721ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15222024-10-31T20:20:56.723ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15232024-10-31T20:20:56.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 24621399 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44460 req_id = 36bfb9db-1948-46e7-966e-ac47feb73c01 response_code = 204 uri = /omicron-zones
15242024-10-31T20:20:56.741ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1322
15252024-10-31T20:20:56.741ZINFOSledAgent (RSS): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15262024-10-31T20:20:56.743ZINFOSledAgent (RSS): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15272024-10-31T20:20:56.748ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:708
15282024-10-31T20:20:56.758ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:720
15292024-10-31T20:20:56.803ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:887
15302024-10-31T20:20:56.811ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15312024-10-31T20:20:56.910ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15322024-10-31T20:20:57.002ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15332024-10-31T20:20:57.205ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15342024-10-31T20:20:57.446ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15352024-10-31T20:20:57.622ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15362024-10-31T20:20:57.932ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15372024-10-31T20:20:58.121ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15382024-10-31T20:20:58.655ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15392024-10-31T20:20:59.079ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15402024-10-31T20:20:59.393ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15412024-10-31T20:20:59.766ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15422024-10-31T20:21:00.563ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15432024-10-31T20:21:01.236ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15442024-10-31T20:21:01.736ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/nexus.rs:527 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
15452024-10-31T20:21:02.106ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33051
15462024-10-31T20:21:02.108ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 558 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33051 req_id = 095c7694-103d-4b84-9084-547128ba4a52 response_code = 200 uri = /baseboard
15472024-10-31T20:21:02.134ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/nexus.rs:527 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
15482024-10-31T20:21:02.586ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15492024-10-31T20:21:02.767ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/probe_manager.rs:231 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
15502024-10-31T20:21:03.770ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/probe_manager.rs:231 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
15512024-10-31T20:21:03.932ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15522024-10-31T20:21:04.131ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/nexus.rs:527 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
15532024-10-31T20:21:04.732ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/cf9a2d24-88ed-47a2-a402-0cbbba2d1439/initialization-complete) file = sled-agent/src/rack_setup/service.rs:949
15542024-10-31T20:21:04.772ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/622abb78-eb68-41c1-ac52-e7a263024e57) file = sled-agent/src/probe_manager.rs:231 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
15552024-10-31T20:21:08.541ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
15562024-10-31T20:21:11.571ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a68681e3-972d-40c4-9bda-449bde7ca005", "content-length": "173", "date": "Thu, 31 Oct 2024 20:21:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cf9a2d24-88ed-47a2-a402-0cbbba2d1439\"", request_id: "a68681e3-972d-40c4-9bda-449bde7ca005" } file = sled-agent/src/rack_setup/service.rs:949
15572024-10-31T20:21:14.002ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "268a530a-7a38-4f03-b39c-185377562b06", "content-length": "173", "date": "Thu, 31 Oct 2024 20:21:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cf9a2d24-88ed-47a2-a402-0cbbba2d1439\"", request_id: "268a530a-7a38-4f03-b39c-185377562b06" } file = sled-agent/src/rack_setup/service.rs:949
15582024-10-31T20:21:17.438ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "12d71738-09c7-4c11-902b-f2166a440831", "content-length": "173", "date": "Thu, 31 Oct 2024 20:21:17 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"cf9a2d24-88ed-47a2-a402-0cbbba2d1439\"", request_id: "12d71738-09c7-4c11-902b-f2166a440831" } file = sled-agent/src/rack_setup/service.rs:949
15592024-10-31T20:21:18.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63448
15602024-10-31T20:21:18.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 874 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63448 req_id = cab7ca98-de18-4ef2-adce-99a47a6c5d64 response_code = 200 uri = /vpc-routes
15612024-10-31T20:21:19.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44610
15622024-10-31T20:21:19.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44610 req_id = 0db971e0-7f48-432c-917d-d5073c6752d5 response_code = 200 uri = /vpc-routes
15632024-10-31T20:21:19.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44748
15642024-10-31T20:21:19.177ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15652024-10-31T20:21:19.177ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15662024-10-31T20:21:19.178ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
15672024-10-31T20:21:19.183ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
15682024-10-31T20:21:19.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38432
15692024-10-31T20:21:19.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15702024-10-31T20:21:19.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15712024-10-31T20:21:19.210ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
15722024-10-31T20:21:19.210ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
15732024-10-31T20:21:19.230ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
15742024-10-31T20:21:19.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63448 req_id = 389cc66c-45ff-4cf5-9509-5b16ebd41ba2 response_code = 204 uri = /eip-gateways
15752024-10-31T20:21:19.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36010
15762024-10-31T20:21:19.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36010 req_id = 6cdc0d48-a83a-4084-893a-aab8287d203a response_code = 200 uri = /vpc-routes
15772024-10-31T20:21:19.334ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
15782024-10-31T20:21:19.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44610 req_id = 9ab2a405-73a1-494e-8f60-814911fce8f6 response_code = 204 uri = /eip-gateways
15792024-10-31T20:21:19.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
15802024-10-31T20:21:19.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36010 req_id = 753559e1-b6e9-48e6-a739-dad2e5d0e3f9 response_code = 204 uri = /eip-gateways
15812024-10-31T20:21:19.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62278
15822024-10-31T20:21:19.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1777 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62278 req_id = e0607d2a-c6e4-44e1-870c-220bb513bb77 response_code = 200 uri = /v2p
15832024-10-31T20:21:19.359ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61300
15842024-10-31T20:21:19.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61300 req_id = b2fec39e-e124-4656-b138-20791f022e86 response_code = 200 uri = /v2p
15852024-10-31T20:21:19.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43768
15862024-10-31T20:21:19.381ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15872024-10-31T20:21:19.381ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
15882024-10-31T20:21:19.381ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
15892024-10-31T20:21:19.381ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
15902024-10-31T20:21:19.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 22917 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44610 req_id = 52fec4ff-915d-4c05-9c84-cd78e90ef569 response_code = 204 uri = /vpc-routes
15912024-10-31T20:21:19.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 314163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44748 req_id = 13d15878-c1c1-48f8-9540-98ef58376f6a response_code = 200 uri = /inventory
15922024-10-31T20:21:19.494ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
15932024-10-31T20:21:19.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63448 req_id = 8903dcd3-d281-409d-9058-562de598e6e8 response_code = 204 uri = /vpc-routes
15942024-10-31T20:21:19.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60390
15952024-10-31T20:21:19.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60390 req_id = ba951af3-f211-4c4a-b61f-e0753baa3db0 response_code = 200 uri = /v2p
15962024-10-31T20:21:19.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 303933 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38432 req_id = 5c6e85ff-b56f-4ba7-ae1a-f1cc9e3950f5 response_code = 200 uri = /inventory
15972024-10-31T20:21:19.587ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:469 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
15982024-10-31T20:21:19.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 855 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36010 req_id = c43b21aa-b24d-4368-a2e9-122df97bd5b6 response_code = 204 uri = /vpc-routes
15992024-10-31T20:21:19.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 247213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43768 req_id = c5a60ceb-3d84-4f37-8e58-f39ed5103150 response_code = 200 uri = /inventory
16002024-10-31T20:21:20.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65077
16012024-10-31T20:21:20.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16022024-10-31T20:21:20.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16032024-10-31T20:21:20.049ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
16042024-10-31T20:21:20.050ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
16052024-10-31T20:21:20.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 228107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65077 req_id = 549df2a9-9c77-4cf4-9658-edddd6828ecb response_code = 200 uri = /inventory
16062024-10-31T20:21:23.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38633
16072024-10-31T20:21:23.529ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16082024-10-31T20:21:23.529ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16092024-10-31T20:21:23.529ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16102024-10-31T20:21:23.529ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16112024-10-31T20:21:23.529ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16122024-10-31T20:21:23.529ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16132024-10-31T20:21:23.529ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16142024-10-31T20:21:23.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38633 req_id = 2fb87ae9-cdc6-4eae-81ea-aa2875fccb6b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16152024-10-31T20:21:23.531ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:959
16162024-10-31T20:21:23.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62757
16172024-10-31T20:21:23.694ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16182024-10-31T20:21:23.694ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16192024-10-31T20:21:23.694ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16202024-10-31T20:21:23.694ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16212024-10-31T20:21:23.694ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16222024-10-31T20:21:23.694ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16232024-10-31T20:21:23.694ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16242024-10-31T20:21:23.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62757 req_id = 65ac0ac0-c593-418e-ae5b-b383a52de7ef response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16252024-10-31T20:21:23.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61157
16262024-10-31T20:21:23.699ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16272024-10-31T20:21:23.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16282024-10-31T20:21:23.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16292024-10-31T20:21:23.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16302024-10-31T20:21:23.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16312024-10-31T20:21:23.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16322024-10-31T20:21:23.699ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16332024-10-31T20:21:23.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61157 req_id = d9aaa3f1-cf97-420e-a245-61d711e72ed6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16342024-10-31T20:21:23.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39682
16352024-10-31T20:21:23.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16362024-10-31T20:21:23.946ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
16372024-10-31T20:21:23.946ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
16382024-10-31T20:21:23.946ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
16392024-10-31T20:21:24.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 210942 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39682 req_id = 8d1179d8-1515-44bc-a2ae-a2b9fd8f7ab2 response_code = 200 uri = /inventory
16402024-10-31T20:21:25.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59873
16412024-10-31T20:21:25.213ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16422024-10-31T20:21:25.214ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
16432024-10-31T20:21:25.214ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16442024-10-31T20:21:25.214ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16452024-10-31T20:21:25.214ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16462024-10-31T20:21:25.214ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16472024-10-31T20:21:25.214ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16482024-10-31T20:21:25.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59873 req_id = 87074c40-a467-4529-8cd1-90827a9d3a69 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16492024-10-31T20:21:30.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46781
16502024-10-31T20:21:30.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46781 req_id = 19c3c716-72c5-4103-a598-e46bf926bbfc response_code = 200 uri = /vpc-routes
16512024-10-31T20:21:30.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
16522024-10-31T20:21:30.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46781 req_id = b19770d6-eab0-469c-b7d8-82c5c1c61d8a response_code = 204 uri = /eip-gateways
16532024-10-31T20:21:30.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46781 req_id = f5d389f8-bbd4-4214-8f08-6eda0780d37a response_code = 204 uri = /vpc-routes
16542024-10-31T20:21:32.142ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58527
16552024-10-31T20:21:32.142ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58527 req_id = 529a2a69-4bac-4ae3-8bc1-ab1179e53d65 response_code = 200 uri = /baseboard
16562024-10-31T20:21:37.924ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:38736 remote_addr = [fd00:1122:3344:101::d]:57858 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
16572024-10-31T20:21:37.942ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 17132 local_addr = [fd00:1122:3344:101::1]:38736 method = GET remote_addr = [fd00:1122:3344:101::d]:57858 req_id = bc50103d-740f-4d2a-993f-cecf4855e282 response_code = 200 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 uri = /622abb78-eb68-41c1-ac52-e7a263024e57
16582024-10-31T20:21:49.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33784
16592024-10-31T20:21:49.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33784 req_id = a8fa64d2-daf3-4827-9ab3-67fda62b0a5e response_code = 200 uri = /vpc-routes
16602024-10-31T20:21:49.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57972
16612024-10-31T20:21:49.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57972 req_id = 8a235781-653c-4a38-a13d-543097b265d3 response_code = 200 uri = /v2p
16622024-10-31T20:21:49.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
16632024-10-31T20:21:49.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33784 req_id = 44124af3-7056-4b9c-ba88-35b04e6badbc response_code = 204 uri = /eip-gateways
16642024-10-31T20:21:49.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33784 req_id = e158a3aa-91b7-4bc8-9e1c-bef4006e9c33 response_code = 204 uri = /vpc-routes
16652024-10-31T20:21:49.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62713
16662024-10-31T20:21:49.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62713 req_id = daafcf9e-3099-4d1d-843c-14410f2f006f response_code = 200 uri = /vpc-routes
16672024-10-31T20:21:49.223ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
16682024-10-31T20:21:49.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62713 req_id = 03c1a1bd-7dbb-48c2-a392-643b5bb0f11a response_code = 204 uri = /eip-gateways
16692024-10-31T20:21:49.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62713 req_id = e50f7408-58c8-4865-b7c6-0859e32040fa response_code = 204 uri = /vpc-routes
16702024-10-31T20:21:49.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57399
16712024-10-31T20:21:49.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57399 req_id = c4574eb3-bb18-4bb5-aa1e-623503a2bc27 response_code = 200 uri = /vpc-routes
16722024-10-31T20:21:49.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57271
16732024-10-31T20:21:49.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16742024-10-31T20:21:49.322ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16752024-10-31T20:21:49.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57271 req_id = df6baf1f-ad4a-4f10-a7fb-b32481c24213 response_code = 204 uri = /switch-ports
16762024-10-31T20:21:49.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33925
16772024-10-31T20:21:49.385ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
16782024-10-31T20:21:49.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57399 req_id = 9160eba5-1a90-450d-bc53-bf41ef06a8c9 response_code = 204 uri = /eip-gateways
16792024-10-31T20:21:49.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38593
16802024-10-31T20:21:49.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58998
16812024-10-31T20:21:49.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33925 req_id = 940a0a13-68f5-40c0-8507-f28e6a369411 response_code = 200 uri = /v2p
16822024-10-31T20:21:49.386ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16832024-10-31T20:21:49.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58998 req_id = c2ef1d1c-be4f-481c-8a23-932a6a11f231 response_code = 200 uri = /v2p
16842024-10-31T20:21:49.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5463 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57271 req_id = 52288c69-7a9c-4339-9e7b-7fd6d252a48f response_code = 200 uri = /network-bootstore-config
16852024-10-31T20:21:49.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57399 req_id = 38328a85-ee4d-4d95-8fc7-7ace0085a3e5 response_code = 204 uri = /vpc-routes
16862024-10-31T20:21:49.431ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16872024-10-31T20:21:49.438ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
16882024-10-31T20:21:49.438ZINFOSledAgent (bootstore): Writing ledger to /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16892024-10-31T20:21:49.439ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
16902024-10-31T20:21:49.440ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
16912024-10-31T20:21:49.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57271 req_id = f79589ba-2fb5-4bc0-8ab8-7263fb23fa14 response_code = 204 uri = /network-bootstore-config
16922024-10-31T20:21:49.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54913
16932024-10-31T20:21:49.492ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
16942024-10-31T20:21:49.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38593 req_id = d099357e-f278-4cd7-9af3-9bc540616f17 response_code = 204 uri = /switch-ports
16952024-10-31T20:21:49.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 707 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38593 req_id = d5b1c910-d54a-457e-9efa-14ba4d19bd06 response_code = 200 uri = /network-bootstore-config
16962024-10-31T20:21:49.529ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
16972024-10-31T20:21:49.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54913 req_id = fb3623af-1a1c-4dbe-beb0-a984cbaa2efc response_code = 204 uri = /switch-ports
16982024-10-31T20:21:49.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54913 req_id = a15cf6c0-7e4e-497d-9b37-757ffa905be0 response_code = 200 uri = /network-bootstore-config
16992024-10-31T20:22:02.184ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62304
17002024-10-31T20:22:02.184ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62304 req_id = 3426f2a7-6c50-4405-9426-2f29a2f168a6 response_code = 200 uri = /baseboard
17012024-10-31T20:22:18.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59507
17022024-10-31T20:22:18.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59507 req_id = d1b4b273-bcfc-4826-899b-5f40fc0d4b5e response_code = 200 uri = /vpc-routes
17032024-10-31T20:22:19.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
17042024-10-31T20:22:19.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59507 req_id = 536300fd-9653-474b-b680-ca498099e9ba response_code = 204 uri = /eip-gateways
17052024-10-31T20:22:19.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59507 req_id = b0f9f3a1-0064-4777-95f4-334eb633de2b response_code = 204 uri = /vpc-routes
17062024-10-31T20:22:19.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52273
17072024-10-31T20:22:19.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52273 req_id = e58efb2c-1e7c-4fd1-a3cb-5d2bea44a7ed response_code = 200 uri = /v2p
17082024-10-31T20:22:19.141ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
17092024-10-31T20:22:19.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58157
17102024-10-31T20:22:19.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58157 req_id = 9b9abb27-76d9-477c-b6b7-e7771ca03051 response_code = 200 uri = /vpc-routes
17112024-10-31T20:22:19.233ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
17122024-10-31T20:22:19.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58157 req_id = 37d07f1e-5828-4e74-bd0f-830f1c3d351e response_code = 204 uri = /eip-gateways
17132024-10-31T20:22:19.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62119
17142024-10-31T20:22:19.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17152024-10-31T20:22:19.281ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17162024-10-31T20:22:19.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110949 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62119 req_id = 83735ef9-45a5-4ed7-8e50-2a8d7ba9e289 response_code = 204 uri = /switch-ports
17172024-10-31T20:22:19.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59520
17182024-10-31T20:22:19.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62119 req_id = 3d50c747-bb3f-48a7-8a4a-29b5901f5679 response_code = 200 uri = /network-bootstore-config
17192024-10-31T20:22:19.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58157 req_id = 0d0a5589-1334-4b19-b045-8ce4e5a739a8 response_code = 204 uri = /vpc-routes
17202024-10-31T20:22:19.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59520 req_id = 655905c3-9a40-4f14-9f00-b94674879c6f response_code = 200 uri = /vpc-routes
17212024-10-31T20:22:19.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55058
17222024-10-31T20:22:19.366ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17232024-10-31T20:22:19.404ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17242024-10-31T20:22:19.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93559 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55058 req_id = 2ea407fe-dde9-4d3c-ac67-26818411b223 response_code = 204 uri = /switch-ports
17252024-10-31T20:22:19.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60188
17262024-10-31T20:22:19.459ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
17272024-10-31T20:22:19.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59520 req_id = 7b5cb098-20d7-41db-bd30-eacd779486fa response_code = 204 uri = /eip-gateways
17282024-10-31T20:22:19.460ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17292024-10-31T20:22:19.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55058 req_id = c3f017f3-37d4-46e1-b01e-d8f695da3ac6 response_code = 200 uri = /network-bootstore-config
17302024-10-31T20:22:19.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43959
17312024-10-31T20:22:19.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43959 req_id = 16629c58-905b-4be2-803c-a9d989a369fc response_code = 200 uri = /v2p
17322024-10-31T20:22:19.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58716
17332024-10-31T20:22:19.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58716 req_id = a2cfd40f-7c9d-4134-a293-021ebcdadd1e response_code = 200 uri = /v2p
17342024-10-31T20:22:19.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59520 req_id = 60a64edf-6f6c-4463-bee4-95ec88a80f42 response_code = 204 uri = /vpc-routes
17352024-10-31T20:22:19.497ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17362024-10-31T20:22:19.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92114 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60188 req_id = 7d4f3aaf-eefa-4279-a14b-de2325ff0542 response_code = 204 uri = /switch-ports
17372024-10-31T20:22:19.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60188 req_id = 3ebc4290-3a79-49e1-b94a-815422bbcc24 response_code = 200 uri = /network-bootstore-config
17382024-10-31T20:22:32.218ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41827
17392024-10-31T20:22:32.218ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41827 req_id = 99e02278-e4d1-4438-9316-da32a18ac55f response_code = 200 uri = /baseboard
17402024-10-31T20:22:48.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39431
17412024-10-31T20:22:48.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39431 req_id = c2e12dc3-5f16-4ef9-aeeb-0c3e8b0797ce response_code = 200 uri = /v2p
17422024-10-31T20:22:48.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61051
17432024-10-31T20:22:48.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61051 req_id = c3fec827-7fdb-4d99-a40d-a07a88c80b4c response_code = 200 uri = /vpc-routes
17442024-10-31T20:22:48.946ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
17452024-10-31T20:22:48.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61051 req_id = 2269b31d-ecf0-411e-87ab-38f3fca6ff99 response_code = 204 uri = /eip-gateways
17462024-10-31T20:22:48.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61051 req_id = 3915df3c-c8c3-4b9e-9d20-a496d737b498 response_code = 204 uri = /vpc-routes
17472024-10-31T20:22:48.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56680
17482024-10-31T20:22:48.959ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17492024-10-31T20:22:48.997ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17502024-10-31T20:22:49.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111259 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56680 req_id = a6991bed-87ec-4b38-be91-05fb65b730e6 response_code = 204 uri = /switch-ports
17512024-10-31T20:22:49.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41809
17522024-10-31T20:22:49.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41809 req_id = 57d10145-1497-4c8e-9c8d-be86ebbedd90 response_code = 200 uri = /vpc-routes
17532024-10-31T20:22:49.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56680 req_id = d30d1c51-5916-440d-84cb-df31fe5c7c4a response_code = 200 uri = /network-bootstore-config
17542024-10-31T20:22:49.121ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
17552024-10-31T20:22:49.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41809 req_id = fd3c91ad-7b7a-4b04-aae2-5f7fa4e8fe89 response_code = 204 uri = /eip-gateways
17562024-10-31T20:22:49.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56672
17572024-10-31T20:22:49.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56672 req_id = af52fcd3-5d57-48cb-a356-e63424419a02 response_code = 200 uri = /vpc-routes
17582024-10-31T20:22:49.210ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
17592024-10-31T20:22:49.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56672 req_id = 628d6935-ad47-4c85-90b8-a502064ca134 response_code = 204 uri = /eip-gateways
17602024-10-31T20:22:49.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56672 req_id = 830ac6d1-8702-4c8d-a2f5-0803ade6c9e1 response_code = 204 uri = /vpc-routes
17612024-10-31T20:22:49.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45987
17622024-10-31T20:22:49.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45987 req_id = da6a180e-4826-4866-897e-109cf6180f94 response_code = 200 uri = /v2p
17632024-10-31T20:22:49.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41809 req_id = 546464f3-7cc6-4199-96df-c16db109cef3 response_code = 204 uri = /vpc-routes
17642024-10-31T20:22:49.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50194
17652024-10-31T20:22:49.277ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17662024-10-31T20:22:49.320ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17672024-10-31T20:22:49.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50194 req_id = 97745c40-182b-44a9-8b89-524c7fd1782b response_code = 204 uri = /switch-ports
17682024-10-31T20:22:49.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37201
17692024-10-31T20:22:49.383ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17702024-10-31T20:22:49.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50194 req_id = 96503c35-4259-4926-8cd6-fbee50f512cd response_code = 200 uri = /network-bootstore-config
17712024-10-31T20:22:49.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63891
17722024-10-31T20:22:49.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63891 req_id = 6249f527-8dde-4735-9311-6f377e45af0d response_code = 200 uri = /v2p
17732024-10-31T20:22:49.419ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17742024-10-31T20:22:49.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37201 req_id = 452dd924-6564-4d77-af6b-ee5fbe509af9 response_code = 204 uri = /switch-ports
17752024-10-31T20:22:49.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37201 req_id = c02eb420-3ae4-4c6e-b074-8722e32b6742 response_code = 200 uri = /network-bootstore-config
17762024-10-31T20:23:02.251ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52583
17772024-10-31T20:23:02.251ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52583 req_id = 9cd1549a-0ef1-4db5-b053-0aa5f5446bf4 response_code = 200 uri = /baseboard
17782024-10-31T20:23:19.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61539
17792024-10-31T20:23:19.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61539 req_id = 87701e6d-4d7e-47c5-a9f8-f5b032454ecd response_code = 200 uri = /v2p
17802024-10-31T20:23:19.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54337
17812024-10-31T20:23:19.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54337 req_id = dcf95fd8-309e-4768-b3d0-6592fa83008d response_code = 200 uri = /vpc-routes
17822024-10-31T20:23:19.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
17832024-10-31T20:23:19.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54337 req_id = d686f84b-5402-4772-b124-1aa8677264ca response_code = 204 uri = /eip-gateways
17842024-10-31T20:23:19.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54337 req_id = 984d673f-d144-443d-955e-3fbc135fdf46 response_code = 204 uri = /vpc-routes
17852024-10-31T20:23:19.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40601
17862024-10-31T20:23:19.234ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17872024-10-31T20:23:19.278ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17882024-10-31T20:23:19.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40601 req_id = 382190b8-509e-4333-9b8f-8f9fdbb0fe43 response_code = 204 uri = /switch-ports
17892024-10-31T20:23:19.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62605
17902024-10-31T20:23:19.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62605 req_id = 8bc2b111-7bf7-4d94-b78b-4f346c63580e response_code = 200 uri = /vpc-routes
17912024-10-31T20:23:19.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40601 req_id = 4c223c91-4b12-48d3-ae15-be9821f82ae9 response_code = 200 uri = /network-bootstore-config
17922024-10-31T20:23:19.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43115
17932024-10-31T20:23:19.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43115 req_id = 89c662a0-484d-442c-b6bb-5e86dd19d06e response_code = 200 uri = /vpc-routes
17942024-10-31T20:23:19.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58495
17952024-10-31T20:23:19.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58495 req_id = 577575c4-468f-4b0c-a36a-a60a32f6367c response_code = 200 uri = /v2p
17962024-10-31T20:23:19.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36319
17972024-10-31T20:23:19.373ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
17982024-10-31T20:23:19.413ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
17992024-10-31T20:23:19.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36319 req_id = 2608380a-bf58-4cb6-a928-632792b15c33 response_code = 204 uri = /switch-ports
18002024-10-31T20:23:19.470ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18012024-10-31T20:23:19.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62605 req_id = b63bc287-7418-4407-95a5-326427a48ce7 response_code = 204 uri = /eip-gateways
18022024-10-31T20:23:19.470ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18032024-10-31T20:23:19.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43115 req_id = ab49702c-a3c1-4dfb-ad4c-1f5367142dab response_code = 204 uri = /eip-gateways
18042024-10-31T20:23:19.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36319 req_id = 26b755fa-2da1-4aa6-851d-858eabdf27c3 response_code = 200 uri = /network-bootstore-config
18052024-10-31T20:23:19.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62605 req_id = 75b21109-31a0-4bb6-901c-35720b95ffef response_code = 204 uri = /vpc-routes
18062024-10-31T20:23:19.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54769
18072024-10-31T20:23:19.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54769 req_id = cd826e6a-785b-4935-8cf4-ea83524e05c1 response_code = 200 uri = /v2p
18082024-10-31T20:23:19.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43115 req_id = 5f0d2f91-0199-4b05-ad6e-95f85c95411e response_code = 204 uri = /vpc-routes
18092024-10-31T20:23:19.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52435
18102024-10-31T20:23:19.731ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18112024-10-31T20:23:19.766ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18122024-10-31T20:23:19.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52435 req_id = 9f8a2197-ecf1-4cd8-9f24-371fc50c730f response_code = 204 uri = /switch-ports
18132024-10-31T20:23:19.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52435 req_id = e574be5e-df65-4c0c-b488-b9aec853d7d8 response_code = 200 uri = /network-bootstore-config
18142024-10-31T20:23:32.284ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42365
18152024-10-31T20:23:32.285ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 24 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42365 req_id = ea077828-f396-4138-9960-a20aad291e0d response_code = 200 uri = /baseboard
18162024-10-31T20:23:48.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63287
18172024-10-31T20:23:48.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63287 req_id = 1d6414b7-0909-4079-989a-c14db5591b71 response_code = 200 uri = /vpc-routes
18182024-10-31T20:23:48.948ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18192024-10-31T20:23:48.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63287 req_id = 0e1297c2-22c6-4683-b296-62ce694559bd response_code = 204 uri = /eip-gateways
18202024-10-31T20:23:48.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63287 req_id = 3f9fd34d-cf8b-4c14-8235-db49ab5d532c response_code = 204 uri = /vpc-routes
18212024-10-31T20:23:49.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45541
18222024-10-31T20:23:49.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45541 req_id = 3749f576-4b7d-4397-9e68-767d90f482ca response_code = 200 uri = /v2p
18232024-10-31T20:23:49.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55190
18242024-10-31T20:23:49.020ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18252024-10-31T20:23:49.068ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18262024-10-31T20:23:49.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119208 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55190 req_id = cad5a98e-b3fb-4d30-a76f-453dc2bb690b response_code = 204 uri = /switch-ports
18272024-10-31T20:23:49.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63467
18282024-10-31T20:23:49.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63467 req_id = fd36b16b-10d4-4aa3-ae1c-b9b2a4ec7ecc response_code = 200 uri = /vpc-routes
18292024-10-31T20:23:49.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55190 req_id = 2d2ff031-cd16-4d38-aadc-ae5849683e3a response_code = 200 uri = /network-bootstore-config
18302024-10-31T20:23:49.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39314
18312024-10-31T20:23:49.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18322024-10-31T20:23:49.235ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18332024-10-31T20:23:49.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88893 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39314 req_id = 286f69e3-9aae-47d5-baa1-0a1a552e888b response_code = 204 uri = /switch-ports
18342024-10-31T20:23:49.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45659
18352024-10-31T20:23:49.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63506
18362024-10-31T20:23:49.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63506 req_id = 53404b5a-853e-4012-8cd0-baf1a1e1ea75 response_code = 200 uri = /vpc-routes
18372024-10-31T20:23:49.290ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18382024-10-31T20:23:49.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63467 req_id = a1a37c06-826a-431c-ac1b-495252e838a4 response_code = 204 uri = /eip-gateways
18392024-10-31T20:23:49.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39314 req_id = a0388998-1bca-4594-bc27-06fffed50b72 response_code = 200 uri = /network-bootstore-config
18402024-10-31T20:23:49.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45659 req_id = 0543ba29-4192-4f6f-8b71-486cce4ec022 response_code = 200 uri = /v2p
18412024-10-31T20:23:49.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63467 req_id = 91416f12-211a-4400-94f4-33a9be8a9d11 response_code = 204 uri = /vpc-routes
18422024-10-31T20:23:49.307ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18432024-10-31T20:23:49.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63506 req_id = cdc9c817-75e6-45d7-a79b-f96dfd2579f0 response_code = 204 uri = /eip-gateways
18442024-10-31T20:23:49.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63506 req_id = 46b2f783-3466-4e18-83a7-70b8f68e1ea4 response_code = 204 uri = /vpc-routes
18452024-10-31T20:23:49.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39466
18462024-10-31T20:23:49.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39466 req_id = 106b1771-5022-46b7-bb94-5753df97f313 response_code = 200 uri = /v2p
18472024-10-31T20:23:49.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62119
18482024-10-31T20:23:49.483ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18492024-10-31T20:23:49.515ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18502024-10-31T20:23:49.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82729 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62119 req_id = 42dafba9-dca7-4007-a9fe-99e8ec90a6a0 response_code = 204 uri = /switch-ports
18512024-10-31T20:23:49.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62119 req_id = 34d9433f-eb96-4123-8fcb-022cde0e37c5 response_code = 200 uri = /network-bootstore-config
18522024-10-31T20:24:02.317ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63364
18532024-10-31T20:24:02.317ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63364 req_id = 6a01c9b8-da64-403e-a1a9-71e2e0215cb6 response_code = 200 uri = /baseboard
18542024-10-31T20:24:18.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37557
18552024-10-31T20:24:18.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37557 req_id = b7487cae-cc20-458b-958a-2b682b751a45 response_code = 200 uri = /vpc-routes
18562024-10-31T20:24:19.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32933
18572024-10-31T20:24:19.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32933 req_id = b0627db0-d10e-492e-a3fe-301b83edd9b0 response_code = 200 uri = /v2p
18582024-10-31T20:24:19.109ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18592024-10-31T20:24:19.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37557 req_id = 54f2a330-a496-4fde-8dcd-6274a10a0f39 response_code = 204 uri = /eip-gateways
18602024-10-31T20:24:19.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37557 req_id = 79da5976-d6cc-404d-8495-61deab110716 response_code = 204 uri = /vpc-routes
18612024-10-31T20:24:19.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53159
18622024-10-31T20:24:19.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53159 req_id = 9d42e5a2-f5e7-4bb1-a4ee-d74eaa2d6b30 response_code = 200 uri = /vpc-routes
18632024-10-31T20:24:19.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59621
18642024-10-31T20:24:19.191ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18652024-10-31T20:24:19.240ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18662024-10-31T20:24:19.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59621 req_id = f0d84d0d-cf14-4bc3-a9db-5251ad570ee0 response_code = 204 uri = /switch-ports
18672024-10-31T20:24:19.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63690
18682024-10-31T20:24:19.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18692024-10-31T20:24:19.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53159 req_id = 3b2eb386-739e-43f8-b605-645a05a4b8eb response_code = 204 uri = /eip-gateways
18702024-10-31T20:24:19.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59621 req_id = 1b537b00-65f4-4fcc-9511-c4dc7003dbff response_code = 200 uri = /network-bootstore-config
18712024-10-31T20:24:19.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63690 req_id = 2ab9986e-6ba9-4855-85d3-9794e0ce0e38 response_code = 200 uri = /v2p
18722024-10-31T20:24:19.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53159 req_id = 20d10ff0-056b-4e6a-a6e1-331727b087fc response_code = 204 uri = /vpc-routes
18732024-10-31T20:24:19.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61724
18742024-10-31T20:24:19.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61724 req_id = 648bab36-6d9b-4d49-843f-ae332abb307b response_code = 200 uri = /vpc-routes
18752024-10-31T20:24:19.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38948
18762024-10-31T20:24:19.344ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18772024-10-31T20:24:19.385ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18782024-10-31T20:24:19.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38948 req_id = 393cb753-3906-439a-9a59-f6acfcb05c15 response_code = 204 uri = /switch-ports
18792024-10-31T20:24:19.444ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18802024-10-31T20:24:19.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61724 req_id = 53c271c1-759d-41ba-9600-81a5fc08c2b5 response_code = 204 uri = /eip-gateways
18812024-10-31T20:24:19.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38948 req_id = d38d1a2f-8d23-4ca9-bc77-c7257640e7d6 response_code = 200 uri = /network-bootstore-config
18822024-10-31T20:24:19.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61724 req_id = f4842eac-b2d6-413c-8bdd-4c49728e8b8b response_code = 204 uri = /vpc-routes
18832024-10-31T20:24:19.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62896
18842024-10-31T20:24:19.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62896 req_id = f4b66112-3e8e-431a-93c9-d1658e757e6d response_code = 200 uri = /v2p
18852024-10-31T20:24:19.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33974
18862024-10-31T20:24:19.556ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18872024-10-31T20:24:19.592ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
18882024-10-31T20:24:19.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33974 req_id = 5320b8b5-171c-419e-868f-4ceea860e0e9 response_code = 204 uri = /switch-ports
18892024-10-31T20:24:19.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33974 req_id = 41811351-fbbb-4001-8716-9f7005e82f8e response_code = 200 uri = /network-bootstore-config
18902024-10-31T20:24:32.352ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37214
18912024-10-31T20:24:32.352ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37214 req_id = 873935ac-9207-4480-a827-dcc4ce310d19 response_code = 200 uri = /baseboard
18922024-10-31T20:24:48.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54557
18932024-10-31T20:24:48.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54557 req_id = cd6cf4af-7606-4e64-98c3-5d4ac92bf87a response_code = 200 uri = /vpc-routes
18942024-10-31T20:24:48.815ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
18952024-10-31T20:24:48.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54557 req_id = 517cf34d-bb32-4fbe-892d-09152c474886 response_code = 204 uri = /eip-gateways
18962024-10-31T20:24:48.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54557 req_id = 7ae1b471-6f25-4db0-be6b-79ebf592d866 response_code = 204 uri = /vpc-routes
18972024-10-31T20:24:48.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56866
18982024-10-31T20:24:48.936ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
18992024-10-31T20:24:48.982ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19002024-10-31T20:24:49.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117638 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56866 req_id = cf1dcc91-1b7c-4823-bb2b-07c46ea44a5a response_code = 204 uri = /switch-ports
19012024-10-31T20:24:49.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50702
19022024-10-31T20:24:49.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38135
19032024-10-31T20:24:49.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38135 req_id = ae7c0158-17aa-4c03-ae1c-74293dc06a9a response_code = 200 uri = /vpc-routes
19042024-10-31T20:24:49.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56866 req_id = 7248d0ff-1b55-48e8-856f-3a13ce7c4837 response_code = 200 uri = /network-bootstore-config
19052024-10-31T20:24:49.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50702 req_id = 3f4a3182-7b82-4cd3-be98-84c20f26aede response_code = 200 uri = /v2p
19062024-10-31T20:24:49.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
19072024-10-31T20:24:49.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38135 req_id = b6512c99-3d0b-436a-a120-f6d7dcab99da response_code = 204 uri = /eip-gateways
19082024-10-31T20:24:49.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38135 req_id = 45b59180-9b1c-4f67-b8d7-d1e05c042b22 response_code = 204 uri = /vpc-routes
19092024-10-31T20:24:49.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59223
19102024-10-31T20:24:49.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19112024-10-31T20:24:49.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19122024-10-31T20:24:49.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59223 req_id = e130744d-20a1-4a30-8f3c-21214f2bfab0 response_code = 204 uri = /switch-ports
19132024-10-31T20:24:49.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45891
19142024-10-31T20:24:49.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59223 req_id = a3538888-fc28-44d6-a14f-f0ae5c24f15d response_code = 200 uri = /network-bootstore-config
19152024-10-31T20:24:49.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45891 req_id = f669c055-36f5-46a7-b695-ef6fffbc066c response_code = 200 uri = /v2p
19162024-10-31T20:24:49.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39834
19172024-10-31T20:24:49.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39834 req_id = 96318238-b349-41ba-902d-de8734a38ae0 response_code = 200 uri = /vpc-routes
19182024-10-31T20:24:49.294ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
19192024-10-31T20:24:49.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39834 req_id = a9937743-ef4d-4f89-87b7-8d7e1293942e response_code = 204 uri = /eip-gateways
19202024-10-31T20:24:49.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39834 req_id = 0c57a160-6cef-4b45-90a0-c9437eab65c1 response_code = 204 uri = /vpc-routes
19212024-10-31T20:24:49.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46784
19222024-10-31T20:24:49.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46784 req_id = 0bcbc66b-2e99-4214-8b62-2aea1c3552fe response_code = 200 uri = /v2p
19232024-10-31T20:24:49.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47581
19242024-10-31T20:24:49.403ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19252024-10-31T20:24:49.442ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19262024-10-31T20:24:49.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91580 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47581 req_id = 74495cc4-811c-47a0-a083-2a00c5fca7b0 response_code = 204 uri = /switch-ports
19272024-10-31T20:24:49.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47581 req_id = f5476ed7-9e36-4a67-8ea9-d32f9f4da759 response_code = 200 uri = /network-bootstore-config
19282024-10-31T20:25:02.386ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63420
19292024-10-31T20:25:02.386ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63420 req_id = 4859f564-ed2f-4f72-8d83-1b5b99437ce4 response_code = 200 uri = /baseboard
19302024-10-31T20:25:18.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46304
19312024-10-31T20:25:18.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46304 req_id = cd73718b-4fcd-49cc-8ace-8fa43b7d820e response_code = 200 uri = /vpc-routes
19322024-10-31T20:25:18.936ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
19332024-10-31T20:25:18.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46304 req_id = b25b911a-93f6-425b-a46e-79127c429646 response_code = 204 uri = /eip-gateways
19342024-10-31T20:25:18.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46304 req_id = a843010f-dfa9-4cfe-9159-515c9fe1b6b2 response_code = 204 uri = /vpc-routes
19352024-10-31T20:25:19.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51574
19362024-10-31T20:25:19.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51574 req_id = f579fc8e-6e82-4f8d-b73e-0d977c6733d5 response_code = 200 uri = /vpc-routes
19372024-10-31T20:25:19.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57718
19382024-10-31T20:25:19.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57718 req_id = 5b26cf6e-e91b-4542-a170-3438f78694a5 response_code = 200 uri = /v2p
19392024-10-31T20:25:19.168ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
19402024-10-31T20:25:19.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51574 req_id = f3506d6b-9459-4b5a-8f05-09561a2ed9b2 response_code = 204 uri = /eip-gateways
19412024-10-31T20:25:19.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38254
19422024-10-31T20:25:19.176ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19432024-10-31T20:25:19.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19442024-10-31T20:25:19.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104152 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38254 req_id = 33db82b4-9aab-4fd0-baf8-ad834b789579 response_code = 204 uri = /switch-ports
19452024-10-31T20:25:19.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57678
19462024-10-31T20:25:19.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38254 req_id = b1aad5c6-52b0-4c2c-a0c8-21410a19b47a response_code = 200 uri = /network-bootstore-config
19472024-10-31T20:25:19.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51574 req_id = 5a3e5acd-dfad-495b-a121-74ef36e8f7ae response_code = 204 uri = /vpc-routes
19482024-10-31T20:25:19.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57678 req_id = 2edd4f63-d598-473e-8196-2bddc5b0bdd0 response_code = 200 uri = /vpc-routes
19492024-10-31T20:25:19.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60521
19502024-10-31T20:25:19.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60521 req_id = dd4c9b75-fb85-45df-9acd-ae0c55c0965c response_code = 200 uri = /v2p
19512024-10-31T20:25:19.305ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
19522024-10-31T20:25:19.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57678 req_id = 59df86e4-90ab-4cb3-a83f-67c7768d43b2 response_code = 204 uri = /eip-gateways
19532024-10-31T20:25:19.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57678 req_id = b62ec670-e058-47e4-bec5-98c7120337d2 response_code = 204 uri = /vpc-routes
19542024-10-31T20:25:19.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37814
19552024-10-31T20:25:19.336ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19562024-10-31T20:25:19.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19572024-10-31T20:25:19.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96902 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37814 req_id = 55003379-f925-45e5-92e6-5e2b77731aac response_code = 204 uri = /switch-ports
19582024-10-31T20:25:19.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37814 req_id = fb3e0cf3-b548-4721-8f2d-7acf53f4094e response_code = 200 uri = /network-bootstore-config
19592024-10-31T20:25:19.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51539
19602024-10-31T20:25:19.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51539 req_id = edc9a5cc-c871-41d7-a7e5-8423d5380b47 response_code = 200 uri = /v2p
19612024-10-31T20:25:19.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48338
19622024-10-31T20:25:19.574ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19632024-10-31T20:25:19.611ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19642024-10-31T20:25:19.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92928 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48338 req_id = 52768c98-caf6-4e09-916e-d32e40cb6c87 response_code = 204 uri = /switch-ports
19652024-10-31T20:25:19.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48338 req_id = 353d7e51-6767-4829-8949-2525cb8a1bc4 response_code = 200 uri = /network-bootstore-config
19662024-10-31T20:25:32.419ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56418
19672024-10-31T20:25:32.419ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56418 req_id = 97c49620-c46f-4613-a51b-cd942877fa14 response_code = 200 uri = /baseboard
19682024-10-31T20:25:48.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63956
19692024-10-31T20:25:48.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63956 req_id = d868d2e3-ae7d-46e1-97e2-b704985c2d09 response_code = 200 uri = /vpc-routes
19702024-10-31T20:25:48.906ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
19712024-10-31T20:25:48.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63956 req_id = ba3dc2c0-5034-416a-b464-2ef782026dc7 response_code = 204 uri = /eip-gateways
19722024-10-31T20:25:48.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63956 req_id = 31aa1dd7-e6bb-4141-a9c0-1175354641e1 response_code = 204 uri = /vpc-routes
19732024-10-31T20:25:49.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65435
19742024-10-31T20:25:49.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65435 req_id = 23af9e80-8fda-445c-8517-def97a0d9c60 response_code = 200 uri = /vpc-routes
19752024-10-31T20:25:49.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38531
19762024-10-31T20:25:49.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38531 req_id = 285fa7ae-858b-4950-b89a-f40df161c000 response_code = 200 uri = /v2p
19772024-10-31T20:25:49.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48523
19782024-10-31T20:25:49.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19792024-10-31T20:25:49.093ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19802024-10-31T20:25:49.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117623 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48523 req_id = c885c5b8-ac31-4f61-ae47-6c7ffc0b062a response_code = 204 uri = /switch-ports
19812024-10-31T20:25:49.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34654
19822024-10-31T20:25:49.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
19832024-10-31T20:25:49.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65435 req_id = d0df42e8-a8a9-453c-8692-872fbb4ba010 response_code = 204 uri = /eip-gateways
19842024-10-31T20:25:49.164ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
19852024-10-31T20:25:49.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48523 req_id = b97e7a67-94f8-4777-891a-b0aca47c7090 response_code = 200 uri = /network-bootstore-config
19862024-10-31T20:25:49.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
19872024-10-31T20:25:49.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45548
19882024-10-31T20:25:49.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45548 req_id = 94089c63-db59-4d1b-bf17-f12e72689b80 response_code = 200 uri = /v2p
19892024-10-31T20:25:49.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65435 req_id = ec0bfab2-e642-4205-8c60-e462fc313cf4 response_code = 204 uri = /vpc-routes
19902024-10-31T20:25:49.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34654 req_id = ca62ccf5-1a7e-41af-833b-5886300125ae response_code = 204 uri = /switch-ports
19912024-10-31T20:25:49.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34654 req_id = e52bf206-bf2b-4314-ae6e-4a1cbd1dc948 response_code = 200 uri = /network-bootstore-config
19922024-10-31T20:25:49.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40883
19932024-10-31T20:25:49.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40883 req_id = eb2e893b-eea7-4fef-b2a7-c2712bde8419 response_code = 200 uri = /vpc-routes
19942024-10-31T20:25:49.352ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
19952024-10-31T20:25:49.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40883 req_id = 2e00bbe4-2186-4598-84f4-55ccc75757ad response_code = 204 uri = /eip-gateways
19962024-10-31T20:25:49.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54101
19972024-10-31T20:25:49.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54101 req_id = 5fd82625-b13c-43af-b975-83c039b52cf5 response_code = 200 uri = /v2p
19982024-10-31T20:25:49.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40883 req_id = a0fa31a5-687b-4610-aa71-8dafc336a50f response_code = 204 uri = /vpc-routes
19992024-10-31T20:25:49.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57282
20002024-10-31T20:25:49.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20012024-10-31T20:25:49.444ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20022024-10-31T20:25:49.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57282 req_id = d774d405-388e-482d-a5c4-cf687a59e94d response_code = 204 uri = /switch-ports
20032024-10-31T20:25:49.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57282 req_id = 6bc5e650-403c-439d-9676-e1bb4fe9ecaa response_code = 200 uri = /network-bootstore-config
20042024-10-31T20:26:02.460ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51942
20052024-10-31T20:26:02.461ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51942 req_id = f114b2f7-d49b-421f-b846-3b811bc4b60b response_code = 200 uri = /baseboard
20062024-10-31T20:26:18.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44252
20072024-10-31T20:26:18.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44252 req_id = 6752a5da-1039-492b-bcf3-002b9eecdb8b response_code = 200 uri = /vpc-routes
20082024-10-31T20:26:19.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
20092024-10-31T20:26:19.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44252 req_id = dc712c54-1ec7-45e6-9e82-c0ea4e25b80d response_code = 204 uri = /eip-gateways
20102024-10-31T20:26:19.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44252 req_id = 64507c4d-b913-4d31-915d-73442d547c06 response_code = 204 uri = /vpc-routes
20112024-10-31T20:26:19.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64875
20122024-10-31T20:26:19.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64875 req_id = f336ecd4-1e3b-4ffe-bf7b-1ebeeeae3777 response_code = 200 uri = /vpc-routes
20132024-10-31T20:26:19.214ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
20142024-10-31T20:26:19.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64875 req_id = 6124c7d0-83e0-4f02-b9a2-38155fb00aab response_code = 204 uri = /eip-gateways
20152024-10-31T20:26:19.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43491
20162024-10-31T20:26:19.235ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20172024-10-31T20:26:19.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20182024-10-31T20:26:19.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43491 req_id = 13b997ae-4cdb-4498-b439-df228d2e79b3 response_code = 204 uri = /switch-ports
20192024-10-31T20:26:19.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35966
20202024-10-31T20:26:19.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52331
20212024-10-31T20:26:19.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43533
20222024-10-31T20:26:19.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43491 req_id = 8f15c103-e3db-4fec-8087-2515b078f3a5 response_code = 200 uri = /network-bootstore-config
20232024-10-31T20:26:19.353ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20242024-10-31T20:26:19.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52331 req_id = 4ada7454-9816-45ab-9a1b-8a674261af14 response_code = 200 uri = /vpc-routes
20252024-10-31T20:26:19.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35966 req_id = 1cda85a9-f20e-4887-8c12-4499469106e0 response_code = 200 uri = /v2p
20262024-10-31T20:26:19.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20272024-10-31T20:26:19.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20282024-10-31T20:26:19.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20292024-10-31T20:26:19.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20302024-10-31T20:26:19.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20312024-10-31T20:26:19.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20322024-10-31T20:26:19.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43533 req_id = a41e0034-83ba-44e3-bbfc-af0e86aada0b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20332024-10-31T20:26:19.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34228
20342024-10-31T20:26:19.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34228 req_id = 4fe438c9-0cb1-4aec-9480-78f76cbdcfc8 response_code = 200 uri = /v2p
20352024-10-31T20:26:19.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64875 req_id = 9406f46b-2df9-4202-8a36-358c08318c63 response_code = 204 uri = /vpc-routes
20362024-10-31T20:26:19.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
20372024-10-31T20:26:19.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52331 req_id = 6f5f7d8e-c5f7-4a42-9736-d193c232a26b response_code = 204 uri = /eip-gateways
20382024-10-31T20:26:19.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52331 req_id = e4c8be48-f2f4-4cd4-8ae6-40d40a496d56 response_code = 204 uri = /vpc-routes
20392024-10-31T20:26:19.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45784
20402024-10-31T20:26:19.420ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20412024-10-31T20:26:19.462ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20422024-10-31T20:26:19.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108480 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45784 req_id = e2b5fdb0-3455-439e-86e3-556e014354b3 response_code = 204 uri = /switch-ports
20432024-10-31T20:26:19.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63523
20442024-10-31T20:26:19.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63523 req_id = b136d4d7-4e01-4da9-991d-f69526354d0b response_code = 200 uri = /v2p
20452024-10-31T20:26:19.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45784 req_id = 1014967b-3ee6-4e0b-a7c3-570c6c43350f response_code = 200 uri = /network-bootstore-config
20462024-10-31T20:26:19.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33556
20472024-10-31T20:26:19.548ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20482024-10-31T20:26:19.587ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20492024-10-31T20:26:19.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93375 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33556 req_id = d239c906-cbb4-4cc3-b21b-dda3d3fcd20d response_code = 204 uri = /switch-ports
20502024-10-31T20:26:19.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55187
20512024-10-31T20:26:19.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33556 req_id = d54886e7-147c-4177-9616-da5fdcb97b3a response_code = 200 uri = /network-bootstore-config
20522024-10-31T20:26:19.642ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20532024-10-31T20:26:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20542024-10-31T20:26:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20552024-10-31T20:26:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20562024-10-31T20:26:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20572024-10-31T20:26:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20582024-10-31T20:26:19.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20592024-10-31T20:26:19.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55187 req_id = ef4f8712-c3c0-4f37-8506-71a32d5af651 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20602024-10-31T20:26:19.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37590
20612024-10-31T20:26:19.714ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20622024-10-31T20:26:19.714ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
20632024-10-31T20:26:19.714ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20642024-10-31T20:26:19.714ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20652024-10-31T20:26:19.714ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20662024-10-31T20:26:19.714ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20672024-10-31T20:26:19.714ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20682024-10-31T20:26:19.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37590 req_id = 073bd73c-8687-487c-8eb0-7c6add5ce995 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20692024-10-31T20:26:32.494ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40433
20702024-10-31T20:26:32.494ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40433 req_id = 10634cbf-7b05-49bd-adc4-bc4192c49e93 response_code = 200 uri = /baseboard
20712024-10-31T20:26:48.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45154
20722024-10-31T20:26:48.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45154 req_id = 6aa73bcd-1878-4220-b974-bf04e83d39e5 response_code = 200 uri = /vpc-routes
20732024-10-31T20:26:48.901ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
20742024-10-31T20:26:48.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45154 req_id = f70696aa-b66c-4806-8a80-3a0d34a72e26 response_code = 204 uri = /eip-gateways
20752024-10-31T20:26:48.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45154 req_id = c41032df-ff16-4cba-bfc5-c11fdb0867e0 response_code = 204 uri = /vpc-routes
20762024-10-31T20:26:48.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44283
20772024-10-31T20:26:48.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44283 req_id = 261211cd-5092-462e-a380-3b1c7db5a9bb response_code = 200 uri = /v2p
20782024-10-31T20:26:49.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64645
20792024-10-31T20:26:49.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20802024-10-31T20:26:49.057ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20812024-10-31T20:26:49.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129259 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64645 req_id = ad70301c-1d66-4f16-ad6f-6b316488d459 response_code = 204 uri = /switch-ports
20822024-10-31T20:26:49.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33343
20832024-10-31T20:26:49.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49679
20842024-10-31T20:26:49.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49679 req_id = 05f8ef3a-a594-49ee-a05c-e1e8cf4e4ee1 response_code = 200 uri = /v2p
20852024-10-31T20:26:49.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33343 req_id = bc6b06f1-d424-4cf3-b96b-faeb3f657c92 response_code = 200 uri = /vpc-routes
20862024-10-31T20:26:49.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64645 req_id = 480e6c3e-40b8-4cec-808f-b41078a7e192 response_code = 200 uri = /network-bootstore-config
20872024-10-31T20:26:49.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49986
20882024-10-31T20:26:49.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
20892024-10-31T20:26:49.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
20902024-10-31T20:26:49.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49986 req_id = 13a1cf0e-78ca-423f-96ec-2f9bc60d4b7c response_code = 204 uri = /switch-ports
20912024-10-31T20:26:49.256ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61004
20922024-10-31T20:26:49.256ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
20932024-10-31T20:26:49.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33343 req_id = ae11de06-9f2e-4a87-9fc5-b6e339c543c6 response_code = 204 uri = /eip-gateways
20942024-10-31T20:26:49.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61004 req_id = d438cba5-152b-4252-82cf-7ceb617897b5 response_code = 200 uri = /vpc-routes
20952024-10-31T20:26:49.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49986 req_id = 4ab71f85-71d0-4e18-8f1b-d80107c9a5bc response_code = 200 uri = /network-bootstore-config
20962024-10-31T20:26:49.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33343 req_id = 3707ed99-20e2-416c-a43f-cbc2e71c87a6 response_code = 204 uri = /vpc-routes
20972024-10-31T20:26:49.271ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
20982024-10-31T20:26:49.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61004 req_id = 75aeedb0-38c5-4e78-891d-51967c820a93 response_code = 204 uri = /eip-gateways
20992024-10-31T20:26:49.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48422
21002024-10-31T20:26:49.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48422 req_id = e04d8856-e9cd-4748-883b-37638b14ce5e response_code = 200 uri = /v2p
21012024-10-31T20:26:49.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61004 req_id = 2e214977-7c3a-4320-aac5-49addbc2eaa3 response_code = 204 uri = /vpc-routes
21022024-10-31T20:26:49.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40985
21032024-10-31T20:26:49.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21042024-10-31T20:26:49.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21052024-10-31T20:26:49.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40985 req_id = f38d4de9-43ac-468e-8ca6-54938bdd79dd response_code = 204 uri = /switch-ports
21062024-10-31T20:26:49.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40985 req_id = 190f1884-ef91-4a64-a707-f36ad0bb8087 response_code = 200 uri = /network-bootstore-config
21072024-10-31T20:27:02.528ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35695
21082024-10-31T20:27:02.528ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35695 req_id = c118065f-fe53-4ca2-96c4-e7fb8302189e response_code = 200 uri = /baseboard
21092024-10-31T20:27:04.795ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
21102024-10-31T20:27:04.795ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
21112024-10-31T20:27:04.822ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1937, tv_nsec: 482949247 } time_to_next_cleanup = 599.99999672s
21122024-10-31T20:27:18.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40133
21132024-10-31T20:27:18.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40133 req_id = 09ccbec3-24ee-4461-8410-78f79d742505 response_code = 200 uri = /vpc-routes
21142024-10-31T20:27:19.035ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
21152024-10-31T20:27:19.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40133 req_id = f1d22ec0-4403-4111-8c71-a1bbb8e30c79 response_code = 204 uri = /eip-gateways
21162024-10-31T20:27:19.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40133 req_id = ffee2b46-e0e0-4bf4-b512-3b2ac7c7df8f response_code = 204 uri = /vpc-routes
21172024-10-31T20:27:19.145ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21182024-10-31T20:27:19.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62847
21192024-10-31T20:27:19.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62847 req_id = b939a24d-dd62-4c73-b37e-272db8c7c2ae response_code = 200 uri = /vpc-routes
21202024-10-31T20:27:19.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64644
21212024-10-31T20:27:19.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64644 req_id = b33aa53b-e878-4ba5-b136-faba66453fde response_code = 200 uri = /v2p
21222024-10-31T20:27:19.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55577
21232024-10-31T20:27:19.261ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21242024-10-31T20:27:19.304ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21252024-10-31T20:27:19.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55577 req_id = 031d0452-e96f-4d87-91cc-7f8a7fe04edb response_code = 204 uri = /switch-ports
21262024-10-31T20:27:19.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51606
21272024-10-31T20:27:19.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55577 req_id = 8ed4b86d-3714-4923-ae65-b6e0a27dc823 response_code = 200 uri = /network-bootstore-config
21282024-10-31T20:27:19.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51606 req_id = 42885bcf-fd5d-4793-ab3f-56e055172a3b response_code = 200 uri = /v2p
21292024-10-31T20:27:19.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
21302024-10-31T20:27:19.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62847 req_id = 5914ea6d-dfbc-416a-b004-873f9dd1a556 response_code = 204 uri = /eip-gateways
21312024-10-31T20:27:19.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49796
21322024-10-31T20:27:19.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49796 req_id = 064bd166-97f8-4884-8fab-8ce3fd19435c response_code = 200 uri = /v2p
21332024-10-31T20:27:19.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41332
21342024-10-31T20:27:19.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41332 req_id = 24f65b2d-77c3-4a3d-916b-c1493d7f777f response_code = 200 uri = /vpc-routes
21352024-10-31T20:27:19.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62847 req_id = 0295f2be-b7aa-43a4-ae81-6ee48800d6b6 response_code = 204 uri = /vpc-routes
21362024-10-31T20:27:19.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38419
21372024-10-31T20:27:19.395ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21382024-10-31T20:27:19.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21392024-10-31T20:27:19.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38419 req_id = 645802e0-10a7-4ddd-b542-473a798d4e24 response_code = 204 uri = /switch-ports
21402024-10-31T20:27:19.499ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
21412024-10-31T20:27:19.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41332 req_id = 52d16835-bd73-4b8b-8649-50a87f4129dc response_code = 204 uri = /eip-gateways
21422024-10-31T20:27:19.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38419 req_id = 2d72dff6-af30-40d2-9f84-596d50471ab4 response_code = 200 uri = /network-bootstore-config
21432024-10-31T20:27:19.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41332 req_id = 4a8d1980-7237-47a1-af5e-8f7ca99465fc response_code = 204 uri = /vpc-routes
21442024-10-31T20:27:19.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59401
21452024-10-31T20:27:19.666ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21462024-10-31T20:27:19.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21472024-10-31T20:27:19.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104555 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59401 req_id = 027e2f9a-f638-478a-93e8-c1b34205e005 response_code = 204 uri = /switch-ports
21482024-10-31T20:27:19.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59401 req_id = ba2cc64a-28e4-4af4-8a18-9e0a4482b528 response_code = 200 uri = /network-bootstore-config
21492024-10-31T20:27:32.560ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47725
21502024-10-31T20:27:32.561ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47725 req_id = dc4c8646-e51e-4142-9aac-47d80c41126e response_code = 200 uri = /baseboard
21512024-10-31T20:27:48.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55384
21522024-10-31T20:27:48.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55384 req_id = bd8061ac-af62-4ee6-87ff-e9b6ad58c75c response_code = 200 uri = /vpc-routes
21532024-10-31T20:27:48.902ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
21542024-10-31T20:27:48.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55384 req_id = 14cbc96a-8a8f-480f-b185-1585fc45c3b9 response_code = 204 uri = /eip-gateways
21552024-10-31T20:27:48.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59979
21562024-10-31T20:27:48.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59979 req_id = 7a1409b2-3aaf-4e44-b438-0ff0faa19a21 response_code = 200 uri = /v2p
21572024-10-31T20:27:48.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55384 req_id = 47af4479-7c0e-4dab-beee-a4e0b766e3d9 response_code = 204 uri = /vpc-routes
21582024-10-31T20:27:48.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56190
21592024-10-31T20:27:48.971ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21602024-10-31T20:27:49.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21612024-10-31T20:27:49.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133231 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56190 req_id = c09a9e06-429b-4e6e-a862-000a74a67556 response_code = 204 uri = /switch-ports
21622024-10-31T20:27:49.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56190 req_id = ab2840f4-b279-4bd9-b0dc-b6da4a34764b response_code = 200 uri = /network-bootstore-config
21632024-10-31T20:27:49.127ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35356
21642024-10-31T20:27:49.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35356 req_id = 4477c181-f5b5-464d-8775-fc4020bece1e response_code = 200 uri = /vpc-routes
21652024-10-31T20:27:49.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
21662024-10-31T20:27:49.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35356 req_id = f0cb41ac-e93b-4206-b7e4-2da76493134d response_code = 204 uri = /eip-gateways
21672024-10-31T20:27:49.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64657
21682024-10-31T20:27:49.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64657 req_id = f2fb39fe-e1af-4666-8a21-e5cc8d736c9d response_code = 200 uri = /vpc-routes
21692024-10-31T20:27:49.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62064
21702024-10-31T20:27:49.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62064 req_id = d95c76f3-bc49-4caa-80f5-2d2ee4a884c6 response_code = 200 uri = /v2p
21712024-10-31T20:27:49.230ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
21722024-10-31T20:27:49.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64657 req_id = 0d14959c-a0e7-417c-b437-60573b12e3a1 response_code = 204 uri = /eip-gateways
21732024-10-31T20:27:49.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35356 req_id = f2f71a7b-aab7-41fb-aa1b-05cf911f48b0 response_code = 204 uri = /vpc-routes
21742024-10-31T20:27:49.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50933
21752024-10-31T20:27:49.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50933 req_id = a0d384d6-d537-4ce3-910f-38f31bbae58f response_code = 200 uri = /v2p
21762024-10-31T20:27:49.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64657 req_id = 8bf07534-4a54-4648-bdf5-55c0ee1796c7 response_code = 204 uri = /vpc-routes
21772024-10-31T20:27:49.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50174
21782024-10-31T20:27:49.271ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21792024-10-31T20:27:49.313ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21802024-10-31T20:27:49.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99407 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50174 req_id = caf41ae0-4911-4fd4-9e90-a0da651a899e response_code = 204 uri = /switch-ports
21812024-10-31T20:27:49.371ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36328
21822024-10-31T20:27:49.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50174 req_id = b36154dd-13d5-48b0-abb5-f7de6f3abd92 response_code = 200 uri = /network-bootstore-config
21832024-10-31T20:27:49.371ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
21842024-10-31T20:27:49.411ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
21852024-10-31T20:27:49.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94445 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36328 req_id = b72fad5b-c431-4ea2-b88f-b8fe8781ba66 response_code = 204 uri = /switch-ports
21862024-10-31T20:27:49.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36328 req_id = 1763f529-e0fd-41f5-8b07-cbd4f3a6bce4 response_code = 200 uri = /network-bootstore-config
21872024-10-31T20:28:02.594ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63691
21882024-10-31T20:28:02.594ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63691 req_id = 544a121e-9fa7-4d5c-9195-4dda5736bfea response_code = 200 uri = /baseboard
21892024-10-31T20:28:18.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42106
21902024-10-31T20:28:18.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42106 req_id = da864a2d-dfed-44e6-9394-850155aa58ba response_code = 200 uri = /vpc-routes
21912024-10-31T20:28:18.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
21922024-10-31T20:28:18.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42106 req_id = fe0bdc77-21fa-4ccd-ab19-85cb4115659d response_code = 204 uri = /eip-gateways
21932024-10-31T20:28:18.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42106 req_id = afb89f6c-9e05-4efa-b724-0073f5599f02 response_code = 204 uri = /vpc-routes
21942024-10-31T20:28:19.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32792
21952024-10-31T20:28:19.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32792 req_id = 444d9414-48f9-4007-bca9-68d627f9dfe1 response_code = 200 uri = /v2p
21962024-10-31T20:28:19.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63795
21972024-10-31T20:28:19.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63795 req_id = e5dcb381-2b2e-4879-94c8-2aa62bf24c0a response_code = 200 uri = /vpc-routes
21982024-10-31T20:28:19.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49869
21992024-10-31T20:28:19.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22002024-10-31T20:28:19.205ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22012024-10-31T20:28:19.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49869 req_id = 7b024c65-c4b4-440f-a881-2eaf215d2efd response_code = 204 uri = /switch-ports
22022024-10-31T20:28:19.277ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
22032024-10-31T20:28:19.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37428
22042024-10-31T20:28:19.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63795 req_id = 5e7f301a-57cc-4c77-a972-e80d8636081f response_code = 204 uri = /eip-gateways
22052024-10-31T20:28:19.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61712
22062024-10-31T20:28:19.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37428 req_id = f28d04a3-fdbb-4263-b558-c66429f38b17 response_code = 200 uri = /v2p
22072024-10-31T20:28:19.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22082024-10-31T20:28:19.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49869 req_id = 32765769-bb4c-40b4-b231-815ae1a59bdb response_code = 200 uri = /network-bootstore-config
22092024-10-31T20:28:19.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63795 req_id = 7e34672e-c942-4a99-8554-b34835474501 response_code = 204 uri = /vpc-routes
22102024-10-31T20:28:19.322ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22112024-10-31T20:28:19.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 104960 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61712 req_id = c8a40534-6048-4694-9fbe-c164e36b4dfd response_code = 204 uri = /switch-ports
22122024-10-31T20:28:19.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61712 req_id = eb6dff9e-e642-439a-85ad-3f14ec6518bb response_code = 200 uri = /network-bootstore-config
22132024-10-31T20:28:19.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63646
22142024-10-31T20:28:19.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63646 req_id = 627ad0fa-43d8-4df6-ac2d-452e4a0fc531 response_code = 200 uri = /v2p
22152024-10-31T20:28:19.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58282
22162024-10-31T20:28:19.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58282 req_id = b625967c-3bcc-4cf8-9344-4268902f696a response_code = 200 uri = /vpc-routes
22172024-10-31T20:28:19.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59818
22182024-10-31T20:28:19.578ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22192024-10-31T20:28:19.621ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22202024-10-31T20:28:19.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103155 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59818 req_id = 5d9dde51-3426-4472-ad9e-810054d40b52 response_code = 204 uri = /switch-ports
22212024-10-31T20:28:19.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
22222024-10-31T20:28:19.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59818 req_id = 46222734-cd8c-4712-b4b0-d75de5ae3222 response_code = 200 uri = /network-bootstore-config
22232024-10-31T20:28:19.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58282 req_id = f4c85f87-52ea-4ae4-b2a1-5077cceb62ac response_code = 204 uri = /eip-gateways
22242024-10-31T20:28:19.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58282 req_id = a2103e97-c546-4f01-99e7-fdb9dc188aff response_code = 204 uri = /vpc-routes
22252024-10-31T20:28:32.247ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22262024-10-31T20:28:32.248ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 498 n_new_samples = 6 n_overflow_samples = 4 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22272024-10-31T20:28:32.630ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55230
22282024-10-31T20:28:32.630ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55230 req_id = 70691fe8-86d2-4dfd-87a2-6e4fb80e826d response_code = 200 uri = /baseboard
22292024-10-31T20:28:42.244ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22302024-10-31T20:28:42.247ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22312024-10-31T20:28:42.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22322024-10-31T20:28:42.250ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22332024-10-31T20:28:48.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45043
22342024-10-31T20:28:48.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45043 req_id = 31678c72-2973-4232-a474-23ad93338077 response_code = 200 uri = /vpc-routes
22352024-10-31T20:28:48.804ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
22362024-10-31T20:28:48.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45043 req_id = 93a955fb-23ff-4975-9a0b-2384f0107ab4 response_code = 204 uri = /eip-gateways
22372024-10-31T20:28:48.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45043 req_id = 1640d5d2-3116-4dbe-8129-f10071e6b8b0 response_code = 204 uri = /vpc-routes
22382024-10-31T20:28:48.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39451
22392024-10-31T20:28:48.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39451 req_id = 8e1ff923-f843-4b4d-889b-ecdd3fa21d6c response_code = 200 uri = /v2p
22402024-10-31T20:28:48.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43460
22412024-10-31T20:28:48.987ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22422024-10-31T20:28:49.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22432024-10-31T20:28:49.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 146090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43460 req_id = 4d45d605-3a78-40be-9f5f-b1996313b641 response_code = 204 uri = /switch-ports
22442024-10-31T20:28:49.133ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49559
22452024-10-31T20:28:49.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49559 req_id = 091c32ee-95cc-4761-8eb4-ef7f5b19846d response_code = 200 uri = /vpc-routes
22462024-10-31T20:28:49.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43460 req_id = 603f0c66-06e2-4c11-9751-8ee5e244d291 response_code = 200 uri = /network-bootstore-config
22472024-10-31T20:28:49.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61375
22482024-10-31T20:28:49.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22492024-10-31T20:28:49.188ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22502024-10-31T20:28:49.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 107429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61375 req_id = 8592b407-50ed-4631-bb57-f743cd0c565b response_code = 204 uri = /switch-ports
22512024-10-31T20:28:49.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44521
22522024-10-31T20:28:49.246ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53523
22532024-10-31T20:28:49.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
22542024-10-31T20:28:49.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44521 req_id = 302af67e-f5b5-42a9-bfc4-27f67e3924d0 response_code = 200 uri = /vpc-routes
22552024-10-31T20:28:49.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61375 req_id = 8382b2a1-790c-473a-93a8-5f95d03618f7 response_code = 200 uri = /network-bootstore-config
22562024-10-31T20:28:49.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49559 req_id = f4279565-541d-4cc1-85b4-8c25c07244dd response_code = 204 uri = /eip-gateways
22572024-10-31T20:28:49.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53523 req_id = ecc99456-b9a6-4f30-af05-5117212565ec response_code = 200 uri = /v2p
22582024-10-31T20:28:49.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49559 req_id = aa7e79cb-c21f-4892-8122-2f2d7ce0621a response_code = 204 uri = /vpc-routes
22592024-10-31T20:28:49.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47728
22602024-10-31T20:28:49.274ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22612024-10-31T20:28:49.316ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22622024-10-31T20:28:49.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47728 req_id = 2a3a608b-9c08-4dde-867b-9e6cf8808af9 response_code = 204 uri = /switch-ports
22632024-10-31T20:28:49.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48686
22642024-10-31T20:28:49.374ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
22652024-10-31T20:28:49.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44521 req_id = 76116fff-b9dc-4624-9dda-38190b3b5534 response_code = 204 uri = /eip-gateways
22662024-10-31T20:28:49.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47728 req_id = 0c2f382a-15ca-45d6-9873-7571220e7968 response_code = 200 uri = /network-bootstore-config
22672024-10-31T20:28:49.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48686 req_id = 7225f82b-14bb-4f4f-8d76-4c9374738c4b response_code = 200 uri = /v2p
22682024-10-31T20:28:49.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44521 req_id = 6fccf7fb-5e1e-4574-b5b7-27a6dcd69ea7 response_code = 204 uri = /vpc-routes
22692024-10-31T20:28:52.246ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22702024-10-31T20:28:52.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22712024-10-31T20:28:52.251ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22722024-10-31T20:28:52.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22732024-10-31T20:29:02.249ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22742024-10-31T20:29:02.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22752024-10-31T20:29:02.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22762024-10-31T20:29:02.255ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22772024-10-31T20:29:02.663ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41496
22782024-10-31T20:29:02.663ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41496 req_id = 0a3c3fa8-60ed-4fc0-8a59-dae35a137d44 response_code = 200 uri = /baseboard
22792024-10-31T20:29:12.252ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22802024-10-31T20:29:12.254ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22812024-10-31T20:29:12.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22822024-10-31T20:29:12.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
22832024-10-31T20:29:18.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52149
22842024-10-31T20:29:18.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52149 req_id = 0a4311fd-03b7-47bc-82a8-fc23fb19351e response_code = 200 uri = /vpc-routes
22852024-10-31T20:29:18.932ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
22862024-10-31T20:29:18.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52149 req_id = 97e4225c-82d7-421f-a1ca-429c75c49646 response_code = 204 uri = /eip-gateways
22872024-10-31T20:29:18.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52149 req_id = 67ee9335-3650-401f-bb03-d5c25369f411 response_code = 204 uri = /vpc-routes
22882024-10-31T20:29:19.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33665
22892024-10-31T20:29:19.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33665 req_id = ac68b4b7-01e8-4e5c-a903-56e09fcc1049 response_code = 200 uri = /v2p
22902024-10-31T20:29:19.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53560
22912024-10-31T20:29:19.161ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
22922024-10-31T20:29:19.209ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
22932024-10-31T20:29:19.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53560 req_id = 0263fb5a-e7ff-41cd-97f3-0720570b9390 response_code = 204 uri = /switch-ports
22942024-10-31T20:29:19.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48926
22952024-10-31T20:29:19.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43568
22962024-10-31T20:29:19.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53560 req_id = 91509752-6d99-479a-88e7-8a785d370969 response_code = 200 uri = /network-bootstore-config
22972024-10-31T20:29:19.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43568 req_id = bd76e8a2-0fda-474f-b12d-1b6f41055d93 response_code = 200 uri = /v2p
22982024-10-31T20:29:19.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48926 req_id = 39185ccd-0559-4abf-b51f-82bda817e321 response_code = 200 uri = /vpc-routes
22992024-10-31T20:29:19.331ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
23002024-10-31T20:29:19.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48926 req_id = ad764dd1-4f67-4ec4-9519-eed491e8a988 response_code = 204 uri = /eip-gateways
23012024-10-31T20:29:19.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48926 req_id = 63416550-0b1c-43ea-bf38-19c5d3ace82a response_code = 204 uri = /vpc-routes
23022024-10-31T20:29:19.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49975
23032024-10-31T20:29:19.363ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23042024-10-31T20:29:19.400ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23052024-10-31T20:29:19.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98418 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49975 req_id = 248c19fc-7e21-4237-858f-713619577b7a response_code = 204 uri = /switch-ports
23062024-10-31T20:29:19.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40466
23072024-10-31T20:29:19.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34123
23082024-10-31T20:29:19.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34123 req_id = 8f0b422e-63fb-4ff5-a1ce-69be112fa637 response_code = 200 uri = /v2p
23092024-10-31T20:29:19.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49975 req_id = 0b298969-1dec-445f-8d59-81e550efde2c response_code = 200 uri = /network-bootstore-config
23102024-10-31T20:29:19.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40466 req_id = e2c3f356-12a9-4e63-83e0-a9e313b33bd9 response_code = 200 uri = /vpc-routes
23112024-10-31T20:29:19.504ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
23122024-10-31T20:29:19.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40466 req_id = 054b3cbc-9b3a-456c-970d-37d09a0bf55e response_code = 204 uri = /eip-gateways
23132024-10-31T20:29:19.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40466 req_id = 012a7d77-8db1-4395-9863-a4516d412059 response_code = 204 uri = /vpc-routes
23142024-10-31T20:29:19.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58704
23152024-10-31T20:29:19.571ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23162024-10-31T20:29:19.612ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23172024-10-31T20:29:19.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101774 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58704 req_id = c7538b63-dac8-4c03-9d3b-0a621e57237c response_code = 204 uri = /switch-ports
23182024-10-31T20:29:19.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58704 req_id = 992a080b-6ed8-44e2-9888-dfe1f594aef4 response_code = 200 uri = /network-bootstore-config
23192024-10-31T20:29:22.256ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23202024-10-31T20:29:22.258ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23212024-10-31T20:29:22.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23222024-10-31T20:29:22.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23232024-10-31T20:29:32.260ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23242024-10-31T20:29:32.262ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23252024-10-31T20:29:32.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23262024-10-31T20:29:32.264ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23272024-10-31T20:29:32.697ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39138
23282024-10-31T20:29:32.697ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39138 req_id = a32284b9-2167-4965-b551-da2d75942124 response_code = 200 uri = /baseboard
23292024-10-31T20:29:42.265ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23302024-10-31T20:29:42.267ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23312024-10-31T20:29:42.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23322024-10-31T20:29:42.269ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23332024-10-31T20:29:48.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57821
23342024-10-31T20:29:48.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57821 req_id = d2a8f096-12ab-4a2d-b115-1313e2ca811b response_code = 200 uri = /vpc-routes
23352024-10-31T20:29:48.847ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
23362024-10-31T20:29:48.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57821 req_id = 1012b5f8-2819-45bb-9f6c-8a5a34c08909 response_code = 204 uri = /eip-gateways
23372024-10-31T20:29:48.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50384
23382024-10-31T20:29:48.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50384 req_id = 27faf60b-a5d4-478a-8a55-209000c3cb53 response_code = 200 uri = /v2p
23392024-10-31T20:29:48.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57821 req_id = a5495eac-caf0-4a13-bfd6-8524ace9ae72 response_code = 204 uri = /vpc-routes
23402024-10-31T20:29:48.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44952
23412024-10-31T20:29:48.966ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23422024-10-31T20:29:49.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23432024-10-31T20:29:49.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 122764 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44952 req_id = 70f73009-f565-4f9a-8293-b42ceb662b9b response_code = 204 uri = /switch-ports
23442024-10-31T20:29:49.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44952 req_id = 2a54d099-3991-4f73-8870-c9b0db844f18 response_code = 200 uri = /network-bootstore-config
23452024-10-31T20:29:49.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33812
23462024-10-31T20:29:49.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33812 req_id = 1b390982-976b-468d-a174-cdcc85ad636f response_code = 200 uri = /vpc-routes
23472024-10-31T20:29:49.173ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
23482024-10-31T20:29:49.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33812 req_id = d4a55b23-0b8e-473d-9d69-e9b008bf0b03 response_code = 204 uri = /eip-gateways
23492024-10-31T20:29:49.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60344
23502024-10-31T20:29:49.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60344 req_id = 7aea81a6-6e6f-4f65-b89b-71f98348563e response_code = 200 uri = /v2p
23512024-10-31T20:29:49.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33812 req_id = b273b4da-a3a7-49fb-b33a-ad7465799f1c response_code = 204 uri = /vpc-routes
23522024-10-31T20:29:49.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49537
23532024-10-31T20:29:49.204ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23542024-10-31T20:29:49.247ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23552024-10-31T20:29:49.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49537 req_id = 15aa504a-bbfe-4ca4-9c4a-951ff3072153 response_code = 204 uri = /switch-ports
23562024-10-31T20:29:49.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48639
23572024-10-31T20:29:49.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48639 req_id = 952464e1-0bd6-4e6b-a0b9-47d1774da601 response_code = 200 uri = /vpc-routes
23582024-10-31T20:29:49.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49537 req_id = 395b90f4-82b8-4df2-8143-d2cc704d3713 response_code = 200 uri = /network-bootstore-config
23592024-10-31T20:29:49.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47727
23602024-10-31T20:29:49.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47727 req_id = 3db79706-10e0-4d8e-a675-9b377cd601a7 response_code = 200 uri = /v2p
23612024-10-31T20:29:49.320ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
23622024-10-31T20:29:49.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48639 req_id = 7697b68e-44c8-400c-9679-525e998faed2 response_code = 204 uri = /eip-gateways
23632024-10-31T20:29:49.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48639 req_id = d5a71b00-7cef-4eca-b10f-80d092d1e1cb response_code = 204 uri = /vpc-routes
23642024-10-31T20:29:49.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61564
23652024-10-31T20:29:49.358ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23662024-10-31T20:29:49.398ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23672024-10-31T20:29:49.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99350 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61564 req_id = 507f9ea4-9c9c-4a67-9b03-eb34d93607ea response_code = 204 uri = /switch-ports
23682024-10-31T20:29:49.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61564 req_id = 9831f79a-4f9e-4aff-a516-02ee7eb0b46f response_code = 200 uri = /network-bootstore-config
23692024-10-31T20:29:52.268ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23702024-10-31T20:29:52.270ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23712024-10-31T20:29:52.272ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23722024-10-31T20:29:52.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23732024-10-31T20:30:02.271ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23742024-10-31T20:30:02.273ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23752024-10-31T20:30:02.275ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23762024-10-31T20:30:02.276ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23772024-10-31T20:30:02.730ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39796
23782024-10-31T20:30:02.730ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39796 req_id = 4ec0af7a-4c0c-43f3-9d0f-90d547c88f44 response_code = 200 uri = /baseboard
23792024-10-31T20:30:12.275ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23802024-10-31T20:30:12.277ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23812024-10-31T20:30:12.279ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23822024-10-31T20:30:12.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
23832024-10-31T20:30:18.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58336
23842024-10-31T20:30:18.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58336 req_id = b189e24c-04c8-4b53-a369-62140d44d2d4 response_code = 200 uri = /vpc-routes
23852024-10-31T20:30:18.997ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
23862024-10-31T20:30:18.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58336 req_id = 892eda7a-1f18-4d77-84d5-93928d79c26f response_code = 204 uri = /eip-gateways
23872024-10-31T20:30:19.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58336 req_id = 56459fe8-8162-46b8-a017-8bfd56e1ab0b response_code = 204 uri = /vpc-routes
23882024-10-31T20:30:19.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48052
23892024-10-31T20:30:19.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48052 req_id = 4bf6b895-5743-418b-b8f1-4964cddff31a response_code = 200 uri = /vpc-routes
23902024-10-31T20:30:19.145ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41538
23912024-10-31T20:30:19.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41538 req_id = 60859770-4631-4f0c-ad34-2bc247b777bf response_code = 200 uri = /v2p
23922024-10-31T20:30:19.159ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
23932024-10-31T20:30:19.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48052 req_id = dfe9b4da-a8ff-4528-a2bb-175cdddd9235 response_code = 204 uri = /eip-gateways
23942024-10-31T20:30:19.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48052 req_id = 221bf815-2113-4b45-a6ad-a98580f24616 response_code = 204 uri = /vpc-routes
23952024-10-31T20:30:19.182ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44284
23962024-10-31T20:30:19.182ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
23972024-10-31T20:30:19.227ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
23982024-10-31T20:30:19.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115763 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44284 req_id = 639503ab-01cb-4021-8f41-261974c3cc63 response_code = 204 uri = /switch-ports
23992024-10-31T20:30:19.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44284 req_id = e437ef62-13bc-4e72-9c7c-02aa90d01009 response_code = 200 uri = /network-bootstore-config
24002024-10-31T20:30:19.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47021
24012024-10-31T20:30:19.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47021 req_id = 1cd323be-c7f7-47cf-a9d5-1fe3b5a6a433 response_code = 200 uri = /v2p
24022024-10-31T20:30:19.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63951
24032024-10-31T20:30:19.356ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24042024-10-31T20:30:19.397ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24052024-10-31T20:30:19.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101775 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63951 req_id = 7dbc7d94-d387-448b-b1af-814768b4e9d7 response_code = 204 uri = /switch-ports
24062024-10-31T20:30:19.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63951 req_id = afcb7be7-f5bf-48d5-9ee6-7c41ac16dc7d response_code = 200 uri = /network-bootstore-config
24072024-10-31T20:30:19.515ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49706
24082024-10-31T20:30:19.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49706 req_id = d46a6272-f17e-4121-8801-d31fe3c252b2 response_code = 200 uri = /vpc-routes
24092024-10-31T20:30:19.555ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
24102024-10-31T20:30:19.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49706 req_id = ff7f7b1e-5366-4fad-a35c-32388841b2df response_code = 204 uri = /eip-gateways
24112024-10-31T20:30:19.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61650
24122024-10-31T20:30:19.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61650 req_id = ffe4bc7f-ef9f-49ae-a122-a64cdf9bacfb response_code = 200 uri = /v2p
24132024-10-31T20:30:19.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49706 req_id = 033ed017-2e4f-4d7c-a5e1-5a9864ccc095 response_code = 204 uri = /vpc-routes
24142024-10-31T20:30:19.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43147
24152024-10-31T20:30:19.603ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24162024-10-31T20:30:19.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24172024-10-31T20:30:19.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103908 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43147 req_id = d525ed0e-6629-4a59-8405-16235d232d00 response_code = 204 uri = /switch-ports
24182024-10-31T20:30:19.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43147 req_id = db9b0f98-50a8-4b1c-8e89-6e037090c926 response_code = 200 uri = /network-bootstore-config
24192024-10-31T20:30:22.278ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24202024-10-31T20:30:22.280ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24212024-10-31T20:30:22.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24222024-10-31T20:30:22.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24232024-10-31T20:30:32.282ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24242024-10-31T20:30:32.283ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24252024-10-31T20:30:32.285ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24262024-10-31T20:30:32.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24272024-10-31T20:30:32.764ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60371
24282024-10-31T20:30:32.764ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60371 req_id = 093dc5e6-24e1-4eb2-a5e1-86003f776bb8 response_code = 200 uri = /baseboard
24292024-10-31T20:30:42.286ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24302024-10-31T20:30:42.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24312024-10-31T20:30:42.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24322024-10-31T20:30:42.291ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24332024-10-31T20:30:48.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62341
24342024-10-31T20:30:48.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62341 req_id = 26f19339-4416-4424-bd54-babb91ae4db6 response_code = 200 uri = /vpc-routes
24352024-10-31T20:30:48.916ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
24362024-10-31T20:30:48.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62341 req_id = e5c596a9-68f5-47ca-ab57-499f8d7fb496 response_code = 204 uri = /eip-gateways
24372024-10-31T20:30:48.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62341 req_id = ed07f03c-1387-411f-9968-975c3d2323bc response_code = 204 uri = /vpc-routes
24382024-10-31T20:30:48.936ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41866
24392024-10-31T20:30:48.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41866 req_id = e32b6a21-b459-4d13-87d3-3a6f6484f612 response_code = 200 uri = /v2p
24402024-10-31T20:30:48.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42870
24412024-10-31T20:30:48.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24422024-10-31T20:30:49.042ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24432024-10-31T20:30:49.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42870 req_id = 74f7cd96-c248-4107-b8f2-4e71acb50fca response_code = 204 uri = /switch-ports
24442024-10-31T20:30:49.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60874
24452024-10-31T20:30:49.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51266
24462024-10-31T20:30:49.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60874 req_id = 458106cd-a71e-4cec-88ef-d19970c62ff7 response_code = 200 uri = /vpc-routes
24472024-10-31T20:30:49.119ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24482024-10-31T20:30:49.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42870 req_id = 20380dce-59e6-43fd-8b9c-ccbf3973d0f7 response_code = 200 uri = /network-bootstore-config
24492024-10-31T20:30:49.134ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
24502024-10-31T20:30:49.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60874 req_id = a13bfec1-580f-41bb-8c2b-18d5396c1a3e response_code = 204 uri = /eip-gateways
24512024-10-31T20:30:49.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60874 req_id = beb045a6-7e3f-4f90-964a-2fd88219bff3 response_code = 204 uri = /vpc-routes
24522024-10-31T20:30:49.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61424
24532024-10-31T20:30:49.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61424 req_id = 0ae9ef8d-c105-4b02-ab03-4e858d1623fb response_code = 200 uri = /vpc-routes
24542024-10-31T20:30:49.164ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24552024-10-31T20:30:49.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64781
24562024-10-31T20:30:49.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64781 req_id = 17927a62-5509-4d89-abdb-2c0ddf5d0e17 response_code = 200 uri = /v2p
24572024-10-31T20:30:49.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
24582024-10-31T20:30:49.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4588 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61424 req_id = 9c7f1844-8f7a-46d3-8cab-d58a74e063c8 response_code = 204 uri = /eip-gateways
24592024-10-31T20:30:49.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 892 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61424 req_id = 1df65786-6050-43a5-a006-26f32a121d97 response_code = 204 uri = /vpc-routes
24602024-10-31T20:30:49.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120425 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51266 req_id = 970a26a4-2702-472c-baec-99f436def023 response_code = 204 uri = /switch-ports
24612024-10-31T20:30:49.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51266 req_id = cdce9528-9a38-45da-b8b1-676aa2aa343f response_code = 200 uri = /network-bootstore-config
24622024-10-31T20:30:49.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57946
24632024-10-31T20:30:49.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57946 req_id = facb7512-d32f-410d-bfdd-d6999bca1cc6 response_code = 200 uri = /v2p
24642024-10-31T20:30:49.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53319
24652024-10-31T20:30:49.495ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24662024-10-31T20:30:49.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24672024-10-31T20:30:49.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100346 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53319 req_id = 63afcab4-a0ae-47bc-ade7-45c006c62931 response_code = 204 uri = /switch-ports
24682024-10-31T20:30:49.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53319 req_id = 98376eff-fec0-41df-963b-71018cf5a803 response_code = 200 uri = /network-bootstore-config
24692024-10-31T20:30:52.289ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24702024-10-31T20:30:52.292ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24712024-10-31T20:30:52.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24722024-10-31T20:30:52.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24732024-10-31T20:31:02.293ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24742024-10-31T20:31:02.294ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24752024-10-31T20:31:02.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24762024-10-31T20:31:02.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24772024-10-31T20:31:02.796ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36490
24782024-10-31T20:31:02.797ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36490 req_id = 90d81bf2-012a-41e5-b1f1-a6b7d94b0e48 response_code = 200 uri = /baseboard
24792024-10-31T20:31:12.295ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24802024-10-31T20:31:12.297ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24812024-10-31T20:31:12.300ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24822024-10-31T20:31:12.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
24832024-10-31T20:31:18.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49029
24842024-10-31T20:31:18.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49029 req_id = e867c12a-22b8-4bf9-9cb1-d17183c7acaf response_code = 200 uri = /v2p
24852024-10-31T20:31:19.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45711
24862024-10-31T20:31:19.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45711 req_id = a7d0e8d0-0d67-49df-9066-31f9b44e5599 response_code = 200 uri = /vpc-routes
24872024-10-31T20:31:19.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
24882024-10-31T20:31:19.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45711 req_id = 5e757cec-b304-408c-bb17-b3c137e3a12d response_code = 204 uri = /eip-gateways
24892024-10-31T20:31:19.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45711 req_id = 51e6024b-19f0-4fb5-93a9-79c260439716 response_code = 204 uri = /vpc-routes
24902024-10-31T20:31:19.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62794
24912024-10-31T20:31:19.200ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
24922024-10-31T20:31:19.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
24932024-10-31T20:31:19.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137864 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62794 req_id = 757535d5-39e9-472e-ad2b-09a45236adaa response_code = 204 uri = /switch-ports
24942024-10-31T20:31:19.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52545
24952024-10-31T20:31:19.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52545 req_id = 4d1b315b-1492-47c0-b7be-3461b7ac50f7 response_code = 200 uri = /vpc-routes
24962024-10-31T20:31:19.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62794 req_id = d5aa2b0e-a77e-41d7-9ec3-6978c7fad8de response_code = 200 uri = /network-bootstore-config
24972024-10-31T20:31:19.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42472
24982024-10-31T20:31:19.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42472 req_id = bccc7718-5561-4434-a909-7fc4af3dd5af response_code = 200 uri = /vpc-routes
24992024-10-31T20:31:19.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53572
25002024-10-31T20:31:19.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53572 req_id = d90ba81e-1f58-45ba-a6eb-f581d4e59846 response_code = 200 uri = /v2p
25012024-10-31T20:31:19.384ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
25022024-10-31T20:31:19.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52545 req_id = e8f51d2c-bd2e-448b-b39b-6a2c18c14db4 response_code = 204 uri = /eip-gateways
25032024-10-31T20:31:19.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52545 req_id = 4fe77a19-92ef-4ed4-bec2-8937089e21ea response_code = 204 uri = /vpc-routes
25042024-10-31T20:31:19.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60460
25052024-10-31T20:31:19.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25062024-10-31T20:31:19.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25072024-10-31T20:31:19.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 113019 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60460 req_id = 4b1895a1-c3ea-4ee3-b0cc-ae32b5aef582 response_code = 204 uri = /switch-ports
25082024-10-31T20:31:19.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
25092024-10-31T20:31:19.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42032
25102024-10-31T20:31:19.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42472 req_id = 6eef5007-7df7-44e4-828d-9b5001bfea3f response_code = 204 uri = /eip-gateways
25112024-10-31T20:31:19.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46504
25122024-10-31T20:31:19.509ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25132024-10-31T20:31:19.509ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25142024-10-31T20:31:19.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60460 req_id = aa7b847b-038b-4ff7-bfc2-182f5dd8f3dd response_code = 200 uri = /network-bootstore-config
25152024-10-31T20:31:19.509ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25162024-10-31T20:31:19.509ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
25172024-10-31T20:31:19.509ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
25182024-10-31T20:31:19.509ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25192024-10-31T20:31:19.509ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25202024-10-31T20:31:19.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25212024-10-31T20:31:19.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25222024-10-31T20:31:19.510ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25232024-10-31T20:31:19.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42032 req_id = ab6d39ce-6ba7-48bc-9912-d7be761a4505 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25242024-10-31T20:31:19.510ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
25252024-10-31T20:31:19.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39015
25262024-10-31T20:31:19.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25272024-10-31T20:31:19.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25282024-10-31T20:31:19.530ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
25292024-10-31T20:31:19.530ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
25302024-10-31T20:31:19.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 735 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42472 req_id = 6cb60546-ad5b-4c12-ac12-28a037b8cea1 response_code = 204 uri = /vpc-routes
25312024-10-31T20:31:19.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63143
25322024-10-31T20:31:19.544ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25332024-10-31T20:31:19.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
25342024-10-31T20:31:19.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25352024-10-31T20:31:19.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25362024-10-31T20:31:19.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25372024-10-31T20:31:19.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25382024-10-31T20:31:19.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25392024-10-31T20:31:19.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63143 req_id = b46353b6-16e6-40ec-92aa-e08cc83cadda response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25402024-10-31T20:31:19.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64338
25412024-10-31T20:31:19.610ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:731 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3f4f0287-3e1d-43e4-92d4-51818f19aeea, kind: Service { id: a8364658-9f18-48ec-a891-264e5c9fbbb6 }, name: Name("external-dns-a8364658-9f18-48ec-a891-264e5c9fbbb6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f8a84a07-b5a5-4df1-b716-350849750307, kind: Service { id: 02376501-3235-4cfe-a1cd-82b53358d277 }, name: Name("external-dns-02376501-3235-4cfe-a1cd-82b53358d277"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 19])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 51cedfa9-394a-4772-9219-c0d1bbd35709, kind: Service { id: d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd }, name: Name("nexus-d1d4a816-66aa-49b9-ae2c-bb1e5c353bdd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc5d4789-938f-4b63-943c-fa25f029e3f9, kind: Service { id: d9ba0639-2706-4be9-a317-acca09a0f0a8 }, name: Name("nexus-d9ba0639-2706-4be9-a317-acca09a0f0a8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 180, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fbf5a295-1469-4a9e-8440-07b19c913d9a, kind: Service { id: d7179265-27eb-4ac0-b81e-90f9c7b4c49c }, name: Name("nexus-d7179265-27eb-4ac0-b81e-90f9c7b4c49c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 8])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25422024-10-31T20:31:19.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte0" rules = []
25432024-10-31T20:31:19.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25442024-10-31T20:31:19.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25452024-10-31T20:31:19.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25462024-10-31T20:31:19.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25472024-10-31T20:31:19.610ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:750 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25482024-10-31T20:31:19.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64338 req_id = 294deab6-7733-4c88-bd5f-ed63e288feee response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25492024-10-31T20:31:19.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50769
25502024-10-31T20:31:19.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4480 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50769 req_id = 9f993373-fe9f-462f-bd19-06e0f0d94508 response_code = 200 uri = /v2p
25512024-10-31T20:31:19.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38307
25522024-10-31T20:31:19.675ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25532024-10-31T20:31:19.715ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25542024-10-31T20:31:19.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 243364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46504 req_id = a7c0392f-0ca8-4464-80e2-a56956e50e9d response_code = 200 uri = /inventory
25552024-10-31T20:31:19.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 243202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39015 req_id = 9ec7345f-4ee8-4da1-a17b-bcdaa527d929 response_code = 200 uri = /inventory
25562024-10-31T20:31:19.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105226 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38307 req_id = ae20df7e-e10e-41ff-bb47-03474c0dfa60 response_code = 204 uri = /switch-ports
25572024-10-31T20:31:19.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38307 req_id = ee6f66f2-831f-4745-aca1-caae6564ef83 response_code = 200 uri = /network-bootstore-config
25582024-10-31T20:31:20.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45478
25592024-10-31T20:31:20.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25602024-10-31T20:31:20.304ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
25612024-10-31T20:31:20.304ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/config/omicron-zones.json file = common/src/ledger.rs:177
25622024-10-31T20:31:20.304ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/config/omicron-zones.json file = common/src/ledger.rs:177
25632024-10-31T20:31:20.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 204898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45478 req_id = abd25844-9d0f-4871-8883-bc06fbca8871 response_code = 200 uri = /inventory
25642024-10-31T20:31:22.299ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25652024-10-31T20:31:22.301ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25662024-10-31T20:31:22.304ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25672024-10-31T20:31:22.305ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25682024-10-31T20:31:32.303ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25692024-10-31T20:31:32.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25702024-10-31T20:31:32.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25712024-10-31T20:31:32.309ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25722024-10-31T20:31:32.829ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39727
25732024-10-31T20:31:32.829ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39727 req_id = f6115e35-7bff-49b5-9aa8-8f36f64bbe1f response_code = 200 uri = /baseboard
25742024-10-31T20:31:42.306ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25752024-10-31T20:31:42.308ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25762024-10-31T20:31:42.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25772024-10-31T20:31:42.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
25782024-10-31T20:31:48.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57199
25792024-10-31T20:31:48.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57199 req_id = 947544a0-e54d-4b8b-ba83-f5e683cc5d8b response_code = 200 uri = /vpc-routes
25802024-10-31T20:31:48.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
25812024-10-31T20:31:48.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57199 req_id = cd1b0f71-0bcc-4d49-b3db-15d814ed571d response_code = 204 uri = /eip-gateways
25822024-10-31T20:31:48.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57199 req_id = 16054f11-8894-4336-8fab-b52f1b50c356 response_code = 204 uri = /vpc-routes
25832024-10-31T20:31:48.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50143
25842024-10-31T20:31:48.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50143 req_id = 4d30f4db-55ad-4e68-af31-c63f3899e8f0 response_code = 200 uri = /v2p
25852024-10-31T20:31:48.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34234
25862024-10-31T20:31:48.947ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25872024-10-31T20:31:48.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
25882024-10-31T20:31:49.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34234 req_id = c8e9bf59-9ffc-480c-a2fe-6d192acbd94b response_code = 204 uri = /switch-ports
25892024-10-31T20:31:49.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34567
25902024-10-31T20:31:49.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34567 req_id = a38c1688-fdee-48c5-8759-77fb8621bee0 response_code = 200 uri = /vpc-routes
25912024-10-31T20:31:49.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34234 req_id = e607f79d-6727-41e1-b1e3-854af4a37758 response_code = 200 uri = /network-bootstore-config
25922024-10-31T20:31:49.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55176
25932024-10-31T20:31:49.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55176 req_id = d36ec3b8-69d3-4506-aafe-3c84324955b9 response_code = 200 uri = /v2p
25942024-10-31T20:31:49.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
25952024-10-31T20:31:49.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34567 req_id = c0c0e1eb-19a1-4f11-ba88-392151333bd1 response_code = 204 uri = /eip-gateways
25962024-10-31T20:31:49.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34567 req_id = 92bb7827-36a0-4313-8c42-aa1f9d5e70e3 response_code = 204 uri = /vpc-routes
25972024-10-31T20:31:49.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58236
25982024-10-31T20:31:49.161ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
25992024-10-31T20:31:49.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26002024-10-31T20:31:49.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103072 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58236 req_id = 8e798a51-84b0-477f-969e-e69d78b4d652 response_code = 204 uri = /switch-ports
26012024-10-31T20:31:49.264ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50402
26022024-10-31T20:31:49.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50402 req_id = f5d0638f-821a-4724-b8ae-1d1c2df4dfdf response_code = 200 uri = /vpc-routes
26032024-10-31T20:31:49.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58236 req_id = 3fce25a2-bb7f-44a0-ac12-d44cfc1c8bd9 response_code = 200 uri = /network-bootstore-config
26042024-10-31T20:31:49.280ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
26052024-10-31T20:31:49.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50402 req_id = a8e62b30-555a-4d0c-89a8-73d72c383da4 response_code = 204 uri = /eip-gateways
26062024-10-31T20:31:49.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50402 req_id = c18d2a1b-01ef-4974-a4f8-84e04877a1ac response_code = 204 uri = /vpc-routes
26072024-10-31T20:31:49.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63910
26082024-10-31T20:31:49.302ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26092024-10-31T20:31:49.346ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26102024-10-31T20:31:49.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 101723 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63910 req_id = 8a0cbf50-3878-4f24-a4b1-796e96c92506 response_code = 204 uri = /switch-ports
26112024-10-31T20:31:49.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50686
26122024-10-31T20:31:49.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63910 req_id = e4f8f1b3-1bae-48d9-8803-4a6cb47cb110 response_code = 200 uri = /network-bootstore-config
26132024-10-31T20:31:49.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50686 req_id = 3b7e5f9c-0fa4-4300-80b8-d2fb3a24082e response_code = 200 uri = /v2p
26142024-10-31T20:31:52.310ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26152024-10-31T20:31:52.311ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26162024-10-31T20:31:52.315ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26172024-10-31T20:31:52.315ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26182024-10-31T20:32:02.313ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26192024-10-31T20:32:02.315ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26202024-10-31T20:32:02.318ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26212024-10-31T20:32:02.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26222024-10-31T20:32:02.863ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45511
26232024-10-31T20:32:02.863ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45511 req_id = 01f307d8-20e1-49c0-82a9-e9c9f3da99dd response_code = 200 uri = /baseboard
26242024-10-31T20:32:12.315ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26252024-10-31T20:32:12.317ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26262024-10-31T20:32:12.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26272024-10-31T20:32:12.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26282024-10-31T20:32:18.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52279
26292024-10-31T20:32:18.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52279 req_id = 2fd2ceda-fdb9-4d3e-9a4b-e33faecab839 response_code = 200 uri = /vpc-routes
26302024-10-31T20:32:19.027ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
26312024-10-31T20:32:19.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52279 req_id = c3256818-e6e6-464b-953c-68807ccfd4f9 response_code = 204 uri = /eip-gateways
26322024-10-31T20:32:19.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52279 req_id = 38d4b8cd-1dae-4ea0-bbf0-9e5785d9e5fe response_code = 204 uri = /vpc-routes
26332024-10-31T20:32:19.149ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
26342024-10-31T20:32:19.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62807
26352024-10-31T20:32:19.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62807 req_id = 0fe6e545-1b53-41ac-ada0-226399403e2b response_code = 200 uri = /vpc-routes
26362024-10-31T20:32:19.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54722
26372024-10-31T20:32:19.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54722 req_id = b034e49c-3804-4ebf-b6e7-39fd69ba8312 response_code = 200 uri = /v2p
26382024-10-31T20:32:19.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45933
26392024-10-31T20:32:19.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26402024-10-31T20:32:19.295ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26412024-10-31T20:32:19.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 124762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45933 req_id = 75cdfaf7-e391-42d7-992d-5ab2902621a9 response_code = 204 uri = /switch-ports
26422024-10-31T20:32:19.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
26432024-10-31T20:32:19.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62807 req_id = 5248f2be-726b-4d91-85c9-17ecbc740c27 response_code = 204 uri = /eip-gateways
26442024-10-31T20:32:19.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45933 req_id = be922cd7-bb64-4767-bd03-e0f3eede7d3b response_code = 200 uri = /network-bootstore-config
26452024-10-31T20:32:19.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47906
26462024-10-31T20:32:19.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47906 req_id = dacaefe3-5cf3-4fd4-a922-1dadd6e3a1de response_code = 200 uri = /v2p
26472024-10-31T20:32:19.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62807 req_id = 8a598425-9b0f-4be4-8a85-2fe3fc5b1f71 response_code = 204 uri = /vpc-routes
26482024-10-31T20:32:19.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41041
26492024-10-31T20:32:19.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41041 req_id = b7996352-6e2d-4dca-be4b-34996cd6178e response_code = 200 uri = /v2p
26502024-10-31T20:32:19.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37572
26512024-10-31T20:32:19.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26522024-10-31T20:32:19.523ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26532024-10-31T20:32:19.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98566 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37572 req_id = bc183c5d-689d-45c7-88da-e9cf862ebdf0 response_code = 204 uri = /switch-ports
26542024-10-31T20:32:19.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57766
26552024-10-31T20:32:19.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57766 req_id = 8046f417-c9e6-4d84-846c-272b2c36b558 response_code = 200 uri = /vpc-routes
26562024-10-31T20:32:19.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37572 req_id = 0470cd2c-0e74-495c-8412-7a8918e3bca3 response_code = 200 uri = /network-bootstore-config
26572024-10-31T20:32:19.596ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
26582024-10-31T20:32:19.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57766 req_id = 7a553bc5-c0ff-42a6-b4d4-7a2f342e8868 response_code = 204 uri = /eip-gateways
26592024-10-31T20:32:19.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38325
26602024-10-31T20:32:19.601ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26612024-10-31T20:32:19.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26622024-10-31T20:32:19.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 105690 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38325 req_id = 6218487e-bc6c-4550-9105-97359efc8337 response_code = 204 uri = /switch-ports
26632024-10-31T20:32:19.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38325 req_id = b2da7da8-0da4-4f8d-9491-9e006cdb40f4 response_code = 200 uri = /network-bootstore-config
26642024-10-31T20:32:19.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57766 req_id = ce5fe787-63ec-49cc-9b14-0d70c8ab4610 response_code = 204 uri = /vpc-routes
26652024-10-31T20:32:22.319ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26662024-10-31T20:32:22.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26672024-10-31T20:32:22.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26682024-10-31T20:32:22.324ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26692024-10-31T20:32:32.321ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26702024-10-31T20:32:32.323ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26712024-10-31T20:32:32.326ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26722024-10-31T20:32:32.327ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26732024-10-31T20:32:32.897ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48689
26742024-10-31T20:32:32.897ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48689 req_id = 4ac3b890-d21b-4d03-90ba-fd1c9700e33b response_code = 200 uri = /baseboard
26752024-10-31T20:32:42.325ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26762024-10-31T20:32:42.327ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26772024-10-31T20:32:42.329ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26782024-10-31T20:32:42.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
26792024-10-31T20:32:48.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44924
26802024-10-31T20:32:48.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44924 req_id = e5452015-12f8-4496-9e03-be7ceed93a37 response_code = 200 uri = /vpc-routes
26812024-10-31T20:32:48.906ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
26822024-10-31T20:32:48.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44924 req_id = 52a74f20-9a97-4497-acc5-396ff0320311 response_code = 204 uri = /eip-gateways
26832024-10-31T20:32:48.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44924 req_id = b60fc06f-c3bd-403a-8740-592059f5a1ec response_code = 204 uri = /vpc-routes
26842024-10-31T20:32:48.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35986
26852024-10-31T20:32:48.968ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
26862024-10-31T20:32:49.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
26872024-10-31T20:32:49.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35986 req_id = d2d15a8c-fc2e-499d-8c20-b99db6b2b105 response_code = 204 uri = /switch-ports
26882024-10-31T20:32:49.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40839
26892024-10-31T20:32:49.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56743
26902024-10-31T20:32:49.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56743 req_id = 4d24f0cb-9782-42ff-b810-7fe9d8616508 response_code = 200 uri = /vpc-routes
26912024-10-31T20:32:49.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35986 req_id = dcbcf5c3-b9f3-4c44-833b-0816f7b8d5ef response_code = 200 uri = /network-bootstore-config
26922024-10-31T20:32:49.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40839 req_id = 5af14192-b46b-4981-b94a-23fdc468bf1d response_code = 200 uri = /v2p
26932024-10-31T20:32:49.130ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
26942024-10-31T20:32:49.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56743 req_id = 4b03f6c6-a0ba-431c-90f2-788fa54802a4 response_code = 204 uri = /eip-gateways
26952024-10-31T20:32:49.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42834
26962024-10-31T20:32:49.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42834 req_id = f25420cb-3f20-4801-aa59-59282972383e response_code = 200 uri = /v2p
26972024-10-31T20:32:49.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56743 req_id = 73256ec5-138b-4dc2-ae7c-57b857926ac5 response_code = 204 uri = /vpc-routes
26982024-10-31T20:32:49.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48944
26992024-10-31T20:32:49.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48944 req_id = ee9ebc33-997a-492a-ab5a-92bd4b24aa5f response_code = 200 uri = /vpc-routes
27002024-10-31T20:32:49.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
27012024-10-31T20:32:49.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48944 req_id = 00590754-b795-4d2b-be53-d5a1cdab1f21 response_code = 204 uri = /eip-gateways
27022024-10-31T20:32:49.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48944 req_id = fb0b13e1-2f72-45be-bae9-1f197ec0f2d2 response_code = 204 uri = /vpc-routes
27032024-10-31T20:32:49.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65067
27042024-10-31T20:32:49.280ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27052024-10-31T20:32:49.328ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27062024-10-31T20:32:49.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 114329 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65067 req_id = c2d3468f-8a3d-4841-b2d1-c80cc1ca7098 response_code = 204 uri = /switch-ports
27072024-10-31T20:32:49.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42673
27082024-10-31T20:32:49.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40679
27092024-10-31T20:32:49.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65067 req_id = bc2bfa29-4e34-4ca5-ac2c-f21f6424aa74 response_code = 200 uri = /network-bootstore-config
27102024-10-31T20:32:49.395ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27112024-10-31T20:32:49.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42673 req_id = 90e07cc3-fc6b-489a-b6d4-c70e369e5311 response_code = 200 uri = /v2p
27122024-10-31T20:32:49.437ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27132024-10-31T20:32:49.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 102815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40679 req_id = 893f0699-8a27-41d1-ac9b-8c9af7eb834a response_code = 204 uri = /switch-ports
27142024-10-31T20:32:49.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40679 req_id = a4cc5fb2-da2c-4332-ada2-0ebc9a4bbbf9 response_code = 200 uri = /network-bootstore-config
27152024-10-31T20:32:52.328ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27162024-10-31T20:32:52.330ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27172024-10-31T20:32:52.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27182024-10-31T20:32:52.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27192024-10-31T20:33:02.331ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27202024-10-31T20:33:02.333ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27212024-10-31T20:33:02.335ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27222024-10-31T20:33:02.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27232024-10-31T20:33:02.932ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44874
27242024-10-31T20:33:02.933ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44874 req_id = c610f5bf-186a-4668-8438-a0783f60935d response_code = 200 uri = /baseboard
27252024-10-31T20:33:12.336ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27262024-10-31T20:33:12.339ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27272024-10-31T20:33:12.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27282024-10-31T20:33:12.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27292024-10-31T20:33:19.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39856
27302024-10-31T20:33:19.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39856 req_id = 52c8e16d-7546-464f-af50-722e1efe2c38 response_code = 200 uri = /vpc-routes
27312024-10-31T20:33:19.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61610
27322024-10-31T20:33:19.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61610 req_id = d09459a7-bf53-431a-a91a-9d05c091d303 response_code = 200 uri = /vpc-routes
27332024-10-31T20:33:19.168ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
27342024-10-31T20:33:19.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39856 req_id = f85f2df1-75a9-4696-b71d-eb25e3b57008 response_code = 204 uri = /eip-gateways
27352024-10-31T20:33:19.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39856 req_id = aa194ac2-9ca4-425f-b47c-ba02c61f425c response_code = 204 uri = /vpc-routes
27362024-10-31T20:33:19.216ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
27372024-10-31T20:33:19.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61610 req_id = ef9efe8d-1149-4c78-934b-d3abe56ab5f2 response_code = 204 uri = /eip-gateways
27382024-10-31T20:33:19.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61610 req_id = a1c2241a-6f37-4da9-858e-716e21bf2fdb response_code = 204 uri = /vpc-routes
27392024-10-31T20:33:19.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39550
27402024-10-31T20:33:19.286ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27412024-10-31T20:33:19.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27422024-10-31T20:33:19.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 116514 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39550 req_id = ee7d46ff-3608-4494-aeb4-4c0696af6929 response_code = 204 uri = /switch-ports
27432024-10-31T20:33:19.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55879
27442024-10-31T20:33:19.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55879 req_id = 6fb2a323-8e5f-4be7-a04c-429cd18ace74 response_code = 200 uri = /v2p
27452024-10-31T20:33:19.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39550 req_id = 6876c7da-332a-4b4e-b0a4-b45669ed3b35 response_code = 200 uri = /network-bootstore-config
27462024-10-31T20:33:19.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46027
27472024-10-31T20:33:19.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46027 req_id = 8dc38292-d4b2-4181-a495-999c560c2582 response_code = 200 uri = /v2p
27482024-10-31T20:33:19.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37785
27492024-10-31T20:33:19.467ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27502024-10-31T20:33:19.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27512024-10-31T20:33:19.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 120831 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37785 req_id = 7995b403-322b-4b0d-8db0-97e28810e0ba response_code = 204 uri = /switch-ports
27522024-10-31T20:33:19.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51802
27532024-10-31T20:33:19.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51802 req_id = 7a190e16-0ccc-4f93-9353-0fb061761655 response_code = 200 uri = /vpc-routes
27542024-10-31T20:33:19.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37785 req_id = aed50b2f-d798-4917-971b-ae7b507f81b6 response_code = 200 uri = /network-bootstore-config
27552024-10-31T20:33:19.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59316
27562024-10-31T20:33:19.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59316 req_id = 22864a74-4ed2-4b0f-a77c-dc0debcdd1cf response_code = 200 uri = /v2p
27572024-10-31T20:33:19.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45537
27582024-10-31T20:33:19.674ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4081
27592024-10-31T20:33:19.719ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4105
27602024-10-31T20:33:19.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 118837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45537 req_id = 731728ea-10d6-403e-90fc-3a91b15a3f0f response_code = 204 uri = /switch-ports
27612024-10-31T20:33:19.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
27622024-10-31T20:33:19.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51802 req_id = 1b3aefe3-c933-4ab0-96cc-d3a088fbcc56 response_code = 204 uri = /eip-gateways
27632024-10-31T20:33:19.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45537 req_id = e64298b0-6a8d-421c-9566-2fcb4d5d0f44 response_code = 200 uri = /network-bootstore-config
27642024-10-31T20:33:19.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51802 req_id = 06c575d4-2269-4b90-8b13-021abb718fd8 response_code = 204 uri = /vpc-routes
27652024-10-31T20:33:21.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35212
27662024-10-31T20:33:21.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35212 req_id = 4a0d14bd-ab01-4eb5-944e-7630dcbc2e5f response_code = 200 uri = /v2p
27672024-10-31T20:33:21.702ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:838 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(1431929) }
27682024-10-31T20:33:21.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35212 req_id = 3af8baf5-5ba5-4425-8c53-b4ff37adccab response_code = 204 uri = /v2p
27692024-10-31T20:33:21.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51462
27702024-10-31T20:33:21.886ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 054b3993-78fc-425d-b55e-1a4e8f813c2c, kind: Instance { id: 357fbea1-566f-4f4b-889b-8e19f3822126 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1431929), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 054b3993-78fc-425d-b55e-1a4e8f813c2c, kind: Instance { id: 357fbea1-566f-4f4b-889b-8e19f3822126 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1431929), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 054b3993-78fc-425d-b55e-1a4e8f813c2c, kind: Instance { id: 357fbea1-566f-4f4b-889b-8e19f3822126 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1431929), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1431929))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 054b3993-78fc-425d-b55e-1a4e8f813c2c, kind: Instance { id: 357fbea1-566f-4f4b-889b-8e19f3822126 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1431929), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-dabaca91725", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 43ff7a09-8e75-4b6b-bdb6-860faed08749, read_only_parent: Some(Volume { block_size: 512, id: 886440e4-5396-41f1-8574-d58bafdc654d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ef2f209b-3319-41e8-9a89-c0f5d1235796, key: Some("eHbe/ThqAunBVlOfDvSNaHbyDO9Z01y1c5uXIV2IucY="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 43ff7a09-8e75-4b6b-bdb6-860faed08749, key: Some("fxp127w4MZgzSENAbcAmzZvwZlnoiit4XEi1AU6shWg="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::17]:19003", "[fd00:1122:3344:101::13]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-dabaca91725" }] }), cloud_init_bytes: Some(..) } instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 metadata = InstanceMetadata { silo_id: 9efc5118-5ea4-4fe1-a8c5-501dee3e98c0, project_id: a417e185-37e9-49d5-8ec8-a866b9e0467f } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-31T20:33:21.879932781Z }
27712024-10-31T20:33:21.887ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 migration_id = None propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
27722024-10-31T20:33:21.887ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 migration_id = None propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 054b3993-78fc-425d-b55e-1a4e8f813c2c, kind: Instance { id: 357fbea1-566f-4f4b-889b-8e19f3822126 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1431929), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 054b3993-78fc-425d-b55e-1a4e8f813c2c, kind: Instance { id: 357fbea1-566f-4f4b-889b-8e19f3822126 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1431929), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 054b3993-78fc-425d-b55e-1a4e8f813c2c, kind: Instance { id: 357fbea1-566f-4f4b-889b-8e19f3822126 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1431929), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1431929))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 054b3993-78fc-425d-b55e-1a4e8f813c2c, kind: Instance { id: 357fbea1-566f-4f4b-889b-8e19f3822126 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1431929), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-dabaca91725", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 43ff7a09-8e75-4b6b-bdb6-860faed08749, read_only_parent: Some(Volume { block_size: 512, id: 886440e4-5396-41f1-8574-d58bafdc654d, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ef2f209b-3319-41e8-9a89-c0f5d1235796, key: Some("eHbe/ThqAunBVlOfDvSNaHbyDO9Z01y1c5uXIV2IucY="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 43ff7a09-8e75-4b6b-bdb6-860faed08749, key: Some("fxp127w4MZgzSENAbcAmzZvwZlnoiit4XEi1AU6shWg="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::17]:19003", "[fd00:1122:3344:101::13]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-dabaca91725" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-10-31T20:33:21.879932781Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27732024-10-31T20:33:21.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51462 req_id = f1ef33b7-04be-43f5-9056-c3b75b1277d3 response_code = 200 uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063
27742024-10-31T20:33:22.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63718
27752024-10-31T20:33:22.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63718 req_id = 63a8bee1-7473-4229-bfb9-db078369303d response_code = 200 uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063/state
27762024-10-31T20:33:22.005ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:430 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 1431929 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27772024-10-31T20:33:22.005ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
27782024-10-31T20:33:22.053ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063 file = illumos-utils/src/zone.rs:325 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
27792024-10-31T20:33:22.078ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063 file = illumos-utils/src/zone.rs:363 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
27802024-10-31T20:33:22.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47292
27812024-10-31T20:33:22.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47292 req_id = 345497e4-41aa-407f-9333-93aac4175078 response_code = 200 uri = /vpc-routes
27822024-10-31T20:33:22.129ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {054b3993-78fc-425d-b55e-1a4e8f813c2c: {10.151.1.176: {704ec6cc-4706-4a67-a05c-d8be500e3300}, 10.151.1.175: {704ec6cc-4706-4a67-a05c-d8be500e3300}}} }
27832024-10-31T20:33:22.340ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27842024-10-31T20:33:22.342ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27852024-10-31T20:33:22.346ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27862024-10-31T20:33:22.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
27872024-10-31T20:33:23.475ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
27882024-10-31T20:33:23.475ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27892024-10-31T20:33:23.652ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 60.733866ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27902024-10-31T20:33:23.737ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 107.244764ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27912024-10-31T20:33:23.863ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 104.326343ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27922024-10-31T20:33:23.983ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 406.881074ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27932024-10-31T20:33:24.406ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 796.930216ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27942024-10-31T20:33:25.218ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 1.161369368s file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27952024-10-31T20:33:26.391ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 1.40953316s file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27962024-10-31T20:33:27.815ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 909.478472ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 zone = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
27972024-10-31T20:33:28.761ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063 file = sled-agent/src/instance.rs:1787 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
27982024-10-31T20:33:28.771ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 34.367959ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
27992024-10-31T20:33:28.816ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 81.959524ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28002024-10-31T20:33:28.911ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 157.544274ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28012024-10-31T20:33:29.083ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063") failed: Property not found. retry in 249.364233ms file = illumos-utils/src/svc.rs:36 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28022024-10-31T20:33:29.346ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1796 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28032024-10-31T20:33:29.384ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1820 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28042024-10-31T20:33:29.531ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28052024-10-31T20:33:29.532ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1215 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28062024-10-31T20:33:29.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7403587 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47292 req_id = 335ec147-935a-4003-8dc0-bc068b757240 response_code = 204 uri = /eip-gateways
28072024-10-31T20:33:29.532ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-10-31T20:33:29.532682782Z } file = sled-agent/src/instance.rs:780 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28082024-10-31T20:33:29.532ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-10-31T20:33:29.532682782Z } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28092024-10-31T20:33:29.532ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-10-31T20:33:29.532682782Z }, migration_in: None, migration_out: None }
28102024-10-31T20:33:29.578ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-10-31T20:33:29.578318353Z } file = sled-agent/src/instance.rs:780 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28112024-10-31T20:33:29.578ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-31T20:33:29.578318353Z } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28122024-10-31T20:33:29.578ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-10-31T20:33:29.578318353Z }, migration_in: None, migration_out: None }
28132024-10-31T20:33:29.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47292 req_id = fb08fefe-4aa8-41c6-9bae-03ba6e3f490b response_code = 204 uri = /vpc-routes
28142024-10-31T20:33:32.343ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28152024-10-31T20:33:32.344ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28162024-10-31T20:33:32.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28172024-10-31T20:33:32.349ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28182024-10-31T20:33:32.969ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41420
28192024-10-31T20:33:32.969ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41420 req_id = b329e4b1-3e6d-4dc0-b3b4-9528d1a068ca response_code = 200 uri = /baseboard
28202024-10-31T20:33:39.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45723
28212024-10-31T20:33:39.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 706 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45723 req_id = 414b11b0-5ab9-46ca-9857-265e215fbeed response_code = 200 uri = /vmms/c0830806-a2a5-45b8-9ba4-47136bbb3063/state
28222024-10-31T20:33:39.509ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-10-31T20:33:39.509249099Z } file = sled-agent/src/instance.rs:780 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28232024-10-31T20:33:39.509ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-10-31T20:33:39.509249099Z } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28242024-10-31T20:33:39.509ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-10-31T20:33:39.509249099Z }, migration_in: None, migration_out: None }
28252024-10-31T20:33:39.526ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-10-31T20:33:39.526436190Z } file = sled-agent/src/instance.rs:780 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28262024-10-31T20:33:39.526ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-10-31T20:33:39.526436190Z } propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28272024-10-31T20:33:39.526ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28282024-10-31T20:33:39.526ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28292024-10-31T20:33:39.526ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 10567757938779281698 n_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28302024-10-31T20:33:39.526ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14496142322626062612 n_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28312024-10-31T20:33:39.526ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:451
28322024-10-31T20:33:39.526ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/1861475f-867e-45e6-a81b-af152ebe9a55/debug/bundle/zone", "/pool/int/6d5de02b-0b31-45f6-8a53-13e937cfb977/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/c58d846a-5713-40f9-b784-2f738bd83bc2/crypt/debug", "/pool/ext/6cdabbea-dfea-4c4a-a6f2-7df6bde97f34/crypt/debug", "/pool/ext/90a5cbc6-ee3d-4de0-9a29-814842f60db6/crypt/debug", "/pool/ext/c0da9f47-3ba9-44de-b97b-4854847926e3/crypt/debug", "/pool/ext/d94d1e41-79ad-434a-a5c0-f6dedadc31a6/crypt/debug", "/pool/ext/b02e5273-d830-439b-a210-08a4dffedb6c/crypt/debug", "/pool/ext/d69c81fd-1038-4573-af8f-d97c9e6eb958/crypt/debug", "/pool/ext/29756246-aa82-409a-9346-5743a657eff3/crypt/debug", "/pool/ext/fc2aad54-033d-4218-806a-7c669bd520a9/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063
28332024-10-31T20:33:40.189ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063", bundle_id: d3972a77-4dda-46ad-a85f-3d6fe328e780 }, time_created: 2024-10-31T20:33:39.527476429Z, version: 0, cause: TerminatedInstance }
28342024-10-31T20:33:40.189ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_c0830806-a2a5-45b8-9ba4-47136bbb3063 file = sled-agent/src/instance.rs:1032 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28352024-10-31T20:33:41.945ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28362024-10-31T20:33:41.964ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(1431929), kind: System }
28372024-10-31T20:33:41.964ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:964 id = RouterId { vni: Vni(1431929), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28382024-10-31T20:33:41.964ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-31T20:33:41.964598693Z }, migration_in: None, migration_out: None }
28392024-10-31T20:33:41.990ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-10-31T20:33:41.964598693Z }, migration_in: None, migration_out: None }
28402024-10-31T20:33:41.992ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 357fbea1-566f-4f4b-889b-8e19f3822126 propolis_id = c0830806-a2a5-45b8-9ba4-47136bbb3063
28412024-10-31T20:33:42.347ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28422024-10-31T20:33:42.348ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28432024-10-31T20:33:42.351ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28442024-10-31T20:33:42.351ZWARNSledAgent (kstat-sampler-worker): sample queue is too full, dropping oldest samples file = oximeter/instruments/src/kstat/sampler.rs:688 n_current_samples = 500 n_new_samples = 6 n_overflow_samples = 6 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28452024-10-31T20:33:42.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44103
28462024-10-31T20:33:42.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44103 req_id = afaa8b23-201c-43d4-b35d-114b518dc8b1 response_code = 200 uri = /vpc-routes
28472024-10-31T20:33:42.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
28482024-10-31T20:33:42.550ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1215 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57
28492024-10-31T20:33:42.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44103 req_id = acbb66f5-ac23-4d20-bcad-c476812e7162 response_code = 204 uri = /eip-gateways
28502024-10-31T20:33:42.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44103 req_id = dac923e2-16e1-4363-bca9-5c2347d168cb response_code = 204 uri = /vpc-routes
28512024-10-31T20:33:42.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33211
28522024-10-31T20:33:42.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33211 req_id = 176e1c38-e6d4-4ec0-bb8b-e9869e93f6b7 response_code = 200 uri = /v2p
28532024-10-31T20:33:43.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34166
28542024-10-31T20:33:43.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34166 req_id = 41972961-76d8-4ab9-a0b6-3a4429eab98c response_code = 200 uri = /v2p
28552024-10-31T20:33:43.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49816
28562024-10-31T20:33:43.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49816 req_id = c7ad6e88-2417-459a-b598-4f7e6bb9633e response_code = 200 uri = /vpc-routes
28572024-10-31T20:33:43.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
28582024-10-31T20:33:43.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49816 req_id = ca914d1e-f0e3-4194-ab63-b2f82502ec4c response_code = 204 uri = /eip-gateways
28592024-10-31T20:33:43.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49816 req_id = 553c573c-396d-45c2-a3a4-506b25fd8779 response_code = 204 uri = /vpc-routes
28602024-10-31T20:33:44.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56916
28612024-10-31T20:33:44.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56916 req_id = dba4dffe-d4e9-4eac-91b4-3088762c63eb response_code = 200 uri = /vpc-routes
28622024-10-31T20:33:44.513ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1189 sled_id = 622abb78-eb68-41c1-ac52-e7a263024e57 values = ExternalIpGatewayMap { mappings: {} }
28632024-10-31T20:33:44.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56916 req_id = a41dc757-399a-4e96-9a01-4ecf92750b44 response_code = 204 uri = /eip-gateways
28642024-10-31T20:33:44.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56916 req_id = 730a0649-4684-4608-9d0a-6a0b5ab323b2 response_code = 204 uri = /vpc-routes