During AMD’s Computex 2024 event, Gigabyte unveiled its end-to-end artificial intelligence (AI) solution for training large language models (LLM) natively on a single device. The full-stack AI solution includes AI Top Utilities, AI Top Hardware, and AI Top Tutor, which covers various aspects of training open-source AI models. AI Top Utilities is a training software with support for multiple open-source AI models, while AI Top Hardware offers the company’s AI-focused products. AI Top Tutor is for people who need help understanding how to get the most out of this solution.
Gigabyte AI provides solutions for training top on-device AI
Announcing during the Computex 2024 event, the company unveiled AI Top as an all-in-one solution that aims to “train your own AI at your desk”. In a press release, the company detailed various aspects of the offering which includes three segments – software support, hardware support and consultation and technical support. Notably, this announcement comes after the Gigabyte AI PC was introduced at the Consumer Electronics Show (CES) 2024.
Gigabyte AI Top Utility
Photo credit: Gigabyte
AI Top Utility is a digital interface that allows local AI model training using new workflows. The company claims that the software offers a user-friendly interface and real-time progress monitoring. It supports multiple open-source AI models with 236 billion parameters. The company claims that the platform is more cost-effective and shows faster results compared to cloud counterparts. It can also offload data to system memory and SSDs, bypassing VRAM size limitations.
Next up is the AI Top Hardware, which is essentially a hardware offering from the company. It features a range of AI optimized products that are power efficient and can handle AI training workloads. These hardware solutions also include upgradeable components. One of the primary hardware in this series includes the AI Top motherboard (TRX50) with configurable form factor, memory type and slots, graphics interface and more. An AI top graphics card, SSD and PSU are also included.
The last offering in this solution is AI Top Tutor. Positioning it as “on-desk AI coaching,” this is essentially the company’s AI-powered consulting and technical support system that provides insights, set-up guidance, and troubleshooting assistance. The company claims that the coaching system will empower both beginners and professionals to start AI projects on the device.
The company has not announced pricing or availability for Gigabyte AI Top Solutions.