Super Micro Computer, Inc. (SMCI) is making waves in the AI space with the launch of its new 3U Edge AI inferencing system. This high-density platform is specifically designed to handle the demanding computational needs of AI applications at the network edge, where data is processed closer to its source. The system boasts an impressive array of features, including support for eight dual-width GPU accelerator cards, two Intel Xeon 6900 processors, 8800 MT/s MRDIMM, and up to 20 PCIe 5.0 expansion slots. It can also accommodate up to 6TB of RDIMM memory and 14 E1.S or 6 U.2 NVMe drives.
The company highlights the system’s optimized thermal design, which enables it to deliver high performance within a compact 3U form factor. This makes it suitable for deployment in edge data centers, where space and power consumption are often critical factors.
Charles Liang, president and CEO of Supermicro, emphasized the growing demand for powerful AI solutions, stating, “As the AI market is growing exponentially, customers need a powerful, versatile solution to inference data to run LLM-based applications on-premises, close to where the data is generated. Our new 3U Edge AI system enables them to run innovative solutions with minimal latency.”
This launch comes at a crucial time for Super Micro, as the company faces scrutiny from the Department of Justice following an August short report from Hindenburg Research. The report raised concerns about the company’s revenue recognition practices and allegations of past accounting violations.
Despite the ongoing investigation, SMCI shares initially surged by over 15% on Monday after the company announced its deployment of over 100,000 GPUs for large-scale AI projects. Super Micro also unveiled a comprehensive liquid cooling solution for its servers, featuring advanced cooling technologies designed to enhance efficiency and performance.
However, the market’s reaction to the new AI system appears to be mixed. SMCI shares plummeted at the opening bell on Tuesday, dropping by 5.97% to $44.87. While the launch showcases Super Micro’s commitment to AI innovation, the company will need to navigate the challenges posed by the ongoing DOJ investigation to regain investor confidence.
