Groq’s founder on why AI’s next big shift isn’t about Nvidia - YouTube
Delivering Fast AI Inference with the LPUThe Groq Language Processing Unit, the LPU, is the technology that meets this moment. The LPU delivers instant speed, unparalleled affordability, and energy efficiency at scale. Fundamentally different from the GPU – originally designed for graphics processing – the LPU was designed for AI inference and language.
free dev option available
Groq, Inc. is an American artificial intelligence (AI) company that builds an AI accelerator application-specific integrated circuit (ASIC) that they call the Language Processing Unit (LPU) and related hardware to accelerate the inference performance of AI workloads.
Examples of the types AI workloads that run on Groq's LPU are: large language models (LLMs),[2][3] image classification,[4] anomaly detection,[5][6] and predictive analysis.
No comments:
Post a Comment