News on Medial

'Feels like magic!': Groq's ultrafast LPU could well be the first LLM-native processor — and its latest demo may well convince Nvidia and AMD to get out their checkbooks

Techradar · 1y ago

Medial

Groq, a company led by ex-Google engineer Jonathan Ross, claims to have developed the first-ever Language Processing Unit (LPU) for AI applications. The company's Tensor Stream Processor (TSP) operates like an assembly line, while also being more energy efficient and scalable. In recent demos, Groq's LPU showcased lightning-fast speeds, generating factual and cited answers with hundreds of words in less than a second. The performance of Groq's LPU puts it in direct competition with other AI models like Chat-GPT. To experience the speed firsthand, users can visit a chat page provided by Groq.