Groq 1 topic

CEO Jonathan Ross founded Groq with the goal of making high performance AI available to everyone.

Groq operates in a crowded space with intense competition including NVIDIA, Google, Microsoft, AWS, Intel, Cerebras, Graphcore, etc. NVIDIA has an overwhelming estimated market share of 80%.

CEO Ross believes Groq’s speedier, more affordable chip will be readily adopted by startups in particular and help Groq gain market share.

Groq has broken records in the AI space by being able to run chatbots faster than Gemini, ChatGPT, and Microsoft’s GrokAI. For reference, the company claims Groq chips can run OpenAi’s chatbot ChatGPT 13 times faster than it does currently. Groq is making chips with LPUs more suitable for AI language models as opposed to NVIDIA’s GPUs. GPUs are needed for training AI models, but LPUs reduce the time from inputs to making predictions or decisions (inference).

Groq acquired Maxeler Technologies in 2022 and Definitive Intelligence in 2024. The company partners with BittWare, iqt, Poe, Cirrascale, VAPI, carahsoft.