On Monday, the 13th of May, OpenAI gained an advantage over Google (who had their own launch event planned for the following day) by releasing a new version of their GPT-4 flagship model called GPT-4-o, with "o" standing for omni. While it doesn't deliver any features that we haven't seen before from a large language model, GPT-4-o represents a significant step forward in performance and usability, especially when it comes to multi-modal inputs and outputs.

This lag, often referred to as 'inference speed,' is essentially the time LLMs take to generate the tokens that form their responses. The reason ChatGPT might take a while is because the GPUs supplied by Nvidia, while optimized for a wide range of tasks, aren't specifically designed for hosting Large Language Models. This is where Groq offers a distinctly different approach…

Why on earth start another Generative AI blog?

Since ChatGPT burst onto the scene in November 2022, I’m sure your social feeds, much like mine, have been filled with content predominantly about generative AI—and for good reason.