News on Medial

New AI benchmark tests speed of responses to user queries

Economic TimesEconomic Times · 8m
New AI benchmark tests speed of responses to user queries

AI benchmarking group MLCommons has released new tests and results that assess the speed of top-of-the-line hardware in running AI applications. The benchmarks focus on the generation of responses from powerful AI models, showcasing how quickly applications like ChatGPT can deliver responses. MLCommons added a question-and-answer benchmark called Llama 2, developed by Meta Platforms, and a text-to-image generator benchmark based on Stability AI's Stable Diffusion XL model. Servers powered by Nvidia's H100 chips were the winners in terms of raw performance, with designs from other companies also showing promising results. Energy efficiency remains a significant challenge in AI deployment. MLCommons has a separate benchmark category for measuring power consumption.

Comments

Download the medial app to read full posts, comements and news.