News on Medial

'iPhone of AI': startup first to deliver trillion-plus parameter AI model that works in symbiosis with its very own chip — SambaNova promises 90% savings on inference costs, but take that with a pinch of salt

TechradarTechradar · 8m
'iPhone of AI': startup first to deliver trillion-plus parameter AI model that works in symbiosis with its very own chip — SambaNova promises 90% savings on inference costs, but take that with a pinch of salt

SambaNova Systems, a Softbank-funded company, has launched Samba-1, the first trillion-parameter generative AI model. Unlike other models, Samba-1 uses a Composition of Experts (CoE) architecture, aggregating multiple smaller models into a single large solution. This approach offers broader knowledge across various domains and promises high accuracy and multimodality. SambaNova Systems also introduced the SN40L, a smart AI chip that integrates with the Samba-1 model, making it the first integrated hardware and software system for enterprise AI. Despite its claimed 90% reduction in inference costs, the true value of this saving remains to be seen in real-world deployments.

Comments

Download the medial app to read full posts, comements and news.