News on Medial

xAI open-sources base model of Grok, but without any training code

TechCrunch · 1y

Elon Musk's xAI has open-sourced the base code for the Grok AI model. The model, known as the "314 billion parameter Mixture-of-Expert model," is available on GitHub under the Apache License 2.0. However, the training code is not included. The Grok model was previously released as a chatbot on the X social network but the open-source version does not have connections to the network. Some companies are already considering using Grok in their AI-powered tools, and Perplexity CEO Arvind Srinivas has mentioned fine-tuning it for conversational search.