Elon Musk’s xAI Takes Its AI Chatbot Grok Open Source for Researchers and Developers

Mar18,2024



Elon Musk's artificial intelligence (AI) venture, XAI, made its large language model (LLM) GROC-1 available in open source on March 17. Last week, the billionaire revealed on his social media platform X (formerly known as Twitter) that the AI ​​chatbot would be open-source. Now, it is available to researchers and developers. Specifically, the Doesn't come with.

Announcing the open release, xAI said in a blog post, “We are releasing the base model weights and network architecture of our large language model Grok-1. Grok-1 is a 314 billion parameter mixture-of-experts model trained from scratch by xAI. The AI ​​firm also noted that the LLM is being provided in open source under the Apache 2.0 license. Interested individuals can access the AI ​​model from GitHub.

According to a report by VentureBeat, the Apache 2.0 license covers commercial use as well as modification and redistribution. This means that developers can build on top of LLM, fine-tune it for specific applications, and sell it. However, models cannot be trademarked and developers must mention any changes made to the original code.

But while a commercial license is being provided, the version of Grok-1 that has been made available is from October 2023, before which the model was trained using data from X and this gives the Grok chatbot a unique personality. Is. This means that any researchers or developers wishing to use the model will have to obtain the data themselves.

xAI said the open-sourced Grok-1 is a 314 billion parameter mixture-of-experts (MoE) model. The parameter size is much larger than that of other LLMs in the public domain, such as Meta LLAMA2 or Mistral 8x7B. The larger the parameter size, the larger the context window of the AI. This enables it to provide more contextually accurate and complete responses.

Grok was unveiled on November 3, 2023 as a chatbot designed to compete with the major players in the segment. It was made available to a limited number of users who purchased an X Premium+ subscription. Musk also said at the time that Grok would get a standalone app.


Affiliate links may be automatically generated – see our ethics statement for details.

Related Post

Leave a Reply

Your email address will not be published. Required fields are marked *