Grok ?

Post13: Grok by Elon Musk.

According to xAI, Grok has been created to assist humanity to understand and gain knowledge. It is powered by Grok-1 LLM, which has been developed over a period of four months. The prototype Grok-0 was trained with 33 billion parameters, which is said to be as capable as Meta’s LLaMA 2, which supports 70 billion parameters.

In terms of benchmarks, the Grok-1 achieves 63.2% on the HumanEval coding task and 73% on MMLU. While it is still not as capable of something like GPT-4, xAI claims that, within a limited time, the company has been able to improve the performance of Grok-1 when compared to Grok-0.

Grok is a verb coined by American science fiction writer Robert A. Heinlein and, according to the Collins dictionary, means to “understand thoroughly and intuitively”.

Grok has been built by Musk’s new AI company, xAI. Staff at xAI explained the chatbot’s debt to The Hitchhiker’s Guide to the Galaxy, the cult sci-fi comedy by British author Douglas Adams, in a blog post on Saturday.

 

The blog post said Grok-1 had surpassed GPT-3.5, the model used in the freely available version of ChatGPT, on some benchmarks, such as solving middle-school math problems. However, xAI said it lagged behind the most powerful ChatGPT model, GPT-4.

 

“It is only surpassed by models that were trained with a significantly larger amount of training data and computer resources, like GPT-4.”

 

The xAI team said Grok was being made available to a limited number of users in the US as a prototype, adding that “new capabilities and features” would be rolled out in the coming months. According to the Grok website, initial access to the chatbot is being offered to X subscribers under an “early access programme.".

 

Musk co-founded OpenAI, the company behind ChatGPT, but stepped away from the company in 2018, saying he “didn’t agree with some of what the OpenAI team wanted to do”, as well as citing commitments at his other companies. Musk has expressed fears about the pace of development at companies like OpenAI, and in March he supported a call for a six-month pause in developing powerful systems.

 

However, in July, Musk said a pause no longer seemed realistic and announced the formation of xAI, which he said would build AI systems “in a good way”.