Elon Musk’s response to ChatGPT is receiving an update to enhance its capabilities in math, coding, and more. Musk’s xAI has introduced Grok-1.5 to early testers with improved reasoning abilities and the capacity to process longer contexts. The company claims that Grok-1.5 now competes with GPT-4, Gemini Pro 1.5, and Claude 3 Opus in various aspects.
According to xAI’s data, Grok-1.5 shows significant improvement compared to its predecessor, Grok-1. It achieved higher scores in benchmarks such as MATH, GSM8K (math word problems), and HumanEval (coding) when compared to previous versions. Grok-1.5 is closer in performance to Gemini Pro 1.5, GPT-4, and Claude 3 Opus, with its HumanEval coding score surpassing all competitors except Claude 3 Opus.
Furthermore, Grok-1.5 can process longer contexts of up to 128K tokens within its context window, enabling it to gather information from a wider range of sources to comprehend a situation better. xAI did not provide details on Grok’s progress in other areas where it may still be lacking, such as academic scores and multimodal capabilities. However, Grok-1.5 may face competition soon as ChatGPT 5 is expected to launch later this summer, offering a feature set that aims to provide a more human-like communication experience, according to OpenAI.
Presently, Grok is exclusively available to Premium+ tier users on X (formerly Twitter), although Elon Musk has indicated plans to make it accessible to regular Premium users. The company has also recently made its Grok chatbot open source after Musk filed a lawsuit against OpenAI and Sam Altman for allegedly deviating from its non-profit mission.
Source link
