Home News Gemini Ultra Surpasses OpenAI’s GPT-4 in Intelligence Benchmark

Gemini Ultra Surpasses OpenAI’s GPT-4 in Intelligence Benchmark


In a groundbreaking development in the field of artificial intelligence, Google has unveiled Gemini, a new AI model positioned as a formidable competitor to OpenAI’s GPT-4. This latest innovation from Google, particularly its most advanced version, Gemini Ultra, is garnering attention for its superior performance in several domains, outshining GPT-4 in areas such as subject knowledge, Python code generation, and multi-step reasoning tasks.


Google’s Gemini Ultra Sets a New Standard, Outperforming OpenAI’s GPT-4 and Human Experts in Multitask Language Understanding

Significantly, Gemini Ultra has achieved a milestone by matching human-level experts in a comprehensive test spanning 57 subject areas. In the Massive Multitask Language Understanding (MMLU) test, Gemini Ultra scored an impressive 90%, surpassing GPT-4’s 86.4% and even edging out the score of human experts, which stands at 89.8%. This achievement marks the first instance of an AI model outperforming humans in this benchmark test, highlighting the advanced capabilities of Gemini Ultra.

Read Also

Designed to be natively multimodal, Gemini Ultra can process a variety of data types, including text, audio, code, images, and video. This versatility gives it an edge over other models in handling complex and diverse tasks. However, it’s important to note that in the realm of common-sense reasoning for everyday tasks, GPT-4 still holds an advantage over Gemini Ultra.


Google has also released less advanced versions of the Gemini model, such as Gemini Pro, which is accessible through Google’s chatbot Bard. Early reactions to Gemini Pro have been positive, although there have been some concerns regarding its accuracy and tendency for hallucinations.

As the AI landscape continues to evolve, the emergence of models like Gemini Ultra signifies a significant leap forward, not only in terms of technological capabilities but also in the potential applications and implications of AI in various fields. While the full potential of Gemini Ultra and its impact on the AI ecosystem remain to be fully realized, its current achievements set a new benchmark in the ongoing advancement of artificial intelligence technologies​

About The Author

Related Articles


Binance Executive Gambaryan Appears In Court In Wheelchair

Binance Holdings Limited executive Tigran Gambaryan was brought to the Federal High...


EXCLUSIVE: Dubious Website Positioned To Scam Nigerians Through UAE Visa Application

On Monday, the Ministry of Information, and National Orientation, Mohammed Idris announced...


Hundreds More Kenyan Police Deployed To Haiti Amidst Protests At Home

Another 200 Kenyan police officers have been deployed to the violence-ravaged Haiti...

Nigeria's Federal Govt To Receive Airbus A330 Presidential Jet Due For Delivery

Nigeria’s Federal Govt To Receive Airbus A330 Presidential Jet, Report Shows

The Nigerian government is set to receive a reconfigured VP-CAC Midroc Aviation...