Home News Gemini Ultra Surpasses OpenAI’s GPT-4 in Intelligence Benchmark

Gemini Ultra Surpasses OpenAI’s GPT-4 in Intelligence Benchmark


In a groundbreaking development in the field of artificial intelligence, Google has unveiled Gemini, a new AI model positioned as a formidable competitor to OpenAI’s GPT-4. This latest innovation from Google, particularly its most advanced version, Gemini Ultra, is garnering attention for its superior performance in several domains, outshining GPT-4 in areas such as subject knowledge, Python code generation, and multi-step reasoning tasks.


Google’s Gemini Ultra Sets a New Standard, Outperforming OpenAI’s GPT-4 and Human Experts in Multitask Language Understanding

Significantly, Gemini Ultra has achieved a milestone by matching human-level experts in a comprehensive test spanning 57 subject areas. In the Massive Multitask Language Understanding (MMLU) test, Gemini Ultra scored an impressive 90%, surpassing GPT-4’s 86.4% and even edging out the score of human experts, which stands at 89.8%. This achievement marks the first instance of an AI model outperforming humans in this benchmark test, highlighting the advanced capabilities of Gemini Ultra.

Read Also

Designed to be natively multimodal, Gemini Ultra can process a variety of data types, including text, audio, code, images, and video. This versatility gives it an edge over other models in handling complex and diverse tasks. However, it’s important to note that in the realm of common-sense reasoning for everyday tasks, GPT-4 still holds an advantage over Gemini Ultra.


Google has also released less advanced versions of the Gemini model, such as Gemini Pro, which is accessible through Google’s chatbot Bard. Early reactions to Gemini Pro have been positive, although there have been some concerns regarding its accuracy and tendency for hallucinations.

As the AI landscape continues to evolve, the emergence of models like Gemini Ultra signifies a significant leap forward, not only in terms of technological capabilities but also in the potential applications and implications of AI in various fields. While the full potential of Gemini Ultra and its impact on the AI ecosystem remain to be fully realized, its current achievements set a new benchmark in the ongoing advancement of artificial intelligence technologies​

About The Author

Related Articles

Google Israel

Google Sacks 28 Staff Protesting Over Contract with Israel

Google has sacked 28 employees for participating in demonstrations against a partnership...

Iran Israel US

U.S. and UK Impose Sanctions On Iran In Response To Drone Strikes Targeting Israel

The United States and the United Kingdom have jointly announced sweeping sanctions...

EFCC Yahaya Bello Wanted

Just In: EFCC Declares Yahaya Bello Wanted Over Alleged N80.2bn Fraud

The Economic and Financial Crimes Commission (EFCC) has declared the former governor...


Pastor Chris Oyakhilome’s Anti-Vaccine Messages Threaten Africa’s Health – BBC Finds

A famous African preacher, Pastor Chris Oyakhilome, has been spreading doubts about...