Share

ChatGPT-4 capable of passing bar exam, firm says

accreditation
0:00
play article
Subscribers can listen to this article
ChatGPT-4 can pass the bar exam.
ChatGPT-4 can pass the bar exam.

The long-awaited follow-up to ChatGPT has gone live, boasting of “human-level performance” in university-standard exams.

OpenAI said GPT-4, the next generation of its artificial intelligence-powered chatbot, marked a “milestone” in the development of deep learning, which imitates how humans gain knowledge.

“We’ve spent 6 months iteratively aligning GPT-4 using lessons from our adversarial testing program as well as ChatGPT, resulting in our best-ever results (though far from perfect) on factuality, steerability, and refusing to go outside of guardrails,” the San Francisco-based company said in a blog post on Tuesday.

OpenAI, which is backed by Microsoft, said the new version of its AI-powered chatbot is a “multimodal” model that can generate content from both images and text prompts.

In an online demonstration, OpenAI President Greg Brockman showed GPT-4 creating a real website based on a hand-drawn mock-up.

OpenAI said the update is able to pass the bar exam for prospective lawyers with a score in the top 10 percent of applicants, compared with the bottom 10 percent of test-takers previously.

The chatbot can also beat 90 percent of humans who take the evidence-based reading and writing section of the Scholastic Assessment Test and the verbal section of the Graduate Record Examination used for admission to postgraduate education, OpenAI said.

GPT-4 is also much less likely to produce inaccurate, offensive, insulting answers than ChatGPT, the company said.

“We spent six months making GPT-4 safer and more aligned. GPT-4 is 82 percent less likely to respond to requests for disallowed content and 40 percent more likely to produce factual responses,” OpenAI said.

OpenAI, however, said GPT-4 is still “not fully reliable” and can still produce unexpected answers known as “hallucinations” and reasoning errors.

OpenAI’s launch of ChatGPT in November took the tech world by storm, prompting existential questions about the future of sectors ranging from education to journalism and healthcare.

Tech giants including Google, Microsoft, Huawei, Alibaba, and Baidu are racing to roll out their own versions of the technology amid heated competition to dominate the burgeoning AI sector.



We live in a world where facts and fiction get blurred
Who we choose to trust can have a profound impact on our lives. Join thousands of devoted South Africans who look to News24 to bring them news they can trust every day. As we celebrate 25 years, become a News24 subscriber as we strive to keep you informed, inspired and empowered.
Join News24 today
heading
description
username
Show Comments ()
Voting Booth
Should the Proteas pick Faf du Plessis for the T20 World Cup in West Indies and the United States in June?
Please select an option Oops! Something went wrong, please try again later.
Results
Yes! Faf still has a lot to give ...
67% - 1037 votes
No! It's time to move on ...
33% - 501 votes
Vote
Rand - Dollar
18.76
+1.4%
Rand - Pound
23.43
+0.3%
Rand - Euro
20.08
+0.2%
Rand - Aus dollar
12.25
+0.3%
Rand - Yen
0.12
+0.2%
Platinum
924.10
-0.0%
Palladium
959.00
+0.1%
Gold
2,337.68
0.0%
Silver
27.19
-0.0%
Brent Crude
89.50
+0.6%
Top 40
69,358
+1.3%
All Share
75,371
+1.4%
Resource 10
62,363
+0.4%
Industrial 25
103,903
+1.3%
Financial 15
16,161
+2.2%
All JSE data delayed by at least 15 minutes Iress logo
Editorial feedback and complaints

Contact the public editor with feedback for our journalists, complaints, queries or suggestions about articles on News24.

LEARN MORE