A chatbot powered by masses of data from the internet has passed exams at a US law school after writing essays on topics ranging from constitutional law to taxation and torts.
ChatGPT from OpenAI, an American company that received a huge cash injection from Microsoft this week, uses artificial intelligence (AI) to generate text streams based on simple prompts.
The results are so good that educators have warned it could lead to widespread cheating and even spell the end of traditional classroom teaching methods.
Jonathan Choi, a professor at Minnesota University Law School, gave ChatGPT the same test students face, consisting of 95 multiple choice questions and 12 essay questions.
In a white paper titled “ChatGPT goes to law school,” published Monday, he and his co-authors reported that the bot scored a C+ overall.
While this was enough to pass, the bot was at the bottom of the class in most subjects and “bombed” in multiple choice math questions.
– ‘Not a great student’ –
“In essay writing, ChatGPT showed a strong understanding of the basic laws and had consistently solid organization and composition,” the authors wrote.
But the bot “often had trouble detecting problems when presented with an open-ended prompt, a core skill on law school exams.”
Officials in New York and other jurisdictions have banned the use of ChatGPT in schools, but Choi suggested it could be a valuable teaching aid.
“Overall, ChatGPT was not a great law student acting alone,” he wrote on Twitter.
“But we expect that working with people, language models like ChatGPT would be very helpful for law students taking exams and lawyers in practice.”
And he downplayed the possibility of cheating, writing in response to another Twitter user that two of the three markers had seen the paper written by the bot.
“(They) had a hunch and their hunch was correct, because ChatGPT had perfect grammar and was somewhat repetitive,” Choi wrote.
(Except for the headline, this story has not been edited by DailyExpertNews staff and is being published from a syndicated feed.)
Featured video of the day
Shah Rukh Khan fans in Kolkata celebrate the release of Pathaan