Artificial intelligenceBrain power

Study reveals ChatGPT performs better on writing than students

Originally posted on The Horizons Tracker.

The rise of ChatGPT and other generative technologies has prompted a wave of hand-wringing about the potential impacts across society. Nowhere is this more so than in education, where concerns have been raised that such technologies will fundamentally undermine the education system.

These fears were hardly confounded by a study1 from New York University, which found that ChatGPT can do as well as or even better than the average university student when answering questions in subjects like computer science, political studies, engineering, and psychology.

Writing test

To test this, the researchers asked teachers from New York University Abu Dhabi to give them three answers from students for ten different questions. Then they asked ChatGPT to come up with three sets of answers to the same questions. People who didn’t know where the answers came from looked at them and gave grades. ChatGPT got similar or higher grades compared to students in nine out of 32 courses.

ChatGPT did best in a class about public policy, where it got a much higher grade than the students. The researchers also asked people from different countries what they thought about using ChatGPT for homework. About 74% of students said they would use it. But teachers were more critical: 70% of them said using ChatGPT would be like copying someone else’s work.

There were also some computer programs that were supposed to tell if a human or a machine wrote the answers. They made mistakes: sometimes they thought ChatGPT’s answers were from a person. All of these discoveries could help make rules about using AI tools like ChatGPT in school.

Article source: Study Reveals ChatGPT Performs Better On Writing Than Students.

Header image source: Om siva Prakash on Unsplash.

Reference:

  1. Ibrahim, H., Liu, F., Asim, R., Battu, B., Benabderrahmane, S., Alhafni, B., … & Zaki, Y. (2023). Perception, performance, and detectability of conversational artificial intelligence across 32 university courses. Scientific Reports, 13(1), 12187.
Rate this post

Adi Gaskell

I'm an old school liberal with a love of self organizing systems. I hold a masters degree in IT, specializing in artificial intelligence and enjoy exploring the edge of organizational behavior. I specialize in finding the many great things that are happening in the world, and helping organizations apply these changes to their own environments. I also blog for some of the biggest sites in the industry, including Forbes, Social Business News, Social Media Today and Work.com, whilst also covering the latest trends in the social business world on my own website. I have also delivered talks on the subject for the likes of the NUJ, the Guardian, Stevenage Bioscience and CMI, whilst also appearing on shows such as BBC Radio 5 Live and Calgary Today.

Related Articles

Back to top button