AI Detectors: The False Accusations Plaguing Classrooms

TL;DR:

• AI detectors falsely accuse students of cheating, with error rates of 1-2%.
• Neurodivergent and ESL students are more likely to be flagged.
• The arms race between AI detectors and bypass tools is damaging trust in classrooms.

Artificial Intelligence (AI) has swiftly become a part of our daily lives, and classrooms are no exception. However, the rise of AI detectors in schools is causing unprecedented challenges for students, especially those from diverse backgrounds. With about two-thirds of teachers regularly using AI content detection tools, even tiny error rates can have significant consequences.

The Human Cost of AI Detection

Moira Olmsted, a 24-year-old student at Central Methodist University, was falsely accused of using AI to write her assignments. Despite her autism spectrum disorder, which influences her writing style, she was initially given a zero and a strict warning. Olmsted’s story is not unique; many students face similar issues due to AI detectors’ false positives.

Ken Sahib, a multilingual student at Berkeley College, also faced accusations of AI-generated work. These incidents highlight the emotional and academic toll false accusations can take on students.

The Accuracy of AI Detectors

AI detection tools like GPTZero and Copyleaks were tested on 500 college application essays submitted to Texas A&M University before ChatGPT’s release. The results showed that these services falsely flagged 1-2% of the essays as likely written by AI. While this might seem like a small error rate, it can quickly add up, given the vast number of student assignments each year.

Who is Most Affected?

Students who write in a more generic manner, such as those who are neurodivergent, speak English as a second language (ESL), or use straightforward vocabulary and a mechanical style, are more likely to be falsely flagged. A 2023 study by Stanford University researchers found that AI detectors were “near-perfect” with essays written by US-born eighth-grade students but flagged more than half of the essays written by nonnative English students as AI-generated.

The Arms Race of AI Detection

AI detection services can sometimes be tricked by automated tools designed to pass off AI writing as human. This has led to an arms race between AI detectors and bypass tools, damaging trust between educators and students. Students now spend significant time and effort defending the integrity of their work, which diminishes the learning experience.

The Impact on Education

The fear of being flagged by AI detectors has forced students to rethink using popular online writing assistance tools like Grammarly. Some students have even uninstalled these tools to avoid false accusations. This fear has also led to the rise of “AI humanizer” services that rewrite submissions to bypass AI detectors.

The Future of AI in Education

While some educators have backed away from AI detectors and tried to adjust their curricula to incorporate AI, many colleges and high schools still use these tools. AI detection startups have attracted about $28 million in funding since 2019, with most of those deals coming after ChatGPT’s release.

Adapting to AI in the Classroom

Adam Lloyd, an English professor at the University of Maryland, believes that AI is here to stay and that viewing it as something to keep out of the classroom is misguided. Instead of relying on AI detectors, Lloyd prefers to use his intuition and have open discussions with students if he has suspicions.

Comment and Share:

What are your thoughts on the use of AI detectors in classrooms? Have you or someone you know been falsely accused of using AI to write assignments? Share your experiences and thoughts on the future of AI in education. Don’t forget to subscribe for updates on AI and AGI developments.

• You may also like:
• Revolutionising Education: 5 Powerful AI Prompts for Teachers in Asia
• The Secret Weapon Against AI Plagiarism: Watermarking
• The AI Revolution: How Asia’s Top Schools Are Embracing ChatGPT
• To learn more about AI detectors in education, tap here.