How to Tell If A Student is Using AI on Their Assignments

Aaron Wesley Hannah
August 12, 2023

As artificial intelligence (AI) tools become more advanced and widely available, teachers and professors may start to wonder if their students are using them to get an unfair advantage. AI tools like ChatGPT can generate entire essays, solve math problems, and more with just a text prompt. While these tools can be useful for research and idea generation, students should not rely on them to complete major assignments. Here are some tips for identifying if a student’s work was AI-generated.

Look at the Writing Style

One giveaway of AI-written text is the writing style. AI tools aim to produce natural sounding human writing, but there are often telltale signs that the text was not written by a person. Here are some things to look for:

  • Lack of personal voice or perspective – AI-written text often sounds generic and lacks an author’s unique viewpoint or experiences. It may fail to communicate a real person’s personality.
  • Repetition of ideas or phrases – The AI may unintentionally repeat the same concepts or phrases multiple times throughout the writing. This redundancy is a sign of synthetic text.
  • Abrupt topic shifts – Without a coherent train of thought, the writing may sporadically jump between topics without transition.
  • Overuse of filler words – You may notice an excessive use of filler words and phrases like “therefore”, “basically”, “as a matter of fact”, etc.
  • Lack of original thought – Arguments, analysis, and conclusions made throughout the piece may lack the insightful thinking you’d expect from the student. The ideas tend to be derivative rather than novel.

Ask About Their Writing Process

Have a conversation with the student about the process they went through to write the paper or complete the assignment. Someone who used an AI writer will struggle to explain their research, thinking, planning, and drafting process. Push them to get specific – what sources did they use, how did they organize their thoughts, what was the most difficult part, etc. Authentic firsthand experiences should emerge if they genuinely completed the work themselves.

Evaluate the Content Depth

AI tools are great at synthesizing, summarizing, and paraphrasing information, but they struggle to produce knowledge or analysis that goes very deep. Review the content with an eye for thoughtful examination of sources, new connections or patterns identified, and how concepts are applied to a novel situation. AI-generated text tends to stay on a superficial level.

Watch For Plagiarism

Given their training datasets, AI tools may steal long phrases or sentences from sources without proper attribution. Run passages that sound uncharacteristic of the student through a plagiarism checker. Also be on the lookout for anachronisms, like references to events that happened after the paper was submitted. Plagiarized content and temporal inconsistencies imply AI generation.

Compare to Previous Work

Does the assignment quality match or exceed the student’s previous work in your class? Does the tone and style sound like their voice? Place the submission alongside a prior assignment and look at parallels or discrepancies in areas like critical thinking, writing fluency, originality, and accuracy. Sudden unexplained improvements could mean AI augmentation.

See If They Can Explain Concepts Orally

You can gain additional insight into a student’s grasp of the material by having them summarize or elaborate on their written submission verbally. For example, ask them to explain a key concept, walk through a solution to a problem, or discuss their main arguments. Listen for fluency of thought and subject matter expertise. If they are unable to speak competently about the work they submitted, it raises suspicions.

Require Updates Based on New Information

As a test, provide the student with new information related to their submission – an additional source, data, a critique, etc – and ask them to integrate it to improve and expand their work. Their ability or inability to refine their thinking and writing based on new inputs will be very revealing of whether they truly understand and authored the original piece.

Gauge How Unique Their Work Is

Use plagiarism detection software not just to check for copying, but also to evaluate degrees of shared content across assignments within a class and year-over-year. AI-generated student work is likely to share high similarities with peers also using AI or with freely available AI output online. Look for red flags if multiple students submit unusually similar works.

Foster an Environment of Academic Integrity

Make your expectations clear about ethical writing practices and only using AI tools appropriately. Remind students that even if an AI assistant creates their work, the ideas they present and submit must be their own. Emphasize building real skills over grades; use assessments that demonstrate applied knowledge. Promoting genuine learning helps prevent AI over-reliance. Stay engaged with students so you can better discern when writing may not represent their actual abilities.

Additional Ways to Detect AI Use

Here are some more techniques teachers can use to determine if a student’s assignment was AI-generated:

  • Ask probing questions – During a discussion of the work, ask probing questions that require the student to go beyond what is written and demonstrate a deeper understanding of the material. See if they can support key points with additional details or examples not already covered.
  • Evaluate the structure – Does the writing follow a logical structure and flow or does it jump between points scattershot? Proper transitions and organization signal more authentic writing.
  • Check references cited – Do all sources listed seem properly credited and relevant to the topic, or are some out of place? Bogus or randomly generated references are a giveaway.
  • Compare to class discussions – If the assignment contains ideas or content that the student never expressed in class, it raises doubts. Real reflection builds on previous exchanges.
  • Have them summarize verbally – Ask them to briefly summarize the main points verbally with no notes. Their command of the topic should be evident.
  • Assign a meta-cognitive reflection – Require the student to submit a short reflection explaining their thinking process, what they learned, challenges faced, and goals moving forward. The depth and specificity of their insights will be telling.
  • Change requirements and observe adaptability – Modify assignment parameters, like length, topics covered, or format, and see if the student can reinvent their approach. Mimicking human flexibility is difficult for AI.
  • Review acknowledges sources – Does the student appropriately credit any AI tools used narrowly just for research, not final content generation? Ethical use requires transparency.

Role of the Educator

As AI capabilities evolve, instructors play a crucial role in maintaining academic integrity and guiding students to think independently. Here are some principles for educators to keep in mind:

  • Set clear policies on AI use – Develop guidelines specifying appropriate vs. inappropriate uses of AI for your assignments and classes. Explain what constitutes plagiarism or cheating.
  • Design assessments focused on applied skills – Structure projects and test questions so students must demonstrate proficiency beyond facts and comprehension. Evaluate critical thinking.
  • Cultivate curiosity and growth mindsets – Instill a love of learning for its own sake. When students are intellectually curious, they become active learners rather than seeking quick answers.
  • Encourage conceptual understanding – Have students explain concepts in their own words, make connections to other ideas, and apply their knowledge creatively in novel contexts.
  • Be alert to sudden changes – Notice major shifts in writing style, quality, vocabulary use, reasoning ability and ask probing questions to understand why.
  • Address use of AI proactively – Discuss AI openly with students. Explain policies, monitor work, and make AI assistance available if needed, so students don’t use it secretly.
  • Focus on metacognition – Require students to reflect on their thinking processes. This builds self-awareness and accountability for their understanding.
  • Have empathy for student struggles – Avoid punitive reactions to AI use. Understand how students may be tempted to rely on AI due to skills gaps, test anxiety, pressure to achieve, etc.
  • Be a coach and guide – Support students’ growth by giving actionable feedback, inspiring curiosity, and cultivating their intrinsic motivation to learn.

Conclusion

The responsible use of artificial intelligence in education will continue to be an important issue. By staying vigilant for the signs of inappropriate AI use and emphasizing learning over grades, teachers can both maintain academic standards and help students develop real competencies. With care and attention, educators and students can learn to meaningfully complement each other’s strengths.

Aaron Wesley Hannah

Aaron Wesley Hannah

Freelance writer, solopreneur & coach. OSU grad. Writes on wellness, leadership & lifelong learning to spark conversations & help people live thoughtful lives.

0 Comments

Submit a Comment

Pin It on Pinterest