Beware of ChatGPT Auto-Detection

Using AI to Police AI Cannot Solve the Problem

OpenAI, the maker of ChatGPT, released a tool to detect auto-generated text. Fundamentally, they made a tool that identifies when their other tool, and similar tools, are being used. For anyone who is excited to hear this: its success rate is around 26%, so let us not celebrate just yet.

It is important to know that AI detection systems, and this is an exploding industry right now with new products and companies popping up almost daily, have their limitations and often will not be correct. They can give both false positives and false negatives as AI's ability to mimic human writing styles makes it tough to tell if text is real or fake.

Human + AI Is the Answer

Instead of putting too much faith in AI detection systems, the best approach is to combine AI with human engagement. Yes, you can use AI detection systems as a tool, but it requires human insight to determine whether the detection is accurate. You CANNOT effectively outsource your ChatGPT "cheating" concerns to another AI tool. Please do not be fooled by those who profess that this will work.

Follow the Calculator Precedent

For educators, consider following the same educational path that has been established for using calculators. Just as calculators were introduced as a tool to support student learning, at the appropriate place in the learning journey, ChatGPT and other generative AI tools should also be seen as tools to support the learning process. Perhaps you could immediately mimic the already established processes used for calculators and the internet.

It is an incredibly exciting time to embrace generative AI, particularly ChatGPT. There is tremendous potential to impact productivity, learning, customer experience, revenue, and more. To do so, let us be prudent and think of building a working partnership with these new and powerful tools. Strike a balance between AI detection systems and human judgment.