2023 is poised to be an exciting year for AI technology. As language models continue to advance, more AI-based products emerge. One of these products recently creating a buzz is ChatGPT.
Unlike the language models preceding it, ChatGPT is specifically trained to mimic human conversations. This has led people to question whether the content they read nowadays is written by a machine or an actual human. Enter AI detection tools.
While AI detection tools are powered by AI technology, they’re designed to identify machine-generated content. As they say, it takes one to know one. Today, we’ll be exploring one such tool from Sapling.ai.
The Sapling Company creates AI assistants for business communication to help teams communicate more effectively with their clients. So, they’re well-qualified to construct their own AI detection tool too.
Sapling.ai’s AI Detector is a browser-based tool trained to catch GPT-3 and ChatGPT texts. It was developed by former researchers at Google, Stanford University, and Berkeley University of California.
The tool shows a percentage of how likely a machine-generated text. It also suggests which specific phrases were written by a machine. Let’s take a more in-depth look at its features.
Now that we’ve looked at Sapling.ai’s features, let’s check the tool’s accuracy. To do this, we tested seven text samples generated entirely by Jasper.ai, a popular AI writer, and compared Sapling.ai’s results with Originality.ai’s.
The latter is also a powerful AI detection tool that can catch content generated by GPT-3, GPT-3.5, and GPT-2. We’ve tested it against many other apps, and it has always displayed better results. Let’s see the verdict this time around.
As you can see, Sapling.ai can be quite impressive when it works. But when it fails, the results are very damaging. It was not able to detect any instances of AI in three of the samples, whereas Originality.ai caught at least 2% in one.
This means if Sapling.ai were to be used as part of an assessment for “AI plagiarism,” it may produce false positives, making it unreliable. However, with further tweaking, the tool may shine.
The only sample wherein Sapling.ai beat out Originality.ai is the third sample. If we review how the other AI content detection tools fared in our previous analyses, Originality.ai always showed superior percentages for the first three texts. This is one of the rare few times its competitor showed better results for at least one.
For now, it’s safe to conclude that Originality.ai is the winner of this experiment. Even though it is not 100% accurate in its detection, the tool has fewer instances of showing false positives.
We’ve answered the question of Sapling.ai’s accuracy. Now let’s see how the tool fares in other aspects, like features and usability.
The biggest advantage Sapling.ai has over other AI detection tools is that it is completely free to use. Its text limit may be low compared to other tools, but it’s a great way to get started and explore the tool’s features.
The AI detection tool is also quite fast in its analysis and can detect texts generated by GPT-3 and ChatGPT very quickly. And if you decide to upgrade your subscription, you will have access to lots of related features like an AI writing assistant, grammar checker, etc. which makes the experience even better.
Sapling.ai’s AI Detector is a good beginner tool for anyone who wants to detect machine-generated content. It is fast, mostly accurate, and provides a great way to explore the tool’s features without paying for anything.
Of course, it’s always best to pair the tool with other assessment methods. Since Sapling.ai can bring false positives, you shouldn’t rely on it as the sole source for detecting machine-generated content. But overall, it’s a great tool if you want to get started with AI detection or just want to explore your options.