Writefull GPT Detector Review

The implications of today’s AI language models are quite scary. Not only are they getting better at mimicking human language, but they can also be used for nefarious purposes.

Many are understandably concerned about the potential for “AI plagiarism” or other misuse of AI-written content. Educators, in particular, worry that students will use AI as a shortcut in completing their assignments, exams, and theses. As a response, some schools in the US have banned the use of ChatGPT and similar tools.

That does not mean AI is completely harmful to academic learning. It can still be used to aid students and teachers.

That’s why AI detection tools are a welcome addition to the AI landscape. While they are also AI-powered, they were developed to determine whether or not a text is AI-generated. Teachers and students can use such tools to ensure they uphold academic integrity.

Writefull’s GPT Detector is one of the AI detection apps that has emerged recently. The AI behind it was trained to detect outputs created by the latest language models, including ChatGPT.

Writefull is a company that specializes in academic AI writing services. They offer widgets like Abstract Generator, Paraphrase, and Title Generator. Thus, it’s fair to say their GPT Detector tool is also designed for academic purposes.

Let’s check out what the Writefull GPT Detector has to offer.

Features

• GPT-3, GPT-4, ChatGPT detector: Writefull’s detector model works on the text generated by the latest language models. All three models can create high-quality, convincing outputs in various writing styles and tones.

• Probability score: The tool produces a percentage based on its analysis of a text. Naturally, the higher the score, the higher it is likely written by a machine.

• Data encryption: Any text checked for analysis is encrypted. Writefull respects user privacy and does not store such data for any purpose.
• API access: The API for Writefull GPT Detector is readily available upon request. This is invaluable for developers or academic institutions that want to integrate the detector into their systems.

Pros

• Completely free
• 50-word minimum limit
• Data is not stored

Cons

• Daily use quota
• Low accuracy rate
• No plagiarism-checking capabilities

Testing Writefull’s Accuracy

Since Writefull’s GPT Detector is intended for students and academic institutions, it’s important to test its accuracy. For this test, we used seven Jasper AI-generated text samples. Jasper AI is a GPT-3-powered writing assistant capable of creating various forms of content, including articles, social media posts, and video scripts.

We also compared Writefull’s scores with results from another AI detection tool called Originality.ai. This is a premium detection tool that is often praised for its high accuracy rate. Showing the results side by side will give us a clear picture of how trustworthy a detector is.

Here are the test results:

As shown in the above summary, Writefull’s accuracy rate is quite low. Considering all samples are 100% AI-generated, the highest score the tool produced is only 55%. Its average detection score is 28.71% compared to Originality.ai’s 79.14%. The only instance where Writefull surpassed Originality.ai’s score is in sample #7, but the gap is small.

It’s important to note that no AI detection tool is 100% accurate. However, as we’ve seen in our previous reviews, several other free apps gave better scores. This may not be suitable for educators looking to discover how much AI was used to create a text.

Comparing Writefull to Other AI Content Detection Platforms

As mentioned earlier, a few other free tools fare better than Writefull. Given that it’s a tool for educational use, let’s see which areas Writefull can improve on:

• Accuracy: For something free, Writefull’s detector decently detects if there are AI instances in a text. However, there is plenty of room for improvement in the tool’s accuracy. Writefull can update its model to better assess the probability scores of various texts.
• Highlighted phrases: Besides giving a probability score, the GPT Detector could also pinpoint which text sections are likely generated by AI. This feature could help students revise those phrases to ensure their works are 100% human-made.

• Plagiarism check: Many students will benefit from a 2-in-1 AI tool that checks for AI-generated content plus plagiarism in texts. Plagiarism checkers work by checking the text against a large database of websites, research papers, and books.

• URL scanning: Writefull could also expand its GPT detection to include URL scanning. Educators may use this tool to scan published works online and see if they display any hints of AI generation.

Advantages of Writefull

Writefull’s biggest advantages are its accessibility and ease of use. The tool is completely free, albeit with a daily use quota. This makes it an ideal choice for students who simply want to check and maintain integrity in their work.

The tool also allows texts of as few as 50 words, meaning it can analyze at least one or two sentences. Most other platforms have a minimum text limit of 200 to 500 words.

Writefull also comes with a slew of other useful academic AI tools, like its copyediting tool and automatic citation tool. For those who prefer sticking to apps by one brand, Writefull can be a good option.

Conclusion

Writefull’s GPT Detector is an AI detection tool designed for academic use. It offers several useful features, such as its low word limit and additional AI tools. However, its accuracy rate is quite low compared to other free apps.

Ultimately, it depends on your needs and preferences. For those who only need a quick check of their texts or have limited resources, Writefull can be a good solution. On the other hand, educators looking for more reliable results may want to consider another option.

We’re still miles away from having an AI detection tool that displays 100% accuracy, so it’s always best to pair your app with other forms of assessment.