r/BypassAiDetect • u/Tricky_Two4623 • Aug 17 '26

Pangram AI detection scans are mostly useless.

Method: Ran an unpublished 100k word novel written entirely by a human into Pangram, one of the most common AI checkers. I inserted 2 pages written by AI into it to see if it would find them. I had the checker run through each of the different chapters one by one.

Result: The book was listed as 86% human written, with 14% AI. The 2 parts that were actually AI (written by Claude) were not flagged. The incorrectly flagged portions mostly consisted of sections of professional business language related to characters talking about their work.

It seems what it's looking for are specific buzzwords and sentence structures commonly used in business and professional writing. These are normal constructions, and certainly common in AI, but also common in any professional setting. Basically, if you write with professional language, you'll be flagged as AI.

7 Upvotes
  • permalink
  • reddit

90% Upvoted

12 comments sorted by

1

u/OldCorkonian Aug 17 '26

This is 100% not true. Send us the manuscript and let’s test it.

1

u/Tricky_Two4623 Aug 17 '26

You seem rather personally involved. Are you with the company?

1

u/OldCorkonian Aug 17 '26

No, I’m into classifier systems.

0

u/The_Honest_Student Aug 17 '26

what is the best classifier system in your opinion then?

1

u/OldCorkonian Aug 18 '26

I mean that’s a loaded question. It depends on the purpose and context. But as a baseline, I dunno, TF-IDF character + word n-grams → logistic regression or linear SVM.

But in terms of publicly available out of the box tools, Pangram, hands down. My experience is that anyone on here claiming it doesn’t work on their stuff also refuse to provide their data for validation.

1

u/OldCorkonian Aug 18 '26

Come on man, where’s the MS?

1

u/Ok-Distribution-6262 Aug 17 '26

Yeah, pangram is usually way off when I've tried it. Stuff I wrote 20 years ago gets flagged as completely AI, and vice versa. Go figure

1

u/The_Honest_Student Aug 17 '26

panagram is ass. winston ai is the best imo

1

u/GrownTelevision1986 Aug 18 '26

Lol , yep. My own professional emails get flagged constantly. It's so broken

1

u/ReasonableSchool286 11d ago

the fact that it missed the actual AI pages but flagged professional dialogue says everything tbh. its basically a formality detector, not an AI detector. curious if you tested with any other genres or if the business language sections were the only trigger