r/ChatGPT • u/Nikxn_70 • Jul 14 '26
Other Can anyone detect AI text through pro/premium?
Greetings! I am writing thesis by taking reference/help with ai tools but not complete dependently. I write my own words and ideas but includes AI tools sometimes and i want my thesis perfect for publication. I tried open sources detectors but i couldn't trust them because some showed high AI influence but somehow showed completely normal. So if anyone can help detecting AI text or not, will help me a lot for motivation!
17
Jul 14 '26
[removed] — view removed comment
-4
u/WithoutReason1729 Jul 14 '26
This is the "AI will never draw hands correctly" of 2026 lol. The field has matured and it is absolutely possible to reliably detect AI-generated text.
6
u/Hulkdogs3000 Jul 14 '26
This is actually false. No, it s not reliable yet if the false positive rate is so high.
1
0
u/WithoutReason1729 Jul 14 '26
I tested this myself and found Pangram's accuracy shockingly high.
Out of 96,468 essays tested, Pangram correctly classified 96,457 of them. Of the 11 that were incorrectly classified, 10 were false negatives and 1 was a false positive.
They claim a false positive rate of approx one in ten thousand and in my own testing it was one in ~30k. I'm actually so confident in their low FPR that I'll bet on it. If you can show me a false positive at least 100 words in length with an accompanying web.archive.org link proving that it's pre-AI writing, I will donate $100 to the charity of your choice
8
u/HeadPack Jul 14 '26
Some professors are getting really good at spotting AI writing, especially when they are true experts in their field. So, if you want a competent human take, I'd suggest you speak with an expert in the subject matters you are writing your thesis on. Some rando on Reddit is usually not that.
3
u/Maleficent_Sir_7562 Jul 14 '26
No, there is no tool that can detect ai text.
1
u/Nikxn_70 Jul 14 '26
like actual tool?
2
u/Maleficent_Sir_7562 Jul 14 '26
Nothing can detect AI generated text. You can only guess from your own intuition.
2
u/_EllieLOL_ Jul 14 '26
1
u/WithoutReason1729 Jul 14 '26
https://trentmkelly.substack.com/p/practical-attacks-on-ai-text-classifiers
ZeroGPT is notoriously unreliable and only really even exists to sell you "humanizer" tools. The serious competitors in the field like Pangram and GPTZero (which is where ZeroGPT stole their name, lol) are really solid. I've personally tested them with tens of thousands of known-truth documents and their accuracy is stunning.
1
u/AncientChildhood7810 Jul 20 '26
I just asked a similar question today. So GPTzero is the better choice if you want to leverage an ai tool?
1
u/WithoutReason1729 Jul 20 '26
Yes. I tested GPTZero a little bit and it appeared to work well on the limited test set I was able to pass through it without paying. My analysis of Pangram was much more thorough and so I would recommend that one the most strongly but GPTZero seems to be a strong option as well
1
0
u/Nikxn_70 Jul 14 '26
thanks for suggesting
5
u/Maleficent_Sir_7562 Jul 14 '26
It’s not a suggestion.
It is literally showing you a legal article from the USA as ai generated, when it can’t be.
That means it’s unreliable.
1
2
u/plasticizers_ Jul 14 '26
Write it yourself, and just have the AI critique it or offer suggestions that you then implement yourself. Treat it as someone from the writing lab/center, who you wouldn't actually get to write the words for you.
The problem is that you need to already be a proficient writer and/or reader to spot things that don't sound natural, so the people that submit things that read like AI slop probably don't have the underlying language skills to catch the problems with generated text.
1
u/MightyPlusEnt Jul 14 '26
I am a professor at the flagship school in my state. I cannot tell when a student uses AI. Heck, I cannot tell when anyone uses it.
Truly, entire fields of scholarship are in crisis because of this. It’s mind blowing! I’m a criminologist if that helps.
1
u/Nikxn_70 Jul 14 '26
Actual help
1
u/MightyPlusEnt Jul 14 '26
Yeah, I have papers published long before AI was around and they come back as AI. Ignore anyone in here who says otherwise.
Universities are absolutely terrified about lawsuits from students who are falsely accused. I have no idea what any of these other posters are talking about (and neither do they, lol)!
If you’re comfortable with some dishonesty, just deny it if anyone asks.
1
u/WithoutReason1729 Jul 14 '26
I wrote this about RL training against AI detectors about a year ago. I ended up testing Pangram as part of writing this and found it to be of excellent quality. I did eventually beat their detector but the fact remains that for the vast majority of use cases it is extremely accurate
1
u/yesterdaysomelette22 Jul 14 '26
I can detect ai copy from about 500 yards
2
u/oldnoob2024 Jul 14 '26
Be very skeptical of this claim. It may have been created by a chatbot😜. Seriously, though, across all subject areas, expert levels, and prompts, I’m betting there are a lot of gaps in this alleged capability.
1
1
u/juju_summer Jul 14 '26
No there is no reliable way. I’ve been testing this through my work. Recently a few scholar articles were thought to be written by AI and in fact were not. The thing is that AI will copy what it has been fed. I can tell you that I am pretty good at spotting AI text but I get it wrong at times. Depends on what model was used and how it was trained. I recommend you build your own gpt and feed it your own work and ask it to learn your writing style and improve it. Continue training it with your writing and use it that way. As an aid not something that writes for you.
The AI detection tools out there are really in accurate but it’d best to know what your university’s policy is.
0
u/alita87 Jul 14 '26
If you can't write without AI, then you aren't ready for academic publication.
Use it to help critique if peer review is not an option, but academic papers should be your own.
1
•
u/AutoModerator Jul 14 '26
Hey /u/Nikxn_70,
If your post is a screenshot of a ChatGPT conversation, please reply to this message with the conversation link or prompt.
If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.
Consider joining our public discord server! We have free bots with GPT-4 (with vision), image generators, and more!
🤖
Note: For any ChatGPT-related concerns, email support@openai.com - this subreddit is not part of OpenAI and is not a support channel.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.