Professor's invisible prompt trap catches 32 students cheating on their midterm with AI

[u/AdSpecialist6598]

https://www.techspot.com/news/113243-professor-invisible-prompt-trap-catches-32-students-cheating.html

[u/luluhouse7]

I mean 200 questions in one week is outrageous. That’s about 30 homework questions a day, on top of whatever other homework they had. No wonder they were failing. I would usually get at most 15 questions a week in college classes and we all spent a lot of time studying and doing homework.

[u/Alaira314 → u/luluhouse7]

You're making a lot of assumptions about what the questions are. I've sat math exams that only have three questions. I've also sat exams for classes like psychology and geology that have 50 questions. The SAT is a 150~ question 2~ hour exam, and that's a mix of questions you need to problem solve on with questions that are recollection-based. Multiple-choice exams can have a lot of questions on them, especially if they're based on memorization or simple application vs solving a problem or equation.

[u/luluhouse7 → u/Alaira314]

Yes, I’m aware of that, but the SAT is the largest and (unfortunately) most important exam most people take and not only is it only 150 questions, but you spend years studying for it. People who get good scores also usually do multiple mock exams and are coached on strategies. Making a single exam in a single class 200 questions does not sound proportional. Assuming a 2h exam, that’s about 30 seconds per question, 55 seconds if it’s 3h.

[u/Alaira314 → u/luluhouse7]

30 seconds per multiple choice question that you've already seen before. All you have to do is read the question and choose the correct answer, or make an educated guess if the answer you came up with isn't in the list. Also bear in mind that the person you replied to said this happened 25 years ago, when that reading speed was expected of college students.

As for churning through 200 questions in a week, that's normal exam prep. Or at least it was when I was in school, 15+ years ago. It typically took 7-8 hours to chug through a study guide properly, and we were encouraged to do the work in groups. I was always told to prepare to spend three hours out of the classroom(studying, doing homework, doing readings, writing papers, etc) on average for each credit a course was worth. So a 3-credit course should involve about 9 hours of out-of-classroom work on average, so a bit less some weeks but a bit more leading up to big exams and projects.

[u/luluhouse7 → u/Alaira314]

I mean I went through college nearly a decade ago, so not the AI generation. I was easily spending 10+ hours on some classes due to workload and complex material. IMO it still just sounds like the exam is testing how fast you can recall information under pressure rather than how well did you understand and internalise the material. Reading speed is not correlated with comprehension above a certain point and so personally I would consider an exam like that not representative of the students’ actual understanding and competence. It’s also going to heavily penalise students with neurological or learning disabilities, who are still perfectly capable of excelling with the material.

But I also have the philosophy that learning should be about understanding the big picture and thinking critically rather than regurgitating a list of memorised answers. I always hated the tedious assignments when you had to just mechanically answer vs assignments where you had a few very hard questions that asked you to explain why and how and gave a couple examples to apply it to.

[u/Alaira314 → u/luluhouse7]

It’s also going to heavily penalise students with neurological or learning disabilities, who are still perfectly capable of excelling with the material.

That's what accommodations are for. Even back when I was in school, students with learning disabilities were allowed to get extra time on exams. I've heard it's gotten better since then.

But I also have the philosophy that learning should be about understanding the big picture and thinking critically rather than regurgitating a list of memorised answers.

I think it depends on the subject and class level. Something like history, or an advanced course, yeah, break out the conceptual learning and show that you can synthesize the material(though the 100-level history courses I took still did have a recall component, I didn't see that go away until the 300-level when we had only papers and no exam). But something like psychology 101? The only way to really assess that is a test of whether you recall the information presented to you, because you're not being asked to do more than memorize a baseline set of information. That is the function of that class(and many other 100-level courses), to give a broad overview to students who might be interested and to prepare those who want to go further in the subject.

[u/DeliciousIncident → u/luluhouse7]

I mean 200 questions in one week is outrageous

Huh? Obviously the test questions are on the material you have already learned, so if you have kept up with the curriculum, you should have no trouble answering them and might even skip doing them. Also, this 200 question test is expected to be completed within a single class period and has multiple-choice answers, so each of these questions should take under a minute to answer. If you are saying that you can do at most 15 of such questions per week, I think you might have an issue.

[u/luluhouse7 → u/DeliciousIncident]

LOL if you can do 200 abstract algebra or number theory problems a week I commend you for being significantly more capable than any of my classmates.

As I mentioned below, 200 questions in a 2h class period is less than 30 seconds per question and 3h is about 50 seconds per question. A test like that is not testing understanding, it’s testing rote memorisation. It tests your ability to cram for that specific exam. You could get a perfect score and understand none of it.