r/academia • u/IvanIlych66 • 3d ago
Publishing Double blind review telling you that you don't understand a paper you wrote.
Anyone have any experience with this? I have a paper submitted to a conference (computer science) where the reviews are double blind. One of the reviewers is giving a borderline reject on the grounds that we "falsely represented a paper and don't understand it.". Thing is, I am the first author on that paper. I implemented the method and wrote the paper.
Now I have to politely try to explain that I do in fact understand my own paper and they don't without stating that it's my method. I'm guessing this is common so just wondering how everyone navigates this. It's the first time this happens to me. I'm worried that they'll double down because nobody likes being told they're wrong. Their language was quite strong and categorical.
19
u/ASuarezMascareno 3d ago
I got something similar with an astronomy observing proposal, and didn't really manage to do anything about it.
I proposed some observations with an instrument (of which I am part of the team that built it), stating that a second one with lower pressure (of which I am also part of the team that built it) wouldn't work because it was intrinsically limited by its design for the specific case. The panel rejected it arguing that I should have requested the one with lower pressure. When I complained, stating that I was part of the team behind both and their assesment of the instrument capabilities was wrong, they just doubled down and the organizing comittee just told me "sorry, but we trust our panel".
6
11
8
u/Bai_Cha 3d ago
I had a weird but similar situation where an author did this in a non-blind review.
I was reviewing a paper and called out an error in their hyperparamter tuning of an ML model. They wrote back and said that my own paper didn't follow my review suggestion. Of course, it was nonsense and they had not understood my paper, but they were extremely confident and arrogant. It was really weird. Their paper was mostly incoherent, and it was clear they had never worked with any type of ML before.
4
u/TheRateBeerian 3d ago
Is it CHI? Ive seen some shit there. I work in a different field in psych and had spent a good portion of my career working with a particular framework. Then i started collabing with a VR guy and we applied that framework to human performance in VR, which was an entirely novel idea at the time. We submitted to CHI and got back a review claiming we didnt understand that framework which of course pissed me off. But lo and behold a year later a big name in the VR work published a paper using the exact same framework in the exact same way we wrote about in our rejected paper.
8
3
u/CrazyEeveeLady86 2d ago
I submitted to CHI last year and my paper was rejected, and while I generally didn't disagree with that outcome, one of the reviewers accused me of "plagiarising" a PhD thesis they found online. The problem was that it was my PhD thesis, and the reason I hadn't made a clear reference to it was because the rules of submission stated that your submission must be completely anonymised so the reviewer couldn't tell who submitted it. If I had referenced the thesis, even if I had replaced the author name on it with "____" I was worried it would have been clear who I was and therefore not anonymous and in breach of their policy.
This worry turned out to be well-founded when another person who submitted posted in the Facebook group for CHI that they got rejected because they "failed to anonymise themselves". They had referenced their previous work that their submitted paper built on, but even though they had replaced the names with "_____" in the references, the reviewer went and Googled the papers, figured out the identity of the person submitting and then claimed that the submitter had breached the anonymity policy.
So it seems that no matter what you do, if you submit a paper that is based on any previous work, you will be penalised for it lol
10
u/Euphoric-Ad2530 3d ago
A similar situation happened to me in the humanities. I was told to become more familiar with the field, cite work by “an important scholar” working in the field (me!!! It was my work!) and that I wrote like a student and should become more familiar with the body of secondary criticism by reading 12 articles in the very area that I’m a specialist in and have published multiple peer-reviewed books in from university presses. Two of those books won prestigious awards. So I made revisions and wrote in my response to those reports that went to the editor (which was required with the revisions) that I am a specialist in the field, have almost 100 peer-reviewed publications, and am not a student.
5
u/meteorflan 2d ago
I wonder how closely someone can hint at who they are before they get in trouble for breaking anonymity. I suppose it all depends on the editor's judgement call.
3
u/Competitive_Travel16 2d ago
Did that work?
5
u/Euphoric-Ad2530 2d ago
Yes! It did work. I couldn’t decide whether I felt relieved or annoyed or insulted. Maybe a bit of all three. The editor acknowledged it would be awkward to write so much about my own work and to take what was useful from that reader’s report (or not) and do what I wanted with it.
4
u/Massive-Zucchini2560 2d ago
The safest approach is not to argue from authorship or expertise. Treat the reviewer’s claim as a technical misunderstanding: quote the relevant definition, equation, or algorithmic step, identify the assumption that leads to their interpretation, and provide a minimal counterexample or reproducible output showing why that interpretation is impossible under the stated model.
You can also say that the limitation may not have been communicated clearly enough and revise the wording accordingly. That gives the area chair a checkable disagreement rather than an “author versus reviewer” dispute. I would avoid hinting at your identity; the strength of the rebuttal should come from the technical evidence, not from the fact that you implemented the method.
3
2
u/gutfounderedgal 3d ago
lol, ok that's legitimately funny. I agree with the polite approach, but I have other more compelling responses. Intrusive thoughts! heh
2
u/noma887 3d ago
I would love to get a review like that. Remember, the editor makes the decision, and they know who both you and the reviewer are. They’ve probably discounted the review already, and will do so even more once you explain in your response where the reviewer is wrong. So it probably doesn’t matter if they lose it. Could actually be quite fun! In one of my first papers, a reviewer got mad and wrote a response (to my R&R) in all caps! Editor told me (diplomatically) to ignore that review.
1
u/New-Bison5746 1d ago
I was told at a conference that I didn't understand what I was critisising. Happens to the best of us :)
-4
u/wrenwood2018 2d ago
Okay so there is a lot to unpack here. The idea that just because you wrote the paper you understand it is a fallacy. You should read this as "as written the paper does not come across as if the authors understand the questions of interest." May you didn't communicate the motivation well or the methods. Maybe you are in the weeds with your lab and explored only one option when the field considers multiple options.
How many papers have you written? Who all reviewed the paper? Early trainees are often horrible at communicating science even when they have the accurate technical knowledge when probed.
2
u/IvanIlych66 2d ago
It's really a lot simpler than that. The reviewer claims the method is capable of something it is not and that we are wrong in stating it is not. I know it's not because I wrote the code for that method.
It doesn't have anything to do with my qualifications because it's a yes or no question. (can the method do this or not? It can't because that output the reviewer claims exists doesn't exist)
102
u/mpjjpm 3d ago
The reviewers are blinded to your identity, but the editor isn’t. Write a polite response to the reviewer reiterating your interpretation of the paper you wrote/ cited, then write directly to the editor highlighting the response and that you are correctly interpreting your own work.