Which reviewer raises their score

Which reviewer raises their score after a rebuttal? Do reviewers who write a longer review raise their score more often? I went through 34,561 ICLR 2025 reviews to find out.
Reviewers who wrote 1,000+ words raised their score 43% of the time. Under 200 words changed 17% of the time.
A reviewer sitting 3+ points below the others raised it 51% of the time. Reviewers who started at a 5 moved most often (43%). Stated confidence made no difference.



I'd like to imagine that this is a consensus building process, without ego and focused on meritocratic values.
But is this persuasion or conformity? Can't tell these scores alone. I'm going to look into the circumstances under which reviewers change their scores next.
First posted on LinkedIn, November 12, 2026.


