Are Robo-Pollers Cheating?


Are robo-polls as good as live-interviewer polls? Maybe! Some people have even suggested they’re better.

But wait. Gary Langer reports on an academic study of robo-polls during last year’s Republican primary that finds something strange: if the robo-polls are done after human polls have been done, they’re just as good as the human polls. But if they’re done in states where no human polls were done—that’s the red oval in the chart below—they do significantly worse.

So what’s going on? The researchers make two suggestions. First, the poor results in the red oval are based on a small number of polls in just five states, so “it’s possible that what’s going on is something goofy in those five states.” Alternatively, the folks doing the robo-polls might be massaging their results. The researchers say their analysis “suggests, but certainly does not prove, that at least some IVR polls may use earlier human polls to adjust their results to ensure that they are not notably different from existing polls and beliefs.”

The full paper is here. Stay tuned for further research.

FACT:

Mother Jones was founded as a nonprofit in 1976 because we knew corporations and the wealthy wouldn't fund the type of hard-hitting journalism we set out to do.

Today, reader support makes up about two-thirds of our budget, allows us to dig deep on stories that matter, and lets us keep our reporting free for everyone. If you value what you get from Mother Jones, please join us with a tax-deductible donation today so we can keep on doing the type of journalism 2019 demands.

We Recommend

Latest

Sign up for our newsletters

Subscribe and we'll send Mother Jones straight to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate

We have a new comment system! We are now using Coral, from Vox Media, for comments on all new articles. We'd love your feedback.