Are Robo-Pollers Cheating?


Are robo-polls as good as live-interviewer polls? Maybe! Some people have even suggested they’re better.

But wait. Gary Langer reports on an academic study of robo-polls during last year’s Republican primary that finds something strange: if the robo-polls are done after human polls have been done, they’re just as good as the human polls. But if they’re done in states where no human polls were done—that’s the red oval in the chart below—they do significantly worse.

So what’s going on? The researchers make two suggestions. First, the poor results in the red oval are based on a small number of polls in just five states, so “it’s possible that what’s going on is something goofy in those five states.” Alternatively, the folks doing the robo-polls might be massaging their results. The researchers say their analysis “suggests, but certainly does not prove, that at least some IVR polls may use earlier human polls to adjust their results to ensure that they are not notably different from existing polls and beliefs.”

The full paper is here. Stay tuned for further research.

$500,000 MATCHING GIFT

In 2014, before Donald Trump announced his run for president, we knew we had to do something different to address the fundamental challenge facing journalism: how hard-hitting reporting that can hold the powerful accountable can survive as the bottom falls out of the news business.

Being a nonprofit, we started planning The Moment for Mother Jones: A special campaign to raise $25 million for key investments to make Mother Jones the strongest watchdog it can be. Five years later, readers have stepped up and contributed an astonishing $23 million in gifts and future pledges. This is an incredible statement from the Mother Jones community in the face of the huge threats—both economic and political—against the free press.

Read more about The Moment and see what we've been able to accomplish thanks to readers' incredible generosity so far, and please join them today. Your gift will be matched dollar for dollar, up to $500,000 total, during this critical moment for journalism.

We Recommend

Latest

Sign up for our newsletters

Subscribe and we'll send Mother Jones straight to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate

We have a new comment system! We are now using Coral, from Vox Media, for comments on all new articles. We'd love your feedback.