USNWR’s Peer Survey Problems

Image courtesy of U.S. News and World Report


This should come as no surprise to anyone who followed the recent kerfuffle over Clemson University’s admission that it spun its numbers to improve its U.S. News & World Report’s ranking: On USNWR’s peer assessment survey, which accounts for a quarter of a school’s overall ranking, college administrators gave their own schools rave reviews while playing down competitor institutions.

Inside Higher Ed obtained copies of peer assessment surveys from 18 colleges and universities. “Haphazard responses” from “apathetic respondents” abounded. 

Some telling findings:

  • The presidents and/or provosts of 15 of the 18 universities rated their institutions “distinguished,” from Berkeley (no. 21 on last year’s list) to the University of Missouri at Columbia (No. 96).
  • At Berkeley in 2008, the chancellor rated other “top” publics — including the University of Virginia, the University of Michigan at Ann Arbor and the University of North Carolina at Chapel Hill – “strong.” However, he rated all of the University of California campuses “distinguished,” with the exceptions of Santa Cruz and Riverside, which were also “strong.” (Merced was not on the list.)
  • In a 2009 survey, an official at the University of California at San Diego (No. 35) rated that campus “distinguished,” above the University of Pennsylvania, Duke University, Dartmouth College, Northwestern University and Johns Hopkins University (all “strong”).
  • The president of the University of Florida (No. 49) rated his campus “distinguished” in this year’s survey — along with Harvard, Stanford and MIT — and no other institution in Florida above “good,” as reported by the Gainesville Sun.

Inside Higher Ed points out that this isn’t really outright gaming—the peer assessment survey simply asks for opinions. What kind of administrator wouldn’t play up his or her own institution? And according to University of Vermont president Daniel M. Fogel, even if you wanted to play fair, you’d likely end up working overtime: Fogel estimated that if one were to research each school on the survey before passing judgement, filling out the form would take ten hours.

USNWR releases its 2010 college rankings tomorrow.

Update: USNWR 2010 rankings are out, and so is the MoJo Mini College Guide.

MORE HARD-HITTING JOURNALISM

In 2014, before Donald Trump announced his run for president, we knew we had to do something different to address the fundamental challenge facing journalism: how hard-hitting reporting that can hold the powerful accountable can survive as the bottom falls out of the news business.

Being a nonprofit, we started planning The Moment for Mother Jones, a special campaign to raise $25 million for key investments to make Mother Jones the strongest watchdog it can be. Five years later, readers have stepped up and contributed an astonishing $23 million in gifts and future pledges. This is an incredible statement from the Mother Jones community in the face of huge threats—both economic and political—against the free press.

Read more about The Moment and see what we've been able to accomplish thanks to readers' incredible generosity so far, and please join them today. Your gift will be matched dollar for dollar, up to $500,000 total, during this critical moment for journalism.

We Recommend

Latest

Sign up for our newsletters

Subscribe and we'll send Mother Jones straight to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate

We have a new comment system! We are now using Coral, from Vox Media, for comments on all new articles. We'd love your feedback.