Hot on HuffPost:

See More Stories

Ranking the Political Pollsters

4 years ago
  0 Comments Say Something  »
Text Size
For those of you who follow columns like this one about polls, one of the challenges is comparing the results of one poll versus another. There are many variables, including the methods and track records of each pollsters; whether they are surveying likely voters, registered voters or all adults; or, the percentages they determine for sample size of each demographic group, among other things.

Jumping in to help is Nate Silver of the respected FiveThirytEight.com blog, which has just reached a deal to be hosted this year by the New York Times. Silver, a master of mathematical analysis, first put those skills to use analyzing baseball statistics and developing a model to predict the future performance of players and teams. Later, he decided he could use his modeling to analyze polls and election data the same way.

Silver has come out with his ranking of pollsters when it comes to their accuracy of forecasting election results. The key statistic Silver uses is "Pollster-Introduced Error" which he says "reflects the amount of error that a pollster introduces above and beyond that which is unavoidable due to things like sampling variance."

PollsHere's the top 15 from his list in order of which pollsters had the lowest PIE. It include firms that did a minimum of 10 polls during the period he analyzed. The ratings are based on polling for President, Senate, House and gubernatorial races since 1998:

1. Field Poll (primarily California)
2. ABC News/Washington Post
3. SurveyUSA
4. Ciruli
5. University of Cincinnati's Ohio Poll
6. Selzer & Co.
7. NBC News/Wall Street Journal
8. AP-GfK
9. Mason-Dixon Research
10. Pew Research
11. Gallup
12. Market Shares
13. Public Policy Polling
14. Blum & Weprin
15. Rasmussen Reports

Four polls which Poll Watch frequently cites came in 17th through 20th in this order: Fairleigh Dickinson University, Rutgers University, Marist Institute and Siena College. CBS News/New York Times was 24th, Franklin & Marshall College was 29th, the Los Angeles Times was 34th, Quinnipiac University was 45th and Fox News/Opinion Dynamics was 46th.

Near the bottom of the list was Research 2000, American Research Group, InsiderAdvantage and Zogby Interactive.

Follow Poll Watch on Twitter

Our New Approach to Comments

In an effort to encourage the same level of civil dialogue among Politics Daily’s readers that we expect of our writers – a “civilogue,” to use the term coined by PD’s Jeffrey Weiss – we are requiring commenters to use their AOL or AIM screen names to submit a comment, and we are reading all comments before publishing them. Personal attacks (on writers, other readers, Nancy Pelosi, George W. Bush, or anyone at all) and comments that are not productive additions to the conversation will not be published, period, to make room for a discussion among those with ideas to kick around. Please read our Help and Feedback section for more info.

Add a Comment

*0 / 3000 Character Maximum Comment Moderation Enabled. Your comment will appear after it is cleared by an editor.

10 Comments

Filter by:
jeh0530

The ranking could not have been done by a more credible statistician.....baseball is the most analyzed sport in the world. The PIE method is simple....it compares forecast to results.....How apolitical can you be? Go Red Sox!!

June 07 2010 at 3:24 PM Report abuse rate up rate down Reply

Follow Politics Daily

  • Comics
robert-and-donna-trussell
CHAOS THEORY
Featuring political comics by Robert and Donna TrussellMore>>
  • Woman UP Video
politics daily videos
Weekly Videos
Woman Up, Politics Daily's Online Sunday ShowMore»
politics daily videos
TV Appearances
Showcasing appearances by Politics Daily staff and contributors.More>>