Critics call college rankings 'a joke' - here's why every list has a different No.1

walking campus students college

Michael B. Thomas/Getty Images

College rankings don't really tell you much unless you know the methodology that goes with them.

College rankings are ubiquitous as the school year starts. U.S. News & World Report, Niche, and Times Higher Education all released rankings in September.

The proliferation of these rankings have led some to revolt against the concept of neatly bucketing schools on lists where they are in the "top" or "bottom" of rankings, especially as top performers tend to be expensive private schools, and ballooning student debt calls into question college affordability.Advertisement

Frank Bruni, a columnist at New York Times, wrote an especially damning a piece ridiculing college rankings he called "Why College Rankings Are a Joke."

"The rankings nourish the myth that the richest, most selective colleges have some corner on superior education; don't adequately recognize public institutions that prioritize access and affordability; and do insufficient justice to the particular virtues of individual campuses," he wrote before the U.S. News rankings came out in 2016.

Yet the rankings are still highly cited, and do offer important data about aspects of a particular college, if readers are able to decipher them.
Advertisement

For those who are having a hard time understanding why college rankings all offer different results, Business Insider put together a few charts to break down the anatomy of each.

Artboard 4

Ana Pelisson/Business Insider

U.S. News has been ranking American colleges annually for more than 30 years. Since then, a familiar cast of Ivy League colleges has dominated the top three slots, with Harvard, Princeton, and Yale typically rounding out the top three. In recent years, the University of Chicago has inched its way up the list and tied with Yale this year.The methodology includes both quantitative and qualitative factors. Graduation and retention rates make up one of the most weighted components, which is backed by data. But equally highly weighted at 22.5% are the "opinions of those in a position to judge a school's undergraduate academic excellence."Advertisement

That means an aspect of highly ranked universities may be self-perpetuating. Princeton's No. 1 ranking may contribute to its excellent reputation, which boosts qualitative rankings by peers, in turn helping it keep its No. 1 ranking.

At 20%, faculty resources is the third most important component of the methodology, which includes class size, faculty salary, and proportion of professors with the highest degree in their fields.

The top 10 colleges as ranked by U.S. News & World Report:Advertisement

10. California Institute of Technology

9. Duke University

8. University of PennsylvaniaAdvertisement

5. Stanford University (tie)

5. Massachusetts Institute of Technology (tie)

5. Columbia University (tie)Advertisement

3. Yale University (tie)

3. University of Chicago (tie)2. Harvard UniversityAdvertisement

1. Princeton University

bi_graphics_collegeranking2

Anaele Pelisson/ Business Insider

Niche also ranks US colleges and universities, and places substantial weight on reviews from students and alumni. Niche prides itself on the qualitative nature of its ranking, boasting that it has "the most comprehensive data in the industry" and is "able to provide a more comprehensive suite of rankings across all school types."Advertisement

In fact, survey responses from students and alumni factor into every single component of the methodology, even ones readers may assume are purely data-driven. For example, the largest weighted factor is the "academics grade" which includes: acceptance rate, quality of professors, as well as student and alumni surveys regarding academics at the school.

While U.S. News doesn't incorporate salary, Niche looks to the financial "value" of the college, and includes statistics on average loan about and alumni earnings. But the average loans and alumni earnings component also includes student surveys regarding the value of the school.

The top 10 colleges as ranked by Niche:Advertisement

10. California Institute of Technology

9. Bowdoin College

8. Brown UniversityAdvertisement

7. University of Pennsylvania

6. Princeton University5. Rice UniversityAdvertisement

4. Yale University

3. Harvard University

2. Massachusetts Institute of TechnologyAdvertisement

1. Stanford University

bi_graphics_collegerank

Ana Pelisson/Business Insider

The Times Higher Education World University Rankings, as the name alludes, ranks schools around the world. Like the U.S. News ranking, the methodology includes a mix of both quantitative and qualitative factors.

The teaching component includes a reputation survey given to measure the "perceived prestige of institutions in teaching" as well as the student-teacher ratio at the school.Advertisement

Research includes a survey to judge "university's reputation for research excellence among its peers," and a measure of income the school makes related to its research.

Citations are a measure of how often a university's published work is cited by scholars globally, and international outlook is the ability of a university to attract students and faculty from all over the world.

The top 10 US colleges as ranked by Times Higher Education:Advertisement

10. Columbia University

9. Johns Hopkins University8. Yale UniversityAdvertisement

7. University of Pennsylvania

6. University of Chicago

5. Princeton UniversityAdvertisement

4. Harvard University

3. Massachusetts Institute of Technology

1. Stanford University (tie)Advertisement

1. California Institute of Technology (tie)