Getting my league table just right
One of the features of university life these days is the league table. As I mentioned in a previous post about a year ago, there are now some key rankings, both national and international, which we have to take very seriously. And while many academics express strong reservations about such tables, our stakeholders pay a lot of attention to them. Indeed the position of Irish universities in the world rankings published by Times Higher Education in particular has become almost a matter of national concern, with Irish media coverage and commentary of the results.
The global rankings are dominated by the United States, and to a slightly lesser extent the United Kingdom. It is clear that the standard criteria favour universities with a strong research performance and reasonably favourable student to faculty ratios. And so the European Commission has got in on the act and is planning a league table that, apparently, will focus less on research and more on teaching, in the hope that this will produce more European universities near the top of the rankings. I have some doubts whether such a system will produce very different results, as all the evidence from component parts of the more normal rankings show that research-intensive universities also score more highly when it comes to teaching. Though it will depend, of course, on what exactly the rankings will be asked to measure.
In the meantime, the Vice-Chancellor of the University of Newcastle in England, Chris Brink, has also criticised the established league tables and declared himself in favour of ‘quality profiling’, setting out the institution’s own story like this:
‘Imagine, for example, that each university can respond to the question ‘Do you offer good-quality education?’ by exhibiting a profile of its educational programmes, its curricula, its teaching methodologies and technologies, its student cohorts, their entry- and exit-level performance, the contact hours offered, the teachers who will teach and the assessment methods used.’
I confess I can’t make anything of this at all. The framework he has in mind would clearly make rankings impossible. Actually, Professor Brinks suggests otherwise, but what he means is that you might still be able to say ‘whether one university was better than another’, but with the answer varying depending on ‘the needs of the person asking the question.’ In other words, no ranking. But the problem there is that, in reality, the only reason why league tables are taken so seriously is because they do rank the institutions with reference to empirical data, and that’s not about to change.
I suspect that many people working in higher education instinctively dislike league tables, but they have become a fact of life. By now, also, the criteria used are fairly well established. I suspect that trying to introduce new rankings which have as their starting point a desire to have some particular universities come nearer the top will be easily dismissed, as will tables that don’t supply rankings based on what will be described as objective metrics. Equally, we should not be mesmerised by all this, and above all should not plan all our strategies solely on the basis of what these might achieve in rankings terms. We should keep it all in perspective, and be relaxed. Particularly if we’re doing well in the tables…
Tags: Chris Brink, Times Higher Education, university rankings
You can comment below, or link to this permanent URL from your own site.
September 1, 2009 at 12:25 pm
Hi Ferdinand,
Good to read your blogs – always interesting. I’m a Communications graduate from several years ago.
In relation to League Tables, one of the key determinants of the success of a university is surely the quality of the user’s experience in his various interfaces with the college.
I am currently very disappointed with the move of the Sports Centre to unilaterally impose new parking conditions for astro-turf users which amount to an immediate 50% increase in the cost of a soccer session for individual users. The new conditions have been imposed AFTER we had signed up for a new season, and without consultation or satisfactory explanation.
At the least it’s a fairly hefty consumer affairs issue, at worst it’s a poor reflection on how the university treats its customers.
We have written to the Sports Centre seeking a meeting and are hopeful of some progress. I will keep you updated.
Best
Donnchadh
September 2, 2009 at 4:12 pm
It seem s to me that a very large problem with the THE rankings is the centrepiece – ‘academic peer review’ (40%. This category is not based on any sort of facts or figures, just on what academics think of other institutions. Thus, any misconceptions are perpetuated and the list becomes a self-fulfilling prophesy.
For example, Cambridge University has an extremely strong reputation in particle physics, based on the excellent work done there in the 40s, 50s and 60s. It is not that productive in this area now, but how many physicists know that? Not many.
A listing that is 40% based on views that may be misinformed seems to me to be pretty unscientific…
September 2, 2009 at 7:06 pm
In the current Blitz spirit of innovative academic enterprise I am founding a new Irish university, AAAAUniversity.com. The University, to be located off-shore in the Maldives, will be small – a boutique or niche operation. In fact it will employ just 5 faculty, all of whom will be Nobel prizewinners. The university will be generously funded by George Soros. The student-teacher ratio will be determined by the strict limitation on the number of students, ie 5, each of whom must be a current or former Rose of Tralee who can demonstrate 6 or more A1s in her Leaving Cert. Each faculty member will gain 5 million dollars of research funding (per annum) from the George Soros Scientific Foundation and each will publish 5 monographs per annum though AAAAUniversity Press, and 5 peer-reviewed articles in journals published by Soros Scientific publishing. Each year a searching student satisfaction survey will be administered personally by George Soros at the Cannes campus of the University. The University will forever more be the no. 1 university in the THE, Guardian, Shanghai Jao Tong, Asia Week and Leitrim Observer league tables. Not to mention the Golden Pages.
September 2, 2009 at 7:54 pm
Needless to say, each of the five faculty would be required to cite each of their 4 colleagues in every one of their publications, numerous times.
September 3, 2009 at 8:46 am
Perry, your AAAUniversity is an obvious winner. Let’s get fundraising!
September 3, 2009 at 5:59 pm
sorry Ferdinand, you would need about 5m in ready money even to be invited on to the board!
September 23, 2009 at 5:29 pm
US universities dominated the rankings in many of the international league tables, such as the THES, Webometrics, Academic Ranking of World universities. UK universities are ranked highly in the THES but quite lower position in relative to US schools in the Webometrics ranking.