A Big Week in the Measurement of Expertise: How the UK Research Excellence Framework (REF) Results Will Impact Universities

May 9, 2022

4 min

Justin Shaw

How should we measure faculty expertise? This week the UK provides its answer to this question via its highly significant and formal (government-directed) assessment of academic research - which grades academic teams on a scale of 1* to 4* for their ability to deliver, share and create impact globally outstanding research.


This process is known as the REF (the Research Excellence Framework) - and the results will be publicly released this Thursday (12th May) with universities themselves finding out how they’ve performed in advance today (Monday 9th May). The process was last carried out 8 years ago and has been delayed by a year due to the pandemic.



Why is the Research Excellence Framework (REF) Significant?


The Research Excellence Framework steers the level of UK public funds - allocated via research councils - that will be invested in research for each academic department (or so-called “Unit of Assessment”) for the next few years. It is also a way of comparing performance against other universities that are offering similar research expertise, and of strengthening (or weakening) global research reputations.


During the next three days, UK universities will be digging into the detail of their REF gradings and the accompanying feedback. There will be some very nervous university leaders and research heads delving into why this peer-assessed review of their research has not gone as well as they expected and why their percentages in each of the four grade areas have dropped - or even been given the “unclassified” career-damaging stamp.


How are the REF Scores for Universities Determined?


The measurement process is based on three aspects:


  1. Quality of outputs (such as: publications, performances, and exhibitions),
  2. Impact beyond academia
  3. The environment that supports research


The preparation, participation, and assessment process takes a massive amount of time, attention and energy. Last time (2014) there were 1,911 submissions to review. Research teams, designated REF leaders and senior staff will have spent long hours across many months preparing their submissions and making sure they are presenting hard evidence and the best case possible to meet the above criteria at the highest possible level. There are 34 subject areas that are covered in the latest REF - and three tiers of expert panels (some with about 20 or more senior academics, international subject leaders, and research users) will have reviewed each submission and compared notes to come to decisions.


How do these Key Categories within the REF Contribute to the Rating for a University?


The Research Excellence Framework is actually an intensive and highly important approach to expert assessment. These are the key factors and their definitions (with the assigned weighting of each of the criteria in steering final grades):


  1. Outputs (60%): the quality of submitted research outputs in terms of their ‘originality, significance and rigour’, with reference to international research quality standards. This element will carry a weighting of 60 per cent in the overall outcome awarded to each submission.
  2. Impact (25%): the ‘reach and significance’ of impacts on the economy, society, culture, public policy or services, health, the environment or quality of life that were underpinned by excellent research conducted in the submitted unit. This element carries a weighting of 25 per cent.
  3. Environment (15%): the research environment in terms of its ‘vitality and sustainability’, including the approach to enabling impact from its research, and its contribution to the vitality and sustainability of the wider discipline or research base. This element accounts for 15 per cent.


Taking a Closer Look at the Categories - Are We Focusing Enough on Research Impact?


In 2014 a formal review was carried out in order to improve and evolve the REF process which made a number of recommendations. Most notably the weighting for “impact” was increased by five percent, with “outputs” being reduced by the same percentage. This is certainly a recognition that the external contribution difference that research makes is more important - but is it enough? Should there be greater emphasis on the return on investment from a beneficiaries and user experience perspective?


Many argue that academic research should retain a strong element of ‘”blue sky” experimentation - where outright evidence of impact may take several years (even decades) and so can’t demonstrate such immediate value.


A particularly notable benefit of the timing of the COVID-19 pandemic and the effect of this in REF deadlines has allowed the extended assessment period for ‘proof of impact’ from 1 August 2013 to 31 December 2020. This is an extension from the previous end date of 31 July 2020. The extension has been put in place to enable case studies affected by, or focusing on the response to, COVID-19 to be assessed in REF 2021.


Going back to the original question: how should we measure faculty expertise? It will be interesting to monitor the views and responses of university leaders and faculty members at the end of this week as to whether they feel that - standing back from it all - this UK-centric method of measurement is the best that can be done, a neat compromise or isn’t really what we really need.


For more information on the Research Excellence Framework visit www.ref.ac.uk/


Justin Shaw

Justin is UK and Ireland Development Director for ExpertFile and Chief Higher Education Consultant at Communications Management. An authority on University strategy and communications, he has worked in and with leadership teams at UK universities for over 30 years. In his role he has advised universities on how to promote their expertise and on communications strategies related to the REF.


Connect with:
Justin Shaw

Justin Shaw

Chief Higher Education Consultant (Communications Management) and UK Development Director

Specialist in higher education, communications, reputation and marketing of academic experts

Powered by

You might also like...

Check out some other posts from ExpertFile

Pneumonic Plague: An Ancient Killer That Has Never Completely Disappeared featured image

3 min

Pneumonic Plague: An Ancient Killer That Has Never Completely Disappeared

Few diseases carry the historical weight of plague. Caused by the bacterium Yersinia pestis, plague has been responsible for some of the deadliest disease outbreaks in recorded history. The most infamous was the Black Death of the 14th century, which swept through Europe, the Middle East and North Africa and killed tens of millions of people. The World Health Organization estimates that more than 50 million people died in Europe alone. But plague is not simply a disease of the past. The bacterium continues to circulate naturally among wild rodents and their fleas in parts of the world, and human cases still occur. The World Health Organization reports that most cases recorded between 2019 and 2025 occurred in the Democratic Republic of the Congo and Madagascar. What Is Pneumonic Plague? There are three primary forms of plague: bubonic, septicemic and pneumonic. Bubonic plague - historically the best-known form -  usually develops following the bite of an infected flea and is characterized by painful, swollen lymph nodes known as “buboes.” Pneumonic plague occurs when Yersinia pestis infects the lungs. It can develop when untreated bubonic or septicemic plague spreads to the lungs, or when someone inhales infectious respiratory particles from a person or animal with pneumonic plague. That distinction is important: pneumonic plague is the only form of plague that can spread directly from person to person through respiratory particles. What Are the Symptoms? Pneumonic plague can progress remarkably quickly. According to the CDC, symptoms include fever, headache and weakness followed by rapidly developing pneumonia. Patients can experience shortness of breath, chest pain and coughing, sometimes producing bloody or watery mucus. Symptoms following inhalation can begin as soon as one day after exposure. Without treatment, pneumonic plague is extremely dangerous. The World Health Organization describes untreated pneumonic plague as invariably fatal, making rapid recognition and medical intervention critical. From Medieval Killer to Treatable Disease What separates plague today from the disease that devastated populations centuries ago is modern medicine. Plague is a bacterial infection and can be successfully treated with antibiotics. The CDC recommends beginning treatment as soon as plague is suspected rather than waiting for laboratory confirmation. Depending on the severity of the illness, treatment can involve intravenous or oral antibiotics, with gentamicin and fluoroquinolones among the first-line treatments used in the United States. Early detection matters enormously. Modern antibiotics, infection-control practices, surveillance and public-health responses mean that a disease once capable of devastating entire communities can now be identified, contained and treated. Yet its persistence also offers an important reminder: diseases that profoundly shaped human history do not necessarily disappear. Plague remains present in animal populations, continues to cause human infections and provides researchers with a remarkable window into the relationship between infectious disease, human behaviour, public health and even human evolution. Experts in infectious diseases, epidemiology, public health, microbiology, global health, medicine and the history of disease can help provide perspective on pneumonic plague, how it spreads, the risks it poses and what centuries of experience with plague can teach us about preventing and responding to outbreaks today. Connect with our experts today: View all of your experts here at www.expertfile.com

25 Years Later: How 9/11 Changed the World featured image

2 min

25 Years Later: How 9/11 Changed the World

On September 11, 2001, the world watched as nearly 3,000 people were killed in terrorist attacks that would become one of the defining moments of the 21st century. Twenty-five years later, 9/11 remains much more than a moment in history. Its consequences continue to shape the world we live in. The attacks transformed national security and intelligence, changed how people travel, reshaped airport and border security, and ushered in a new era of surveillance and counterterrorism. They also profoundly influenced American foreign policy, leading to wars in Afghanistan and Iraq and decades of debate about security, military intervention and America's role in the world. The effects were cultural as well as political. September 11 changed how a generation viewed safety, terrorism and global conflict. It also sparked difficult conversations about civil liberties, immigration, religious tolerance and the balance between individual freedoms and collective security. For younger generations, 9/11 is increasingly an event learned about rather than remembered. For millions of others, memories of where they were and what they saw that day remain remarkably vivid. A quarter-century later, the anniversary offers an opportunity to remember those who were lost, recognize the first responders and countless others affected by the attacks, and examine how the decisions made in their aftermath continue to influence our world. Experts in history, political science, international relations, national security, terrorism, public policy and sociology can help provide perspective on September 11, its legacy and how the world has changed 25 years later. Connect with our experts today: View all of your experts here at www.expertfile.com

More Than a Long Weekend: Why Labor Day Still Matters in America featured image

2 min

More Than a Long Weekend: Why Labor Day Still Matters in America

For millions of Americans, Labor Day means the unofficial end of summer , a final long weekend before schools are back in full swing and the fall routine takes over. But behind the barbecues, travel and end-of-summer sales is a holiday rooted in the history of American workers and the transformation of the workplace. Observed on the first Monday in September, Labor Day recognizes the social and economic achievements of American workers. Its origins date to the labor movement of the late 19th century, with the first Labor Day celebration held in New York City on September 5, 1882. In 1894, it became a federal holiday. More than 130 years later, Labor Day remains an opportunity to look at the role work plays in American life, particularly at a time when the workplace itself is undergoing enormous change. Artificial intelligence and automation are reshaping jobs and industries. Remote and hybrid work have changed where and how millions of people work. Employers continue to navigate workforce shortages, recruitment and retention, while workers are reconsidering expectations around compensation, flexibility, benefits and work-life balance. Labor Day can also open the door to broader conversations about the American labor movement, organized labor, workplace protections, wages and the economic contribution of workers. For journalists, that makes the holiday much more than a date on the calendar. It's a timely opportunity to explore both how work in America has changed and where it is heading next. Experts across economics, business, labor relations, history, human resources, public policy and emerging technology can provide valuable perspective on Labor Day and the changing American workplace. Journalists covering Labor Day and looking for expert perspective on the history of the holiday, labor and employment, workplace trends, organized labor, artificial intelligence and the future of work can connect with experts directly through ExpertFile profiles below:

View all posts