A Big Week in the Measurement of Expertise: How the UK Research Excellence Framework (REF) Results Will Impact Universities

May 9, 2022

4 min

Justin Shaw

How should we measure faculty expertise? This week the UK provides its answer to this question via its highly significant and formal (government-directed) assessment of academic research - which grades academic teams on a scale of 1* to 4* for their ability to deliver, share and create impact globally outstanding research.


This process is known as the REF (the Research Excellence Framework) - and the results will be publicly released this Thursday (12th May) with universities themselves finding out how they’ve performed in advance today (Monday 9th May). The process was last carried out 8 years ago and has been delayed by a year due to the pandemic.



Why is the Research Excellence Framework (REF) Significant?


The Research Excellence Framework steers the level of UK public funds - allocated via research councils - that will be invested in research for each academic department (or so-called “Unit of Assessment”) for the next few years. It is also a way of comparing performance against other universities that are offering similar research expertise, and of strengthening (or weakening) global research reputations.


During the next three days, UK universities will be digging into the detail of their REF gradings and the accompanying feedback. There will be some very nervous university leaders and research heads delving into why this peer-assessed review of their research has not gone as well as they expected and why their percentages in each of the four grade areas have dropped - or even been given the “unclassified” career-damaging stamp.


How are the REF Scores for Universities Determined?


The measurement process is based on three aspects:


  1. Quality of outputs (such as: publications, performances, and exhibitions),
  2. Impact beyond academia
  3. The environment that supports research


The preparation, participation, and assessment process takes a massive amount of time, attention and energy. Last time (2014) there were 1,911 submissions to review. Research teams, designated REF leaders and senior staff will have spent long hours across many months preparing their submissions and making sure they are presenting hard evidence and the best case possible to meet the above criteria at the highest possible level. There are 34 subject areas that are covered in the latest REF - and three tiers of expert panels (some with about 20 or more senior academics, international subject leaders, and research users) will have reviewed each submission and compared notes to come to decisions.


How do these Key Categories within the REF Contribute to the Rating for a University?


The Research Excellence Framework is actually an intensive and highly important approach to expert assessment. These are the key factors and their definitions (with the assigned weighting of each of the criteria in steering final grades):


  1. Outputs (60%): the quality of submitted research outputs in terms of their ‘originality, significance and rigour’, with reference to international research quality standards. This element will carry a weighting of 60 per cent in the overall outcome awarded to each submission.
  2. Impact (25%): the ‘reach and significance’ of impacts on the economy, society, culture, public policy or services, health, the environment or quality of life that were underpinned by excellent research conducted in the submitted unit. This element carries a weighting of 25 per cent.
  3. Environment (15%): the research environment in terms of its ‘vitality and sustainability’, including the approach to enabling impact from its research, and its contribution to the vitality and sustainability of the wider discipline or research base. This element accounts for 15 per cent.


Taking a Closer Look at the Categories - Are We Focusing Enough on Research Impact?


In 2014 a formal review was carried out in order to improve and evolve the REF process which made a number of recommendations. Most notably the weighting for “impact” was increased by five percent, with “outputs” being reduced by the same percentage. This is certainly a recognition that the external contribution difference that research makes is more important - but is it enough? Should there be greater emphasis on the return on investment from a beneficiaries and user experience perspective?


Many argue that academic research should retain a strong element of ‘”blue sky” experimentation - where outright evidence of impact may take several years (even decades) and so can’t demonstrate such immediate value.


A particularly notable benefit of the timing of the COVID-19 pandemic and the effect of this in REF deadlines has allowed the extended assessment period for ‘proof of impact’ from 1 August 2013 to 31 December 2020. This is an extension from the previous end date of 31 July 2020. The extension has been put in place to enable case studies affected by, or focusing on the response to, COVID-19 to be assessed in REF 2021.


Going back to the original question: how should we measure faculty expertise? It will be interesting to monitor the views and responses of university leaders and faculty members at the end of this week as to whether they feel that - standing back from it all - this UK-centric method of measurement is the best that can be done, a neat compromise or isn’t really what we really need.


For more information on the Research Excellence Framework visit www.ref.ac.uk/


Justin Shaw

Justin is UK and Ireland Development Director for ExpertFile and Chief Higher Education Consultant at Communications Management. An authority on University strategy and communications, he has worked in and with leadership teams at UK universities for over 30 years. In his role he has advised universities on how to promote their expertise and on communications strategies related to the REF.


Connect with:
Justin Shaw

Justin Shaw

Chief Higher Education Consultant (Communications Management) and UK Development Director

Specialist in higher education, communications, reputation and marketing of academic experts

You might also like...

Check out some other posts from ExpertFile

3 min

Breaking: Justin Timberlake Reveals He Has Lyme Disease

When a major celebrity opens up about a personal health struggle, public attention often follows. That’s certainly the case after Justin Timberlake recently revealed that he is battling Lyme disease—a condition that affects nearly half a million Americans each year but remains widely misunderstood. Timberlake’s announcement is bringing renewed focus to the causes, risks, and complexities of Lyme disease, including how it spreads, where it’s most prevalent, and what individuals can do to protect themselves. With tick season still active in many regions, this moment offers an opportunity to better inform the public—and we’ve identified a group of leading experts who can help do just that. From microbiologists and epidemiologists to entomologists and disease ecologists, the following researchers bring a wide range of expertise on Lyme disease, tick biology, and environmental risk factors. Whether you're a journalist looking for credible sources, a public health communicator, or simply someone trying to make sense of this rising threat, these experts are available to provide clarity and context in the wake of this headline-making health disclosure. Featured Experts A highly media‑quoted microbiologist specializing in Lyme and other tick‑borne diseases. He runs TickReport, a service that tests ticks and interprets exposure risks. Insights on... How celebrities like Timberlake amplifying Lyme awareness may shift public perception and testing demand. The relevance of tick season timing and geographic risk zones. How tick testing works and what patients should know post‑exposure. Over two decades studying Borrelia burgdorferi and blacklegged ticks, with strong expertise in disease ecology and conservation medicine. Insights on... The biology of transmission and the tick’s life cycle—what leads to infection risk. How habitat and ecological shifts may affect Lyme exposure risks. Wildlife‑human disease interface in increasingly peri‑urban settings. Focuses on landscape ecology and patterns of vector‑borne disease emergence including Lyme disease. Insights on... How environmental changes (e.g. urban sprawl, climate trends) are altering Lyme disease risk maps. Predictive models: where Lyme is emerging next. Implications for public health messaging given high-profile cases like Timberlake’s. Specializes in tick taxonomy and vector species genetics—ideal for deeper background on tick diversity and distribution. Insights on... Which tick species carry Lyme and how misidentification can confuse diagnosis. Emerging tick species or genetic strains and what they mean for prevention. Geographic spread and species shift over time. His research examines geographic patterns of Lyme disease, including why incidence varies regionally in the U.S. Insights on... Why Lyme is more prevalent in certain states—even those outside Timberlake’s or his fans’ travel zones. Human behavioral and habitat factors (e.g. suburban greenspace vs. deep woods). What seasonal changes in tick behavior tell us about infection risk. Story Angles to Explore Celebrity spotlight on Lyme disease: How high‑profile cases can impact media attention, funding, public awareness, and testing demand. Diagnosis and prevention: From exposure to testing (e.g., TickReport), early symptoms, treatment windows, and what experts recommend post‑bite. Ecology and environment: Why Lyme is expanding geographically, and how climate and land‑use change influence risk. Tick evolution and identification: Educating the public on which ticks transmit Lyme, emerging strains, and challenges in correct tick identification. Regional variation in risk: Breakdowns of why some states or regions are Lyme hotspots and how that aligns with the celebrity’s likely exposure zones or fan geography. Looking for more Experts? Visit www.expertfile.com or download ExpertFile for your phone.

1 min

10th Anniversary of the Supreme Court Legalizing Gay Marriage

The 10th anniversary of the U.S. Supreme Court’s landmark decision in Obergefell v. Hodges marks a decade since same-sex marriage became legal nationwide—a pivotal moment in the advancement of LGBTQ+ rights and civil liberties. This anniversary is newsworthy not only because of the social and legal progress it symbolizes but also due to ongoing conversations around equality, representation, and protection under the law. As the political landscape shifts and new challenges emerge, revisiting the legacy of this decision offers an opportunity to reflect on progress, examine setbacks, and spotlight the voices shaping the next chapter in LGBTQ+ advocacy. Key story angles that may interest a broad audience include: Personal stories from couples and families: Exploring how the decision transformed lives and created new definitions of family, love, and legal recognition. The legal legacy of Obergefell v. Hodges: Analyzing the impact on subsequent LGBTQ+ rights cases and how the precedent continues to be tested in courts. Backlash and resistance: Investigating the rise of anti-LGBTQ+ legislation and rhetoric in the decade following the ruling. Intersectionality within the LGBTQ+ rights movement: Highlighting the experiences of LGBTQ+ people of color, transgender individuals, and rural communities. The global ripple effect: Examining how the U.S. ruling influenced marriage equality movements in other countries. The future of LGBTQ+ rights: Discussing what comes next in the fight for inclusive healthcare, anti-discrimination laws, and gender identity recognition. Connect with our experts about the 10th Anniversary of the Supreme Court Legalizing Gay Marriage: Check out our experts here : www.expertfile.com

1 min

Operation Rising Lion. Our experts are here to help with your coverage as Israel launches strikes on Iran

Israel carried out strikes against Iran on Friday, targeting its nuclear and military sites, after US President Donald Trump warned of a possible "massive conflict" in the region. Israel's operation struck at the "heart of Iran's nuclear enrichment programme", taking aim at the atomic facility in Natanz and nuclear scientists, Prime Minister Benjamin Netanyahu said. The operation against Iran will "continue as many days as it takes," Netanyahu said. June 12 - AFP Connect with our experts about the latest escalation between Israel and Iran: Check out our experts here : www.expertfile.com

View all posts