A Big Week in the Measurement of Expertise: How the UK Research Excellence Framework (REF) Results Will Impact Universities

May 9, 2022

4 min

Justin Shaw

How should we measure faculty expertise? This week the UK provides its answer to this question via its highly significant and formal (government-directed) assessment of academic research - which grades academic teams on a scale of 1* to 4* for their ability to deliver, share and create impact globally outstanding research.


This process is known as the REF (the Research Excellence Framework) - and the results will be publicly released this Thursday (12th May) with universities themselves finding out how they’ve performed in advance today (Monday 9th May). The process was last carried out 8 years ago and has been delayed by a year due to the pandemic.



Why is the Research Excellence Framework (REF) Significant?


The Research Excellence Framework steers the level of UK public funds - allocated via research councils - that will be invested in research for each academic department (or so-called “Unit of Assessment”) for the next few years. It is also a way of comparing performance against other universities that are offering similar research expertise, and of strengthening (or weakening) global research reputations.


During the next three days, UK universities will be digging into the detail of their REF gradings and the accompanying feedback. There will be some very nervous university leaders and research heads delving into why this peer-assessed review of their research has not gone as well as they expected and why their percentages in each of the four grade areas have dropped - or even been given the “unclassified” career-damaging stamp.


How are the REF Scores for Universities Determined?


The measurement process is based on three aspects:


  1. Quality of outputs (such as: publications, performances, and exhibitions),
  2. Impact beyond academia
  3. The environment that supports research


The preparation, participation, and assessment process takes a massive amount of time, attention and energy. Last time (2014) there were 1,911 submissions to review. Research teams, designated REF leaders and senior staff will have spent long hours across many months preparing their submissions and making sure they are presenting hard evidence and the best case possible to meet the above criteria at the highest possible level. There are 34 subject areas that are covered in the latest REF - and three tiers of expert panels (some with about 20 or more senior academics, international subject leaders, and research users) will have reviewed each submission and compared notes to come to decisions.


How do these Key Categories within the REF Contribute to the Rating for a University?


The Research Excellence Framework is actually an intensive and highly important approach to expert assessment. These are the key factors and their definitions (with the assigned weighting of each of the criteria in steering final grades):


  1. Outputs (60%): the quality of submitted research outputs in terms of their ‘originality, significance and rigour’, with reference to international research quality standards. This element will carry a weighting of 60 per cent in the overall outcome awarded to each submission.
  2. Impact (25%): the ‘reach and significance’ of impacts on the economy, society, culture, public policy or services, health, the environment or quality of life that were underpinned by excellent research conducted in the submitted unit. This element carries a weighting of 25 per cent.
  3. Environment (15%): the research environment in terms of its ‘vitality and sustainability’, including the approach to enabling impact from its research, and its contribution to the vitality and sustainability of the wider discipline or research base. This element accounts for 15 per cent.


Taking a Closer Look at the Categories - Are We Focusing Enough on Research Impact?


In 2014 a formal review was carried out in order to improve and evolve the REF process which made a number of recommendations. Most notably the weighting for “impact” was increased by five percent, with “outputs” being reduced by the same percentage. This is certainly a recognition that the external contribution difference that research makes is more important - but is it enough? Should there be greater emphasis on the return on investment from a beneficiaries and user experience perspective?


Many argue that academic research should retain a strong element of ‘”blue sky” experimentation - where outright evidence of impact may take several years (even decades) and so can’t demonstrate such immediate value.


A particularly notable benefit of the timing of the COVID-19 pandemic and the effect of this in REF deadlines has allowed the extended assessment period for ‘proof of impact’ from 1 August 2013 to 31 December 2020. This is an extension from the previous end date of 31 July 2020. The extension has been put in place to enable case studies affected by, or focusing on the response to, COVID-19 to be assessed in REF 2021.


Going back to the original question: how should we measure faculty expertise? It will be interesting to monitor the views and responses of university leaders and faculty members at the end of this week as to whether they feel that - standing back from it all - this UK-centric method of measurement is the best that can be done, a neat compromise or isn’t really what we really need.


For more information on the Research Excellence Framework visit www.ref.ac.uk/


Justin Shaw

Justin is UK and Ireland Development Director for ExpertFile and Chief Higher Education Consultant at Communications Management. An authority on University strategy and communications, he has worked in and with leadership teams at UK universities for over 30 years. In his role he has advised universities on how to promote their expertise and on communications strategies related to the REF.


Connect with:
Justin Shaw

Justin Shaw

Chief Higher Education Consultant (Communications Management) and UK Development Director

Specialist in higher education, communications, reputation and marketing of academic experts

You might also like...

Check out some other posts from ExpertFile

6 min

Higher Education Enters the Ring

Why it matters Yesterday’s announcement that Linda McMahon is President-elect Donald Trump’s pick to lead the Department of Education ushers in a new era for universities and colleges.  This signals a sharp pivot toward decentralization and pro-business policies, and it's expected that McMahon’s leadership will focus on dismantling traditional federal education structures, expanding school choice, and aligning education priorities with a business-first agenda.  Higher education faces funding uncertainties, new accountability pressures, and the need to demonstrate its relevance in supporting economic growth. The Big Picture McMahon’s appointment reflects Trump’s broader strategy to reframe education policy in a way that prioritizes state control, entrepreneurship, and conservative cultural values. This will likely have significant consequences for higher education, including: Decentralization: Shifting control of education policy and funding to the states. School Choice Expansion: Redirecting public funds to private, religious, and homeschooling options. Economic Alignment: Pressuring institutions to support industry, small business, and workforce development through research, partnerships, and entrepreneurship/startup programs. Cultural Shifts: Rolling back policies on diversity, equity, and inclusion while emphasizing “patriotic” education. What’s at Stake Federal Funding Cuts: Threat: Research funding, Pell Grants, and other federal supports may face cuts. Reality Check: Congressional approval is required to eliminate funding streams like Title I, making complete federal withdrawal unlikely but changes and funding disruptions possible. Policy Shifts: Threat: Federal oversight will likely weaken, and policies favoring vocational and workforce-aligned education will likely put increased pressure on programs such as liberal arts. Universities will also likely face increasing pressure to align with ideological goals, such as restricting DEI (diversity, equity, and inclusion) initiatives.  The new administration could wield considerable control over the school accreditation process, which has been seen by some to force ideological changes on campuses.  There has been a movement to decentralize accreditation authority, reduce federal oversight, and align educational standards with conservative values. According to the Council for Higher Education, many of the ideas put forward focus on empowering states to authorize accrediting agencies and even serve as accreditors themselves, shifting control from federal to state governments.  Action: Institutions must better identify their options amidst a rapidly evolving agenda at both the state and federal levels, develop strategies and secure the resources necessary.  For instance, there are calls to prohibit accreditors from requiring institutions to implement Diversity, Equity, and Inclusion (DEI) policies.  Institutions also need to understand what the implications of a more diverse accreditation landscape could be, with standards varying significantly across states, potentially affecting the uniformity and transferability of academic credentials nationwide.  Reputational Risks: Concern: Growing public skepticism toward higher education undermines enrolment and support. Impact: Conservative narratives favoring alternatives like apprenticeships and other programs that support the economy and job growth will likely gain traction. Preserving Institutional Independence: Pressure: Universities face increased scrutiny of their course curriculum and research priorities that may be deemed ideologically contentious. Opportunity: Institutions must tangibly demonstrate their value to society. The more they can do to break down barriers between “town and gown” and counter the narrative that paints them as too expensive, elitist, and out of touch. Demonstrating Economic Impact: Need: Universities must showcase their role in driving economic growth through research, commercialization, and support for small businesses and entrepreneurs. Opportunity: Institutions should communicate their relevance in relatable ways that engage with businesses, emphasizing tangible contributions to research innovation and job creation as a positive return on investment that can be messaged to taxpayers. Key Questions for Higher Ed Leaders Funding: How can we diversify revenue streams and reduce reliance on federal support? Advocacy: How should universities engage state and federal leaders to protect their interests? Reputation: How can higher education rebuild public trust and counter skepticism?  Relevance: How do we better communicate the value of university research and its role in supporting a pro-business agenda? Adaptation: Can institutions innovate by expanding industry partnerships, online education, and workforce-aligned programs? Implications of Project 2025 Project 2025 is a comprehensive initiative spearheaded by the Heritage Foundation, a conservative think tank, aiming to reshape the U.S. federal government through a conservative lens. Launched in April 2023, it serves as a strategic blueprint for a potential conservative administration, detailing policy proposals, personnel strategies, training programs, and a 180-day action plan. Analysis from the Brookings Institution states that "many proposals in Project 2025 would require an unlikely degree of cooperation from Congress, though others could be enacted unilaterally by a second Trump administration.”  While we don’t know the full extent to which Project 2025 will be implemented, its agenda seeks to reshape federal agencies, including the Department of Education, with a significant impact on the sector.  Key areas of focus include: Title I and Student Aid Proposals to give parents more control over federal funds could deprioritize public education. Tax Credits for School Choice Incentives to support private school tuition may shift K-12 pipelines, impacting university enrolment. Economic Realignment Universities will need to align with business priorities, emphasizing innovation, commercialization, and job creation. Diversity Equity & Inclusion Project 2025 explicitly calls for reducing federal spending on what it deems unnecessary or politicized initiatives, and DEI programs are likely to fall under this categorization.  This could have wide-ranging impacts, including changes to school ranking systems that have a DEI component.  Ranking bodies such as US News & World Report may need to adjust their methodologies to account for changes in diversity initiatives and data availability. With potential reductions in diversity-related data, rankings might place greater emphasis on other factors such as academic performance, faculty qualifications, and post-graduate outcomes. This also could extend to endowments, which direct funding toward diversity programs through scholarships and fellowships. For institutions that rely heavily on DEI as a cornerstone of their fundraising and donor relations strategies, they may experience reduced donor enthusiasm, particularly from philanthropic organizations or alumni committed to these causes. Regulatory Rollbacks There is the potential for significant changes to Title IX protections and federal loan forgiveness programs, creating legal and financial uncertainty. What Universities Can Do Now: Secure Funding Build relationships with private donors, businesses, and industry partners. Strengthen advocacy efforts at the state level to safeguard funding & other resources.   Adopt proactive strategies to mitigate potential policy impacts, such as diversifying revenue sources, engaging donors with aligned government priorities, and ensuring compliance with evolving regulations. Reinforce Public Trust Explain complex topics in accessible ways to help the public and policymakers make informed decisions. Help promote and support faculty who can serve as credible sources for the media, countering misinformation and fostering informed dialogue. Strengthen community connections with your experts through public speaking engagements, workshops, and local events. Position the university as a hub for knowledge and innovation that benefits the community. Capitalize on the reach and influence of alumni. Highlight their successes to show how they benefitted from educational programs and research. Position them as important role models and advocates in the community who are contributing to economic growth. Demonstrate Relevance Showcase faculty and their research breakthroughs. Demonstrate how their work benefits industries, supports entrepreneurship and addresses societal challenges. Speak to real-world outcomes in health, technology, the environment, and more. Use accessible language to connect with policymakers, business leaders and taxpayers. Strengthen Advocacy: Partner with peer institutions to shape policy discussions. Position universities and colleges as vital contributors to a pro-business agenda. Innovate: Expand stackable credentials and micro-credential programs that are aligned with private and public sector requirements and emerging skills-based models. Look at new online education options. Embrace partnerships that connect academic research to real-world economic impact. Universities must deliver a more compelling, data-driven, yet humanized story about their institution’s contributions, fostering stronger relationships with government, the private sector, and taxpayers. What's Next This new era will most certainly challenge higher education to rethink its approach to funding, policy, and public engagement. For all institutions, both public and private, there is no place to hide.  As they step into the ring, Higher Education leaders will need lots of support as they look to forge new paths for research, teaching, and community service while engaging their stakeholders in ways that more powerfully communicate their vital contributions to society. The bell has rung—are you ready?

2 min

#ExpertSpotlight: A look at Afghanistan

Afghanistan has been at the center of international focus since 2001, enduring decades of conflict, social change, and efforts toward rebuilding. This topic remains significant as the world reflects on the lasting impact of the Afghanistan war, the country's evolving human rights landscape, and the enduring resilience of its people. For the public, understanding Afghanistan's history and current situation is essential to grasp the broader issues of international policy, humanitarian needs, and global security. This subject also highlights the importance of accountability and the role of the international community. Key story angles that may interest a broad audience include: The impact of foreign intervention on Afghan society: Exploring how two decades of international involvement have reshaped the country politically, economically, and socially. Human rights challenges and progress: Analyzing the state of women’s and minority rights, including access to education and healthcare under various regimes. Refugee crises and displacement: Examining the large-scale displacement of Afghans over the years and the humanitarian response by neighboring and Western nations. The resilience of Afghan culture and identity: Highlighting how art, music, and traditions have survived despite conflict, and how cultural preservation remains vital to Afghan communities. The future of Afghanistan’s youth: Discussing the aspirations and challenges facing a generation born into conflict, and the role of education and innovation. The international community’s role and response: Assessing current global engagement, diplomatic efforts, and the responsibilities of the U.S. and allied countries toward Afghanistan. Connect with an expert about the History of Conflict in Afghanistan:  To search our full list of experts visit www.expertfile.com

2 min

November 11 - a Day of Remembrance

Observed globally, Remembrance Day on November 11 and Veterans Day in America honors the sacrifices of military personnel in times of conflict and serves as a poignant reminder of the human cost of war. Recognized in Commonwealth countries and beyond, this day holds deep significance as nations reflect on peace, memory, and the ongoing impact of past conflicts. Veterans Day is a federal holiday in the United States observed annually on November 11, for honoring military veterans of the United States Armed Forces. Both days matters to the public because it fosters historical awareness, strengthens national unity, and promotes a global dialogue on peace and reconciliation. Key story angles that may interest a broad audience include: The history and symbolism of Remembrance Day: Exploring the origins of the day, the role of the poppy symbol, and its evolution across generations. Global observances and traditions: Highlighting how different countries commemorate November 11 and the unique rituals they observe. Veterans' experiences and perspectives: Featuring stories from veterans and their families, focusing on the impact of service and the importance of recognition and support. The role of education in remembrance: Examining how schools and communities educate younger generations about the history of wars and the importance of honoring service members. Peace-building efforts inspired by Remembrance Day: Showcasing initiatives and organizations working toward conflict resolution, veteran support, and international cooperation. Post-war recovery and mental health: Discussing resources and support systems for veterans dealing with PTSD, physical injuries, and reintegration challenges. Connect with an expert about Remembrance Day : To search our full list of experts visit www.expertfile.com

View all posts