Featured Post from ExpertFile

A Big Week in the Measurement of Expertise: How the UK Research Excellence Framework (REF) Results Will Impact Universities

May 9, 2022

4 min

Justin Shaw

How should we measure faculty expertise? This week the UK provides its answer to this question via its highly significant and formal (government-directed) assessment of academic research - which grades academic teams on a scale of 1* to 4* for their ability to deliver, share and create impact globally outstanding research.


This process is known as the REF (the Research Excellence Framework) - and the results will be publicly released this Thursday (12th May) with universities themselves finding out how they’ve performed in advance today (Monday 9th May). The process was last carried out 8 years ago and has been delayed by a year due to the pandemic.



Why is the Research Excellence Framework (REF) Significant?


The Research Excellence Framework steers the level of UK public funds - allocated via research councils - that will be invested in research for each academic department (or so-called “Unit of Assessment”) for the next few years. It is also a way of comparing performance against other universities that are offering similar research expertise, and of strengthening (or weakening) global research reputations.


During the next three days, UK universities will be digging into the detail of their REF gradings and the accompanying feedback. There will be some very nervous university leaders and research heads delving into why this peer-assessed review of their research has not gone as well as they expected and why their percentages in each of the four grade areas have dropped - or even been given the “unclassified” career-damaging stamp.


How are the REF Scores for Universities Determined?


The measurement process is based on three aspects:


  1. Quality of outputs (such as: publications, performances, and exhibitions),
  2. Impact beyond academia
  3. The environment that supports research


The preparation, participation, and assessment process takes a massive amount of time, attention and energy. Last time (2014) there were 1,911 submissions to review. Research teams, designated REF leaders and senior staff will have spent long hours across many months preparing their submissions and making sure they are presenting hard evidence and the best case possible to meet the above criteria at the highest possible level. There are 34 subject areas that are covered in the latest REF - and three tiers of expert panels (some with about 20 or more senior academics, international subject leaders, and research users) will have reviewed each submission and compared notes to come to decisions.


How do these Key Categories within the REF Contribute to the Rating for a University?


The Research Excellence Framework is actually an intensive and highly important approach to expert assessment. These are the key factors and their definitions (with the assigned weighting of each of the criteria in steering final grades):


  1. Outputs (60%): the quality of submitted research outputs in terms of their ‘originality, significance and rigour’, with reference to international research quality standards. This element will carry a weighting of 60 per cent in the overall outcome awarded to each submission.
  2. Impact (25%): the ‘reach and significance’ of impacts on the economy, society, culture, public policy or services, health, the environment or quality of life that were underpinned by excellent research conducted in the submitted unit. This element carries a weighting of 25 per cent.
  3. Environment (15%): the research environment in terms of its ‘vitality and sustainability’, including the approach to enabling impact from its research, and its contribution to the vitality and sustainability of the wider discipline or research base. This element accounts for 15 per cent.


Taking a Closer Look at the Categories - Are We Focusing Enough on Research Impact?


In 2014 a formal review was carried out in order to improve and evolve the REF process which made a number of recommendations. Most notably the weighting for “impact” was increased by five percent, with “outputs” being reduced by the same percentage. This is certainly a recognition that the external contribution difference that research makes is more important - but is it enough? Should there be greater emphasis on the return on investment from a beneficiaries and user experience perspective?


Many argue that academic research should retain a strong element of ‘”blue sky” experimentation - where outright evidence of impact may take several years (even decades) and so can’t demonstrate such immediate value.


A particularly notable benefit of the timing of the COVID-19 pandemic and the effect of this in REF deadlines has allowed the extended assessment period for ‘proof of impact’ from 1 August 2013 to 31 December 2020. This is an extension from the previous end date of 31 July 2020. The extension has been put in place to enable case studies affected by, or focusing on the response to, COVID-19 to be assessed in REF 2021.


Going back to the original question: how should we measure faculty expertise? It will be interesting to monitor the views and responses of university leaders and faculty members at the end of this week as to whether they feel that - standing back from it all - this UK-centric method of measurement is the best that can be done, a neat compromise or isn’t really what we really need.


For more information on the Research Excellence Framework visit www.ref.ac.uk/


Justin Shaw

Justin is UK and Ireland Development Director for ExpertFile and Chief Higher Education Consultant at Communications Management. An authority on University strategy and communications, he has worked in and with leadership teams at UK universities for over 30 years. In his role he has advised universities on how to promote their expertise and on communications strategies related to the REF.


Connect with:
Justin Shaw

Justin Shaw

Chief Higher Education Consultant (Communications Management) and UK Development Director

Specialist in higher education, communications, reputation and marketing of academic experts

You might also like...

Check out some other posts from ExpertFile

2 min

#ExpertSpotlight: The Day That Redefined America: 9/11 and Its Lasting Impact

September 11, 2001 marked a pivot in American history—a day when the nation’s sense of safety was shattered, and its collective identity reshaped. The attacks triggered sweeping changes in security, government authority, social behavior, and even cultural cohesion. Today, the legacy of 9/11 lives on in how we remember, govern, and connect. A Nation in Shock—and Unity On that fall morning, the U.S. witnessed a tragedy that killed nearly 3,000 people and devastated the nation’s psyche. In the immediate aftermath, grief turned into solidarity—as most Americans tuned into televised coverage, felt sadness, anger, and fear, yet paradoxically came together in an extraordinary show of patriotism and trust in institutions. In the months that followed, confidence in government reached levels unseen in decades—fueled by mourning, resolve, and a collective desire to heal. The Rise of “Homeland Security” & Executive Power Almost immediately, the U.S. government unleashed legal and structural transformations. The USA PATRIOT Act, passed just weeks later in October 2001, significantly expanded surveillance and law enforcement powers for domestic security—raising ongoing concerns about civil liberties. Alongside this, the Department of Homeland Security was created in 2002, bringing together 22 agencies to coordinate security against future threats and reinforcing a new era of national vigilance. Economic Shock and Air Travel Overhaul The attacks triggered immediate economic consequences: U.S. stock markets plunged, airlines and insurers suffered heavy losses, and GDP forecasts were revised downward. Meanwhile, the aviation sector underwent a rapid and lasting modernization in security protocols and flight routing. Notably, Canada’s Operation Yellow Ribbon absorbed diverted flights in the chaos, highlighting international cooperation amid crisis. Legal Precedents and Global Conflict Congress quickly approved the broad-ranging Authorization for Use of Military Force (AUMF), enabling the U.S. to pursue adversaries globally—a mandate that has since been interpreted far beyond its original context, shaping nearly two decades of “forever wars.” These legal expansions—and the accompanying conflicts in Afghanistan and Iraq—signaled a new global posture that redefined American foreign policy. Remembering, Serving, and the Legacy Continues In the years since, public memory of 9/11 has evolved—from solemn remembrance to proactive service. Patriot Day, proclaimed a national day of mourning and service, now encourages millions of Americans each year to volunteer in honor of those lost and the unity felt afterward. These acts of service continue to reflect the enduring spirit of resilience and community. Connect with our experts on the history, significance, and lasting impact of 9/11 on American life and policy. Check out our experts here : www.expertfile.com

2 min

Are you ready for some football?

From its modest beginnings in the late 19th century to becoming America’s most-watched sport, professional football has not only entertained generations but also transformed communities, economies, and culture. Today, the National Football League (NFL) stands as a global brand, symbolizing both the triumphs and tensions of American life. Early Beginnings Professional football took root in the 1890s, when athletic clubs in Pennsylvania began paying players under the table. In 1920, a group of teams formed the American Professional Football Association, later renamed the NFL in 1922. Early decades were marked by instability, but the league grew steadily, and by the 1950s, with the rise of television, football began capturing national attention. The 1958 NFL Championship Game—dubbed the “Greatest Game Ever Played”—cemented football as America’s sport of the future, setting the stage for the AFL-NFL rivalry of the 1960s and the eventual Super Bowl, first played in 1967. Economic Impact Football is now one of the most powerful economic engines in American sports. The NFL generates more than $18 billion annually, with billions flowing into local economies through stadium construction, tourism, and broadcasting rights. Super Bowl weekend alone can inject hundreds of millions of dollars into host cities. The game has also reshaped industries—from sports broadcasting and advertising to fantasy leagues and legalized sports betting. It drives sponsorships, merchandise sales, and jobs connected to media, hospitality, and infrastructure. Social and Cultural Significance Football’s reach extends beyond the field. It has served as a stage for some of America’s most important social conversations—from racial integration in the 1940s, to gender roles in sports media, to the modern debates over player safety and activism. Figures like Jackie Robinson in baseball broke barriers, but in football, trailblazers such as Kenny Washington (first African American to reintegrate the NFL in 1946) helped reshape opportunity and inclusion. In more recent years, high-profile advocacy by players on issues ranging from racial justice to mental health has placed the sport squarely in the middle of national debates. At the same time, concerns about concussions and long-term health risks have fueled public dialogue on workplace safety and medical ethics, echoing issues seen across many industries. A Lasting Legacy Football is more than a game. It has become a unifying tradition—whether through Friday night lights in small towns, college rivalries that galvanize entire states, or Super Bowl Sunday as an unofficial national holiday. Its economic and cultural significance continues to expand, reflecting both America’s passion for competition and its ongoing social evolution. Connect with our experts about the history and significance of professional football in America: Check out our experts here : www.expertfile.com

2 min

ExpertSpotlight: The History of Labor Day

What began as a modest parade in New York City has grown into a national holiday that honors the contributions of American workers and continues to spark conversations about labor rights today. Observed on the first Monday of September, Labor Day is both a tribute to the workforce and a cultural milestone marking the close of summer. From Parade to Holiday The first Labor Day celebration took place on September 5, 1882, when roughly 10,000 workers marched through New York City in a demonstration organized by the Central Labor Union. The parade, followed by a picnic and speeches, was designed to showcase the unity and strength of trade and labor organizations. The origins of the idea remain contested. Some credit Peter J. McGuire, co-founder of the United Brotherhood of Carpenters, while others point to Matthew Maguire, a machinist and secretary of the Central Labor Union. Regardless of its champion, the concept spread quickly. By the late 1880s, states began adopting Labor Day as an official holiday. In 1894, following a wave of labor unrest that included the Pullman Strike, President Grover Cleveland signed legislation declaring the first Monday in September a federal holiday. Labor Day vs. May Day Unlike May Day (May 1)—which became closely associated with international labor movements and the more radical legacy of the Haymarket Affair of 1886—Labor Day was intended as a uniquely American holiday. Its September placement emphasized unity and recognition without the confrontational overtones of May Day. Over time, this distinction gave Labor Day a broader cultural resonance in the United States. A Living Tradition While barbecues, parades, and retail sales now dominate many Labor Day weekends, the holiday’s deeper meaning endures. It is a reminder of the hard-won gains of the labor movement, from the eight-hour workday to workplace safety protections, as well as the continuing debates over wages, unionization, and economic fairness. Even traditions like the etiquette rule of not wearing white after Labor Day reflect how the holiday shaped cultural norms at the turn of the 20th century. Today, beyond its role as summer’s unofficial finale, Labor Day continues to honor the dignity and achievements of working people across the country. Connect with our experts about the History of Labor Day. Check out our experts here : www.expertfile.com

View all posts
Powered by