Featured Post from University of Rochester

Why generative AI 'hallucinates' and makes up stuff

University of Rochester’s Christopher Kanan says current iterations of AI lack human-like self-awareness and reasoning abilities.

Apr 10, 2025

2 min

Christopher Kanan

Generative artificial intelligence tools, like OpenAI’s GPT-4, are sometimes full of bunk.


Yes, they excel at tasks involving human language, like translating, writing essays, and acting as a personalized writing tutor. They even ace standardized tests. And they’re rapidly improving.


But they also “hallucinate,” which is the term scientists use to describe when AI tools produce information that sounds plausible but is incorrect. Worse, they do so with such confidence that their errors are sometimes difficult to spot.


CaptionResizeWrap TextRemove

Christopher Kanan, an associate professor of computer science with an appointment at the Goergen Institute for Data Science and Artificial Intelligence at the University of Rochester, explains that the reasoning and planning capabilities of AI tools are still limited compared with those of humans, who excel at continual learning.


“They don’t continually learn from experience,” Kanan says of AI tools. “Their knowledge is effectively frozen after training, meaning they lack awareness of recent developments or ongoing changes in the world.”


Current generative AI systems also lack what’s known as metacognition.


“That means they typically don’t know what they don’t know, and they rarely ask clarifying questions when faced with uncertainty or ambiguous prompts,” Kanan says. “This absence of self-awareness limits their effectiveness in real-world interactions.”


Kanan is an expert in artificial intelligence, continual learning, and brain-inspired algorithms who welcomes inquiries from journalists and knowledge seekers. He recently shared his thoughts on AI with WAMC Northeast Public Radio and with the University of Rochester News Center.


Reach out to Kanan by clicking on his profile.


Connect with:
Christopher Kanan

Christopher Kanan

Associate Professor of Computer Science

Christopher Kanan's research focuses on deep learning and Artificial Intelligence (AI)

AI and Machine LearningApplied Machine Learning (e.g. Medical Computer Vision)Language-guided Scene UnderstandingArtificial IntelligenceDeep Learning

You might also like...

Check out some other posts from University of Rochester

1 min

Covering "meme stocks"? Our expert can help.

"Meme stock" fever in the financial markets is back and hotter than ever. If you're a reporter covering the trend now or in the future (because history suggests it'll boomerang), the University of Rochester invites you to reach out to Daniel Burnside, clinical professor of finance at the Simon School of Business, for insight.  Burnside has held various roles in the investment, risk management and financial planning fields, and has worked extensively with both individual and institutional clientele. He recently helped Forbes explain the trend affecting stocks like Krispy Kreme and Kohl's and other brands, and offered advice on how investors should proceed. "You’re not investing in fundamentals, you’re betting on crowd psychology and social media dynamics,” Burnside told Forbes.  Burnside encouraged potential investors to “keep it small.” “No more than, say, 5% of your portfolio,” he added. “It’s speculation, not strategy. If you can’t afford to lose it, you can’t afford to meme it.”  Contact Burnside by clicking on is profile.

1 min

What did Ozzy Osbourne mean to music?

The world lost a heavy metal pioneer on Tuesday when Ozzy Osbourne, the frontman for the group Black Sabbath who went on to astounding commercial success as a solo artist, died at the age of 76. University of Rochester music professor John Covach can help frame the contributions the self-proclaimed “Prince of Darkness” made to the genre of heavy metal and popular music. “What’s That Sound?: An Introduction to Rock and Its History,” which Covach wrote with Carleton College professor Andrew Flory, is widely considered a landmark history of rock music. Covach can help distill heavy metal’s history and influences and Osbourne’s place in both. He recently helped The New York Times explain what made the album “Pet Sounds” a masterpiece for Beach Boys chief songwriter Brian Wilson. He has offered commentary to the New York Daily News on why artists might relinquish ownership of their music. Last year, he offered thoughts to The Boston Globe on the timeless appeal of aging rock ‘n’ rollers who are still packing arenas. Connect with Covach by clicking on his profile.

1 min

As Senate debates Trump's 'Big, Beautiful Bill,' expert Gerald Gamm offers insight

President Donald Trump’s agenda hangs in the balance this week as Senate Republicans race to lock down the votes to pass their major tax and domestic policy bill by the president’s July 4 deadline. Republicans are holding firm against Democrats’ efforts to challenge elements of the measure, particularly its cuts to Medicaid and federal nutrition programs, as well as tax cuts for the wealthy. But the G.O.P. is also witnessing nagging reservations within its own ranks, as fiscal hawks are upset that the bill could pile more than $3 trillion onto the national debt. University of Rochester political scientist Gerald Gamm is watching the deliberations and political maneuverings closely, and is in a unique position to lend insight to reportage on the negotiations. Gamm is a co-author of Steering the Senate (Cambridge University Press, June 2025). The book has received high praise from a multitude of sources, and has been called "essential reading for all who care — or worry — about the past and future of institutional leadership and capacity on Capitol Hill," "the best book we have about the organizational development of the Senate," and "a masterpiece . . . that unearths new information on the emergence of leadership institutions and the role of parties and showing their relevance for the Senate of today." Gamm is available for interviews and can be contacted by email at gerald.gamm@rochester.edu or by clicking on his profile.

View all posts
Powered by