Featured Post from University of Rochester

Why generative AI 'hallucinates' and makes up stuff

University of Rochester’s Christopher Kanan says current iterations of AI lack human-like self-awareness and reasoning abilities.

Apr 10, 2025

2 min

Christopher Kanan

Generative artificial intelligence tools, like OpenAI’s GPT-4, are sometimes full of bunk.


Yes, they excel at tasks involving human language, like translating, writing essays, and acting as a personalized writing tutor. They even ace standardized tests. And they’re rapidly improving.


But they also “hallucinate,” which is the term scientists use to describe when AI tools produce information that sounds plausible but is incorrect. Worse, they do so with such confidence that their errors are sometimes difficult to spot.


CaptionResizeWrap TextRemove

Christopher Kanan, an associate professor of computer science with an appointment at the Goergen Institute for Data Science and Artificial Intelligence at the University of Rochester, explains that the reasoning and planning capabilities of AI tools are still limited compared with those of humans, who excel at continual learning.


“They don’t continually learn from experience,” Kanan says of AI tools. “Their knowledge is effectively frozen after training, meaning they lack awareness of recent developments or ongoing changes in the world.”


Current generative AI systems also lack what’s known as metacognition.


“That means they typically don’t know what they don’t know, and they rarely ask clarifying questions when faced with uncertainty or ambiguous prompts,” Kanan says. “This absence of self-awareness limits their effectiveness in real-world interactions.”


Kanan is an expert in artificial intelligence, continual learning, and brain-inspired algorithms who welcomes inquiries from journalists and knowledge seekers. He recently shared his thoughts on AI with WAMC Northeast Public Radio and with the University of Rochester News Center.


Reach out to Kanan by clicking on his profile.


Connect with:
Christopher Kanan

Christopher Kanan

Associate Professor of Computer Science

Christopher Kanan's research focuses on deep learning and Artificial Intelligence (AI)

AI and Machine LearningApplied Machine Learning (e.g. Medical Computer Vision)Language-guided Scene UnderstandingArtificial IntelligenceDeep Learning

You might also like...

Check out some other posts from University of Rochester

1 min

'Brain-on-a-chip': Engineering tomorrow’s breakthroughs today

A “brain-on-a-chip” technology might sound like science fiction, but it’s real-world hope. James McGrath, a biomedical engineer at the University of Rochester, leads a team that develops micro-scale tissue chips to study diseases in lieu of conducting animal experiments. The team’s “brain-on-a-chip” model replicates the blood-brain barrier — the critical membrane separating the brain from the bloodstream — to mimic how the barrier functions under healthy conditions and the duress of infections, toxins, and immune responses that can weaken it. Recent findings from McGrath’s team show how systemic inflammation, such as that caused by sepsis, can compromise the barrier and harm brain cells. The researchers also demonstrated how pericytes — supportive vascular cells — can help repair barrier damage, an insight that could guide new therapies for Alzheimer’s and Parkinson’s. The research culminated in a pair of recent studies published in Advanced Science and Materials Today Bio. “We hope that by building these tissue models in chip format, we can arrange many brain models in a high-density array to screen candidates for neuroprotective drugs and develop brain models with diverse genetic backgrounds,” McGrath says. McGrath aims to transform how scientists test drugs and predict neurological side effects before they occur — helping rewrite how we study, and one day safeguard, the brain. Contact McGrath by clicking on his profile

1 min

Government Shutdown: With Senate in the spotlight, expert Gerald Gamm offers insight

The Senate returned to Capitol Hill on the first day of a government shutdown to vote on two funding bills aimed at getting the government up and running amid an ongoing blame game among congressional leaders. University of Rochester political scientist Gerald Gamm is watching the deliberations and political maneuverings closely and is in a unique position to lend insight on the negotiations and gamesmanship. Gamm is a co-author of Steering the Senate (Cambridge University Press, June 2025). The book has received high praise from a multitude of sources, and has been called "essential reading for all who care — or worry — about the past and future of institutional leadership and capacity on Capitol Hill," "the best book we have about the organizational development of the Senate," and "a masterpiece . . . that unearths new information on the emergence of leadership institutions and the role of parties and showing their relevance for the Senate of today." Gamm is available for interviews and can be contacted by clicking on his profile.

2 min

How well-meaning parents sink their child's chances of college admission

"What's the number one parent behavior that will hurt a child's chance of admission?"  The question was posed to Robert Alexander, the University of Rochester vice provost and dean of enrollment management, on the podcast "College Knowledge." He was quick to answer. "Parents needs to be empowering the student and not driving the conversation" when it comes to choosing a college and engaging with college admissions professionals, Alexander replied. He explained that too many parents have a narrow view of what they deem as "acceptable" institutions of higher education for their child. They come by it honestly, he said, with most of their knowledge derived from their own college searches and dreams a generation ago.  They tend to home in on 20 or 30 schools when, in reality, the universe of quality colleges and universities has expanded exponentially since the days these parents were considering where to study, Alexander said. "Widening that lends and thinking beyond the 20 or 30 schools they know a lot about or think they know a lot about or see a lot of bumper stickers for, that's really important," Alexander said. "There are many more really great institutions and what's important is not your child getting into 'the best college' that they can, but instead their child finding the best fit at one or maybe a range of different institutions." Alexander is an expert in undergraduate admissions and enrollment management who speaks on the subjects to national audiences and whose work has been published in national publications. Click his profile to reach him.

View all posts
Powered by