Why generative AI 'hallucinates' and makes up stuff

University of Rochester’s Christopher Kanan says current iterations of AI lack human-like self-awareness and reasoning abilities.

Apr 10, 2025

2 min

Christopher Kanan

Generative artificial intelligence tools, like OpenAI’s GPT-4, are sometimes full of bunk.


Yes, they excel at tasks involving human language, like translating, writing essays, and acting as a personalized writing tutor. They even ace standardized tests. And they’re rapidly improving.


But they also “hallucinate,” which is the term scientists use to describe when AI tools produce information that sounds plausible but is incorrect. Worse, they do so with such confidence that their errors are sometimes difficult to spot.


Christopher Kanan, an associate professor of computer science with an appointment at the Goergen Institute for Data Science and Artificial Intelligence at the University of Rochester, explains that the reasoning and planning capabilities of AI tools are still limited compared with those of humans, who excel at continual learning.


“They don’t continually learn from experience,” Kanan says of AI tools. “Their knowledge is effectively frozen after training, meaning they lack awareness of recent developments or ongoing changes in the world.”


Current generative AI systems also lack what’s known as metacognition.


“That means they typically don’t know what they don’t know, and they rarely ask clarifying questions when faced with uncertainty or ambiguous prompts,” Kanan says. “This absence of self-awareness limits their effectiveness in real-world interactions.”


Kanan is an expert in artificial intelligence, continual learning, and brain-inspired algorithms who welcomes inquiries from journalists and knowledge seekers. He recently shared his thoughts on AI with WAMC Northeast Public Radio and with the University of Rochester News Center.


Reach out to Kanan by clicking on his profile.


Connect with:
Christopher Kanan

Christopher Kanan

Associate Professor of Computer Science

Christopher Kanan's research focuses on deep learning and Artificial Intelligence (AI)

AI and Machine LearningApplied Machine Learning (e.g. Medical Computer Vision)Language-guided Scene UnderstandingArtificial IntelligenceDeep Learning
Powered by

You might also like...

Check out some other posts from University of Rochester

1 min

The truth behind federal disclosure of alien life

With the recent presidential comments on potential alien life, UFO enthusiasts have new hope that finally we’re going to get federal “disclosure” of UFOs, aliens and the great government conspiracy surrounding both. But, as a scientist who studies the search for life in the Universe, the question I have is much simpler: What would disclosure really need to disclose? What is required for actual, factual proof that aliens exist and they’ve been visiting Earth? We’ve already had three years of Congressional hearings on UFOs that have produced zero proof of anything. What we need now is simple: hard physical evidence. That is what disclosure needs to deliver. Not stories about alien spaceships being held by the government, but the actual spaceships themselves. Not stories about alien bodies but the actual icky, gooey bodies with their icky gooey tentacles. If disclosure provides physical evidence that independent laboratories and independent scientists all over the world can verify, then it will live up to its hype. That would make “Disclosure Day” truly history-making.

1 min

Parents — Stop Trying to Be Your Teen's BFF

As teenagers push for independence, many parents respond by trying to become their friends and confidants. University of Rochester psychologist Judi Smetana says blurring the line between warmth and authority can backfire. “It’s great if kids want to disclose to you,” Smetana explains. “But it would be weird for parents to talk about their private lives with their kids. When parents start revealing things about themselves, it’s slippery. Your child should not be your confidant.” Smetana, an expert in adolescent development and parent-teen relationships, emphasizes that closeness and trust are essential — but they are not the same as “friendship.” Teenagers need structure, limits, and clear boundaries as they test autonomy. When parents overshare they risk shifting roles in ways that reduce parental influence. That doesn’t mean parent-child relationships remain rigid forever. The dynamics naturally evolve as children mature into early adulthood. “Let the child take the lead,” Smetana says. “There may show a willingness to become more like friends when parents don’t have the same authority. But there will still be some boundaries.” Her research underscores that healthy parent-teen relationships balance openness with guidance. Trust grows not from collapsing boundaries, but from maintaining them with consistency and care. For reporters covering parenting and adolescent behavior, Smetana is available to discuss: • Healthy boundaries in parent-teen relationships • Oversharing and role confusion in families • Adolescent autonomy and authority • How parent-child dynamics shift in early adulthood Click her profile to connect with her.

1 min

The Secret to Happiness? Feeling Loved.

After more than 50 years studying close relationships, University of Rochester psychologist Harry Reis has reached a deceptively simple conclusion: Happy people feel loved. That conclusion became the jumping-off point for a new book Reis co-wrote, “How to Feel Loved: The Five Mindsets That Get You More of What Matters Most” (Harper 2026), which blends decades of research on happiness and human connection. In it, Reis and his co-author, Sonja Lyubomirsky, a psychologist at the University of California, Riverside, outline five research-backed mindsets that strengthen connection: sharing authentically, listening to people, practicing radical curiosity, approaching others with an open heart, and recognizing human complexity. The book was recently featured in The New York Times, which noted that the authors contend giving and receiving love function together like a seesaw: You lift a person up with the weight of your curiosity and attentiveness — and they do the same in turn. “The other side is very important also,” Reis told The Times. “To be sharing what’s important to you, to be sharing what you’re concerned about, so it can really become a two-way street.” Reis, who leads groundbreaking research on close relationships, is available to discuss: • The science of feeling loved vs. being loved • How digital distraction undermines connection • AI companionship and its psychological limits • Practical ways to build stronger, more resilient relationships • The link between love, happiness, and health Journalists writing about love and relationships can contact Reis by clicking on his profile.

View all posts