Featured Post from University of Rochester

Why generative AI 'hallucinates' and makes up stuff

University of Rochester’s Christopher Kanan says current iterations of AI lack human-like self-awareness and reasoning abilities.

Apr 10, 2025

2 min

Christopher Kanan

Generative artificial intelligence tools, like OpenAI’s GPT-4, are sometimes full of bunk.


Yes, they excel at tasks involving human language, like translating, writing essays, and acting as a personalized writing tutor. They even ace standardized tests. And they’re rapidly improving.


But they also “hallucinate,” which is the term scientists use to describe when AI tools produce information that sounds plausible but is incorrect. Worse, they do so with such confidence that their errors are sometimes difficult to spot.


CaptionResizeWrap TextRemove

Christopher Kanan, an associate professor of computer science with an appointment at the Goergen Institute for Data Science and Artificial Intelligence at the University of Rochester, explains that the reasoning and planning capabilities of AI tools are still limited compared with those of humans, who excel at continual learning.


“They don’t continually learn from experience,” Kanan says of AI tools. “Their knowledge is effectively frozen after training, meaning they lack awareness of recent developments or ongoing changes in the world.”


Current generative AI systems also lack what’s known as metacognition.


“That means they typically don’t know what they don’t know, and they rarely ask clarifying questions when faced with uncertainty or ambiguous prompts,” Kanan says. “This absence of self-awareness limits their effectiveness in real-world interactions.”


Kanan is an expert in artificial intelligence, continual learning, and brain-inspired algorithms who welcomes inquiries from journalists and knowledge seekers. He recently shared his thoughts on AI with WAMC Northeast Public Radio and with the University of Rochester News Center.


Reach out to Kanan by clicking on his profile.


Connect with:
Christopher Kanan

Christopher Kanan

Associate Professor of Computer Science

Christopher Kanan's research focuses on deep learning and Artificial Intelligence (AI)

AI and Machine LearningApplied Machine Learning (e.g. Medical Computer Vision)Language-guided Scene UnderstandingArtificial IntelligenceDeep Learning

You might also like...

Check out some other posts from University of Rochester

1 min

Companies pay a price for taking a stand on polarizing issues

News that Target’s sluggish first quarter earnings were partly due to consumers protesting the retail giant’s rollback on diversity, equity, and inclusion (DEI) policies, may have some people wondering why any company would take a position on a politically divisive issue. David Primo, a professor of political science and business administration at the University of Rochester, says political polarization across the country has forced the hands of some corporate executives to take a stand. Perhaps not surprisingly, Americans are split on whether they want big business wading into social and political minefields. “It’s pretty straight forward to think that a corporation ought to be taking positions on issues related to its core business operations,” Primo says. “The challenge for an executive, who has a fiduciary responsibility to the company, is knowing where to draw the line.” Primo regularly shares his insights on a variety of topics with business journalists and political reporters. Recently, he spoke to USA Today about consumers boycotting major retailers. Contact him by clicking on his profile.

1 min

Covering the Conclave? Our Expert Can Help.

The world is watching the Vatican as cardinals from across the globe gather for the papal conclave. The monumental event, which involves cardinals closing themselves off in the Sistine Chapel to elect a new pope, is steeped in history, mystery, and speculation. The new pontiff will be expected to make difficult decisions about the future direction of the Catholic church, which has almost 1.4 billion followers worldwide, and address the Vatican's strained finances and its sexual abuse scandals. If you're a reporter looking for an expert who can provide valuable insight, perspective and opinion on any angle of the events unfolding in Vatican City, consider reaching out to Jack Downey, the John Henry Newman Professor of Roman Catholic Studies at the University of Rochester.  Downey and his scholarship have been featured in media outlets such as The Washington Post, National Public Radio, and Time Magazine. Simply click on his icon now to arrange an interview today.

1 min

Research Matters: Ultra-conductive molecule sets stage for post-silicon computing era

A research team has uncovered what it believes is “the world’s most electrically conductive organic molecule,” a discovery that opens new possibilities for building smaller, more powerful, and more energy-efficient computers. It could also allow computer chip manufacturers to eliminate their reliance on silicon and metal as conductors. “Molecules are nature’s tiniest, mightiest, and most configurable building blocks and can be engineered to build ultra-compact, ultra-efficient technology for everything from computers to quantum devices,” said Ignacio Franco, who was part of the research team that was led by scientists at the University of Miami. Their research was detailed in a paper published in the Journal of the American Chemical Society. The molecule, which is composed of chemical elements found in nature, including carbon, sulfur, and nitrogen, can carry electrical current over record-breaking distances without losing efficiency. Using molecular materials in electronic chips offers several advantages. They consume less power. They can be more easily customized than silicon. They are more environmentally friendly. And, perhaps most importantly to manufacturers, they are potentially cheaper to produce. “This molecular design overcomes many of the big issues that for decades have prevented the use of molecules in electronics,” Franco said. To learn more about this ground-breaking research, read about it at the University of Rochester News Center, and contact Franco at ignacio.franco@rochester.edu.

View all posts
Powered by