Virtual reality training tool helps nurses learn patient-centered care

Apr 7, 2025

5 min



University of Delaware computer science students have developed a digital interface as a two-way system that can help nurse trainees build their communication skills and learn to provide patient-centered care across a variety of situations. This virtual reality training tool would enable users to rehearse their bedside manner with expectant mothers before ever encountering a pregnant patient in person.


The digital platform was created by students in Assistant Professor Leila Barmaki’s Human-Computer Interaction Laboratory, including senior Rana Tuncer, a computer science major, and sophomore Gael Lucero-Palacios.


Lucero-Palacios said the training helps aspiring nurses practice more difficult and sensitive conversations they might have with patients.


"Our tool is targeted to midwifery patients,” Lucero-Palacios said. “Learners can practice these conversations in a safe environment. It’s multilingual, too. We currently offer English or Turkish, and we’re working on a Spanish demo.”


This type of judgement-free rehearsal environment has the potential to remove language barriers to care, with the ability to change the language capabilities of an avatar. For instance, the idea is that on one interface the “practitioner” could speak in one language, but it would be heard on the other interface in the patient’s native language. The patient avatar also can be customized to resemble different health stages and populations to provide learners a varied experience.


Last December, Tuncer took the project on the road, piloting the virtual reality training program for faculty members in the Department of Midwifery at Ankara University in Ankara, Turkey. With technical support provided by Lucero-Palacios back in the United States, she was able to run a demo with the Ankara team, showcasing the UD-developed system’s interactive rehearsal environment’s capabilities.


Last winter, University of Delaware senior Rana Tuncer (left), a computer science major, piloted the virtual reality training program for Neslihan Yilmaz Sezer (right), associate professor in the Department of Midwifery, Ankara University in Ankara, Turkey.


Meanwhile, for Tuncer, Lucero-Palacios and the other students involved in the Human-Computer Interaction Laboratory, developing the VR training tool offered the opportunity to enhance their computer science, data science and artificial intelligence skills outside the classroom.


“There were lots of interesting hurdles to overcome, like figuring out a lip-sync tool to match the words to the avatar’s mouth movements and figuring out server connections and how to get the languages to switch and translate properly,” Tuncer said.


Lucero-Palacios was fascinated with developing text-to-speech capabilities and the ability to use technology to impact patient care.


“If a nurse is well-equipped to answer difficult questions, then that helps the patient,” said Lucero-Palacios.


The project is an ongoing research effort in the Barmaki lab that has involved many students. Significant developments occurred during the summer of 2024 when undergraduate researchers Tuncer and Lucero-Palacios contributed to the project through funding support from the National Science Foundation (NSF). However, work began before and continued well beyond that summer, involving many students over time. UD senior Gavin Caulfield provided foundational support to developing the program’s virtual environment and contributed to development of the text-to-speech/speech-to-text capabilities. CIS doctoral students Fahim Abrar and Behdokht Kiafar, along with Pinar Kullu, a postdoctoral fellow in the lab, used multimodal data collection and analytics to quantify the participant experience.


“Interestingly, we found that participants showed more positive emotions in response to patient vulnerabilities and concerns,” said Kiafar.



The work builds on previous research Barmaki, an assistant professor of computer and information sciences and resident faculty member in the Data Science Institute, completed with colleagues at New Jersey Institute of Technology and University of Central Florida in an NSF-funded project focused on empathy training for healthcare professionals using a virtual elderly patient. In the project, Barmaki employed machine learning tools to analyze a nursing trainee’s body language, gaze, verbal and nonverbal interactions to capture micro-expressions (facial expressions), and the presence or absence of empathy.


“There is a huge gap in communication when it comes to caregivers working in geriatric care and maternal fetal medicine,” said Barmaki. “Both disciplines have high turnover and challenges with lack of caregiver attention to delicate situations.”


UD senior Rana Tuncer (center) met with faculty members Neslihan Yilmaz Sezer (left) and Menekse Nazli Aker (right) of Ankara University in Ankara, Turkey, to educate them about the virtual reality training tool she and her student colleagues have developed to enhance patient-centered care skills for health care professionals.


When these human-human interactions go wrong, for whatever reason, it can extend beyond a single patient visit. For instance, a pregnant woman who has a negative health care experience might decide not to continue routine pregnancy care.


Beyond the project’s potential to improve health care professional field readiness, Barmaki was keen to note the benefits of real-world workforce development for her students.


“Perceptions still exist that computer scientists work in isolation with their computers and rarely interact, but this is not true,” Barmaki said, pointing to the multi-faceted team members involved in this project. “Teamwork is very important. We have a nice culture in our lab where people feel comfortable asking their peers or more established students for help.”


Barmaki also pointed to the potential application of these types of training environments, enabled by virtual reality, artificial intelligence and natural language processing, beyond health care. With the framework in place, she said, the idea could be adapted for other types of training involving human-human interaction, say in education, cybersecurity, even in emerging technology such as artificial intelligence (AI). Keeping people at the center of any design or application of this work is critical, particularly as uses for AI continue to expand.


“As data scientists, we see things as spreadsheets and numbers in our work, but it’s important to remember that the data is coming from humans,” Barmaki said.


While this project leverages computer vision and AI as a teaching tool for nursing assistants, Barmaki explained this type of system can also be used to train AI and to enable more responsible technologies down the road. She gave the example of using AI to study empathic interactions between humans and to recognize empathy.


“This is the most important area where I’m trying to close the loop, in terms of responsible AI or more empathy-enabled AI,” Barmaki said. “There is a whole area of research exploring ways to make AI more natural, but we can’t work in a vacuum; we must consider the human interactions to design a good AI system.”


Asked whether she has concerns about the future of artificial intelligence, Barmaki was positive.


“I believe AI holds great promise for the future, and, right now, its benefits outweigh the risks,” she said.

Powered by

You might also like...

Check out some other posts from University of Delaware

Giving Tuesday: The surprising impact of seemingly small acts of kindness featured image

3 min

Giving Tuesday: The surprising impact of seemingly small acts of kindness

Giving Tuesday was created to encourage generosity in the midst of all the buying that takes place on Black Friday and Cyber Monday. But do people accurately understand the effect that giving has? University of Delaware researcher Amit Kumar can help answer that question. He studies the psychology of giving and why people often underestimate the positive impact of their kindness. Kumar, a professor of marketing and psychological and brain sciences, has collaborated on studies examining why people help others, why they sometimes underestimate the impact of giving and how positive social interactions affect well-being. But even when people take the time to do something kind for others, Kumar’s research shows they may not grasp the difference it makes. "When people experience generosity from someone else, it can encourage them to pass that kindness along.” - Amit Kumar, University of Delaware In one study, Kumar and his collaborators conducted a series of experiments, including real-world studies in which participants gave hot chocolate or small gifts to strangers. Their findings: • Recipients felt more positive about acts of kindness than the givers anticipated. • The warmth and thoughtfulness behind an act often matter more than the giver realizes. • This tendency extends beyond gifts and random acts of kindness. People may hesitate to reach out to an old friend, offer support or express appreciation because they worry about being awkward, saying the wrong thing or inconveniencing someone. People can sometimes underestimate the benefits or overestimate the costs of engaging in other-oriented behavior. • As a result, they may miss opportunities to make a meaningful difference in someone else's life. Kumar says this is why Giving Tuesday can improve well-being. While charitable contributions are one expression of giving, Kumar's research shows how everyday acts of kindness and human connection can benefit both the giver and the recipient. Kumar can discuss: • Giving Tuesday and the psychology of giving: What research tells us about generosity and the benefits of helping others. • The psychology of kindness: Why people underestimate the positive impact of their actions on others. • The prosociality paradox: Why people sometimes hesitate to help, reach out or express appreciation, even when they want to, and would likely be better off if they did. • Happiness and well-being: How kindness and positive social interactions benefit both givers and recipients. • The ripple effect of generosity: How small acts of kindness can encourage others to pay it forward. Available for media interviews Amit Kumar is available for full-length interviews and guest appearances on television, radio, podcasts and online video, including live or recorded segments. He can discuss the psychology of generosity, kindness, happiness, social connection and holiday gift-giving. Media appearances and related coverage: • PHL17 Morning News: Gratitude May Be the Key to Finding Holiday Happiness • Hidden Brain: A Secret Source of Connection • Scientific American: Kindness Can Have Unexpectedly Positive Consequences • Gifting Experiences for the Holidays • Original research: A Little Good Goes an Unexpectedly Long Way Suggested expert commentary The following proposed quotes are available for use in stories with attribution to Amit Kumar: • "We tend to focus on what we're giving when we perform an act of kindness, and not the warmth conveyed by our giving. As a result, we can underestimate how meaningful such gestures can be to the people receiving them." • “Kindness can be rewarding for both people involved. Helping someone else can create a positive social connection that benefits the recipient as well as the person offering help.” • “A seemingly small act of kindness can have effects that extend beyond the initial interaction. When people experience generosity from someone else, it can encourage them to pass that kindness along.” To reach Kumar directly and arrange an interview, visit his profile and click on the "contact" button. Interested reporters can also send an email to MediaRelations@udel.edu.

What Voyager has taught us about the Sun and the space between stars featured image

2 min

What Voyager has taught us about the Sun and the space between stars

Nearly 50 years after their launch, NASA's Voyager spacecraft continue to expand our understanding of the outer reaches of our solar system and the space between stars. University of Delaware physicist Bennett Maruca, an expert on the Sun, the solar wind and Earth's upper atmosphere, can explain the science behind this extraordinary mission, including what Voyager has revealed about the solar wind and its journey from the Sun into interstellar space. Voyager 1, the farthest human-made object from Earth, has reached a distance of one light-day from our planet, meaning a signal traveling at the speed of light takes 24 hours to reach the spacecraft. Maruca and his students have used data from the Voyager spacecraft to investigate how the solar wind, the continuous flow of material from the Sun, changes as it travels toward the outer boundaries of the solar system. He also serves on the science teams of multiple NASA missions, including Parker Solar Probe, Wind and HelioSwarm. Originally launched to explore the outer planets, Voyager 1 and 2 continued their journeys long after completing their planetary flybys. Both spacecraft eventually traveled beyond the reach of the solar wind and into the interstellar medium, the material between stars in our galaxy. Their continuing observations offer an unprecedented opportunity to study this largely unexplored environment. Maruca can discuss Voyager's remarkable longevity and scientific legacy, the interaction between the solar wind and interstellar space, and what decades of spacecraft observations have taught scientists about our Sun and its influence far beyond Earth. Maruca is available for live or recorded interviews and expert commentary. To reach him directly and arrange an interview, visit his profile and click on the "contact" button. Interested reporters can also email MediaRelations@udel.edu.

How Electric Vehicles Could Power Homes and Support the Electric Grid featured image

1 min

How Electric Vehicles Could Power Homes and Support the Electric Grid

University of Delaware researchers Willett Kempton and Rodney McGee are advancing technologies and standards that allow electric vehicles to send electricity back to homes and the power grid. Known as vehicle-to-grid (V2G) technology, this approach could help consumers manage electricity costs, provide backup power and improve grid reliability. Kempton pioneered vehicle-to-grid research at the University of Delaware nearly three decades ago, helping establish the foundation for using electric vehicles as mobile energy storage systems. McGee chaired the development of SAE J3068, an automotive communications standard that supports more affordable bidirectional charging. As automakers, including Ford, move toward bringing bidirectional power technology to more affordable electric vehicles, Kempton and McGee can explain how it works, what it means for consumers and utilities, and how it could shape the future of transportation and energy. Areas of Expertise • Electric vehicles • Vehicle-to-grid (V2G) technology • Bidirectional charging • Energy storage • Electric power grids • Automotive engineering • Renewable energy • EV charging standards To connect with Kempton directly and arrange an interview, visit his ExpertFile profile and click on the "contact" button. Interested journalists can also email MediaRelations@udel.edu to email Kempton or McGee.

View all posts