Virtual reality training tool helps nurses learn patient-centered care

Apr 7, 2025

5 min



University of Delaware computer science students have developed a digital interface as a two-way system that can help nurse trainees build their communication skills and learn to provide patient-centered care across a variety of situations. This virtual reality training tool would enable users to rehearse their bedside manner with expectant mothers before ever encountering a pregnant patient in person.


The digital platform was created by students in Assistant Professor Leila Barmaki’s Human-Computer Interaction Laboratory, including senior Rana Tuncer, a computer science major, and sophomore Gael Lucero-Palacios.


Lucero-Palacios said the training helps aspiring nurses practice more difficult and sensitive conversations they might have with patients.


"Our tool is targeted to midwifery patients,” Lucero-Palacios said. “Learners can practice these conversations in a safe environment. It’s multilingual, too. We currently offer English or Turkish, and we’re working on a Spanish demo.”


This type of judgement-free rehearsal environment has the potential to remove language barriers to care, with the ability to change the language capabilities of an avatar. For instance, the idea is that on one interface the “practitioner” could speak in one language, but it would be heard on the other interface in the patient’s native language. The patient avatar also can be customized to resemble different health stages and populations to provide learners a varied experience.


Last December, Tuncer took the project on the road, piloting the virtual reality training program for faculty members in the Department of Midwifery at Ankara University in Ankara, Turkey. With technical support provided by Lucero-Palacios back in the United States, she was able to run a demo with the Ankara team, showcasing the UD-developed system’s interactive rehearsal environment’s capabilities.


Last winter, University of Delaware senior Rana Tuncer (left), a computer science major, piloted the virtual reality training program for Neslihan Yilmaz Sezer (right), associate professor in the Department of Midwifery, Ankara University in Ankara, Turkey.


Meanwhile, for Tuncer, Lucero-Palacios and the other students involved in the Human-Computer Interaction Laboratory, developing the VR training tool offered the opportunity to enhance their computer science, data science and artificial intelligence skills outside the classroom.


“There were lots of interesting hurdles to overcome, like figuring out a lip-sync tool to match the words to the avatar’s mouth movements and figuring out server connections and how to get the languages to switch and translate properly,” Tuncer said.


Lucero-Palacios was fascinated with developing text-to-speech capabilities and the ability to use technology to impact patient care.


“If a nurse is well-equipped to answer difficult questions, then that helps the patient,” said Lucero-Palacios.


The project is an ongoing research effort in the Barmaki lab that has involved many students. Significant developments occurred during the summer of 2024 when undergraduate researchers Tuncer and Lucero-Palacios contributed to the project through funding support from the National Science Foundation (NSF). However, work began before and continued well beyond that summer, involving many students over time. UD senior Gavin Caulfield provided foundational support to developing the program’s virtual environment and contributed to development of the text-to-speech/speech-to-text capabilities. CIS doctoral students Fahim Abrar and Behdokht Kiafar, along with Pinar Kullu, a postdoctoral fellow in the lab, used multimodal data collection and analytics to quantify the participant experience.


“Interestingly, we found that participants showed more positive emotions in response to patient vulnerabilities and concerns,” said Kiafar.



The work builds on previous research Barmaki, an assistant professor of computer and information sciences and resident faculty member in the Data Science Institute, completed with colleagues at New Jersey Institute of Technology and University of Central Florida in an NSF-funded project focused on empathy training for healthcare professionals using a virtual elderly patient. In the project, Barmaki employed machine learning tools to analyze a nursing trainee’s body language, gaze, verbal and nonverbal interactions to capture micro-expressions (facial expressions), and the presence or absence of empathy.


“There is a huge gap in communication when it comes to caregivers working in geriatric care and maternal fetal medicine,” said Barmaki. “Both disciplines have high turnover and challenges with lack of caregiver attention to delicate situations.”


UD senior Rana Tuncer (center) met with faculty members Neslihan Yilmaz Sezer (left) and Menekse Nazli Aker (right) of Ankara University in Ankara, Turkey, to educate them about the virtual reality training tool she and her student colleagues have developed to enhance patient-centered care skills for health care professionals.


When these human-human interactions go wrong, for whatever reason, it can extend beyond a single patient visit. For instance, a pregnant woman who has a negative health care experience might decide not to continue routine pregnancy care.


Beyond the project’s potential to improve health care professional field readiness, Barmaki was keen to note the benefits of real-world workforce development for her students.


“Perceptions still exist that computer scientists work in isolation with their computers and rarely interact, but this is not true,” Barmaki said, pointing to the multi-faceted team members involved in this project. “Teamwork is very important. We have a nice culture in our lab where people feel comfortable asking their peers or more established students for help.”


Barmaki also pointed to the potential application of these types of training environments, enabled by virtual reality, artificial intelligence and natural language processing, beyond health care. With the framework in place, she said, the idea could be adapted for other types of training involving human-human interaction, say in education, cybersecurity, even in emerging technology such as artificial intelligence (AI). Keeping people at the center of any design or application of this work is critical, particularly as uses for AI continue to expand.


“As data scientists, we see things as spreadsheets and numbers in our work, but it’s important to remember that the data is coming from humans,” Barmaki said.


While this project leverages computer vision and AI as a teaching tool for nursing assistants, Barmaki explained this type of system can also be used to train AI and to enable more responsible technologies down the road. She gave the example of using AI to study empathic interactions between humans and to recognize empathy.


“This is the most important area where I’m trying to close the loop, in terms of responsible AI or more empathy-enabled AI,” Barmaki said. “There is a whole area of research exploring ways to make AI more natural, but we can’t work in a vacuum; we must consider the human interactions to design a good AI system.”


Asked whether she has concerns about the future of artificial intelligence, Barmaki was positive.


“I believe AI holds great promise for the future, and, right now, its benefits outweigh the risks,” she said.

You might also like...

Check out some other posts from University of Delaware

2 min

Vitamin D in pregnancy may boost kids’ brainpower

You don't need a scientist to tell you that milk is good for babies. But a new study led by the University of Delaware's Melissa Melough sheds light on the power of prenatal nutrition — specifically vitamin D— as a key contributor to children’s brain development. The research found that children whose mothers had higher vitamin D levels during pregnancy scored better on tests of memory, attention and problem-solving skills at ages 7 to 12 compared with those whose mothers had lower levels. Melough wrote about the study in a piece for The Conversation. Vitamin D deficiency affects 42% of U.S. adults and about a third of pregnant women, but the average American woman consumes just 168 international units of vitamin D daily (the recommended amount is 600 ID). Many prenatal vitamins contain only 400 IU. One promising finding could result in the solution of a racial disparity in nutrition. The study found a link between prenatal vitamin D levels and childhood cognition was strongest among Black families, who also face higher rates of vitamin D deficiency. Therefore, vitamin D supplementation could be a low-cost strategy to support brain development while reducing racial disparities. Melough is available for interviews about the study, and can also speak to the following topics: • Nutritional and environmental factors influencing human health. • Populations at risk for nutritional inadequacies or harmful environmental exposures. • The roles of endocrine disruptors in the development of obesity. • The influences of maternal nutrition on childhood outcomes • Novel dietary approaches to reduce chemical exposures or their associated health consequences. To arrange an interview with Melough, visit her profile page and click on the "contact" button, or send an email to MediaRelations@udel.edu.

1 min

Pets and the Texas floods: Owners faced difficult decisions and loss during and after disaster

One of the more overlooked aspects of any disaster is the loss of pets. Many of them become separated from their owners, are badly injured or perish as the result of a hurricane, flood, earthquake or other major event. This was the case in the recent flooding of the Guadalupe River in central Texas, said Sarah DeYoung, core faculty with the University of Delaware's Disaster Research Center. DeYoung can talk about the following aspects related to the tragedy: • The decisions that people have to make during evacuation, particularly for those with companion animals. • The amount of horses along the Guadalupe River, which could be found at the camps and recreation areas. • Pets that go missing after a flash flood, and the role that key organizations play in response and tracking and managing logistics. • The psychological impact on people whose pets were injured or died, who are mourning and making memorials. DeYoung can also discuss maternal and child health in crisis and disaster settings with a focus on infant feeding in emergencies. To set up an interview with DeYoung, visit her profile page and click on the contact button; or send an email to MediaRelations@udel.edu.

1 min

What X chief executive's sudden exit means for the future of the social media giant

A sudden CEO departure almost always causes shockwaves. But the unexpected July 9 exit of X chief executive Linda Yaccarino after just two years – especially without a meaningful explanation – suggests instability or deeper dysfunction, says Lawrence Cunningham, director of the University of Delaware's Weinberg Center for Corporate Governance. Cunningham said the immediate questions are what was the succession plan, and is it now being executed? "Or was there no plan, which itself is a governance failure? Boards have a duty to prepare for transitions, especially in volatile environments. If succession planning was absent or inadequate, more departures may follow," he said. Cunningham can discuss the following topics in regards to Yaccarino's departure: • What a short CEO tenure signals about board oversight and strategic misalignment. • The role of succession planning – and what it means if none was in place. • Why reputational risk and cultural tone at the top matter in retaining leadership. • How boards should respond to external controversies affecting company values. To connect with Cunningham directly and arrange an interview, visit his profile and click on the "contact" button," or send an email to MediaRelations@udel.edu.

View all posts