Virtual reality training tool helps nurses learn patient-centered care

Apr 7, 2025

5 min



University of Delaware computer science students have developed a digital interface as a two-way system that can help nurse trainees build their communication skills and learn to provide patient-centered care across a variety of situations. This virtual reality training tool would enable users to rehearse their bedside manner with expectant mothers before ever encountering a pregnant patient in person.


The digital platform was created by students in Assistant Professor Leila Barmaki’s Human-Computer Interaction Laboratory, including senior Rana Tuncer, a computer science major, and sophomore Gael Lucero-Palacios.


Lucero-Palacios said the training helps aspiring nurses practice more difficult and sensitive conversations they might have with patients.


"Our tool is targeted to midwifery patients,” Lucero-Palacios said. “Learners can practice these conversations in a safe environment. It’s multilingual, too. We currently offer English or Turkish, and we’re working on a Spanish demo.”


This type of judgement-free rehearsal environment has the potential to remove language barriers to care, with the ability to change the language capabilities of an avatar. For instance, the idea is that on one interface the “practitioner” could speak in one language, but it would be heard on the other interface in the patient’s native language. The patient avatar also can be customized to resemble different health stages and populations to provide learners a varied experience.


Last December, Tuncer took the project on the road, piloting the virtual reality training program for faculty members in the Department of Midwifery at Ankara University in Ankara, Turkey. With technical support provided by Lucero-Palacios back in the United States, she was able to run a demo with the Ankara team, showcasing the UD-developed system’s interactive rehearsal environment’s capabilities.


Last winter, University of Delaware senior Rana Tuncer (left), a computer science major, piloted the virtual reality training program for Neslihan Yilmaz Sezer (right), associate professor in the Department of Midwifery, Ankara University in Ankara, Turkey.


Meanwhile, for Tuncer, Lucero-Palacios and the other students involved in the Human-Computer Interaction Laboratory, developing the VR training tool offered the opportunity to enhance their computer science, data science and artificial intelligence skills outside the classroom.


“There were lots of interesting hurdles to overcome, like figuring out a lip-sync tool to match the words to the avatar’s mouth movements and figuring out server connections and how to get the languages to switch and translate properly,” Tuncer said.


Lucero-Palacios was fascinated with developing text-to-speech capabilities and the ability to use technology to impact patient care.


“If a nurse is well-equipped to answer difficult questions, then that helps the patient,” said Lucero-Palacios.


The project is an ongoing research effort in the Barmaki lab that has involved many students. Significant developments occurred during the summer of 2024 when undergraduate researchers Tuncer and Lucero-Palacios contributed to the project through funding support from the National Science Foundation (NSF). However, work began before and continued well beyond that summer, involving many students over time. UD senior Gavin Caulfield provided foundational support to developing the program’s virtual environment and contributed to development of the text-to-speech/speech-to-text capabilities. CIS doctoral students Fahim Abrar and Behdokht Kiafar, along with Pinar Kullu, a postdoctoral fellow in the lab, used multimodal data collection and analytics to quantify the participant experience.


“Interestingly, we found that participants showed more positive emotions in response to patient vulnerabilities and concerns,” said Kiafar.



The work builds on previous research Barmaki, an assistant professor of computer and information sciences and resident faculty member in the Data Science Institute, completed with colleagues at New Jersey Institute of Technology and University of Central Florida in an NSF-funded project focused on empathy training for healthcare professionals using a virtual elderly patient. In the project, Barmaki employed machine learning tools to analyze a nursing trainee’s body language, gaze, verbal and nonverbal interactions to capture micro-expressions (facial expressions), and the presence or absence of empathy.


“There is a huge gap in communication when it comes to caregivers working in geriatric care and maternal fetal medicine,” said Barmaki. “Both disciplines have high turnover and challenges with lack of caregiver attention to delicate situations.”


UD senior Rana Tuncer (center) met with faculty members Neslihan Yilmaz Sezer (left) and Menekse Nazli Aker (right) of Ankara University in Ankara, Turkey, to educate them about the virtual reality training tool she and her student colleagues have developed to enhance patient-centered care skills for health care professionals.


When these human-human interactions go wrong, for whatever reason, it can extend beyond a single patient visit. For instance, a pregnant woman who has a negative health care experience might decide not to continue routine pregnancy care.


Beyond the project’s potential to improve health care professional field readiness, Barmaki was keen to note the benefits of real-world workforce development for her students.


“Perceptions still exist that computer scientists work in isolation with their computers and rarely interact, but this is not true,” Barmaki said, pointing to the multi-faceted team members involved in this project. “Teamwork is very important. We have a nice culture in our lab where people feel comfortable asking their peers or more established students for help.”


Barmaki also pointed to the potential application of these types of training environments, enabled by virtual reality, artificial intelligence and natural language processing, beyond health care. With the framework in place, she said, the idea could be adapted for other types of training involving human-human interaction, say in education, cybersecurity, even in emerging technology such as artificial intelligence (AI). Keeping people at the center of any design or application of this work is critical, particularly as uses for AI continue to expand.


“As data scientists, we see things as spreadsheets and numbers in our work, but it’s important to remember that the data is coming from humans,” Barmaki said.


While this project leverages computer vision and AI as a teaching tool for nursing assistants, Barmaki explained this type of system can also be used to train AI and to enable more responsible technologies down the road. She gave the example of using AI to study empathic interactions between humans and to recognize empathy.


“This is the most important area where I’m trying to close the loop, in terms of responsible AI or more empathy-enabled AI,” Barmaki said. “There is a whole area of research exploring ways to make AI more natural, but we can’t work in a vacuum; we must consider the human interactions to design a good AI system.”


Asked whether she has concerns about the future of artificial intelligence, Barmaki was positive.


“I believe AI holds great promise for the future, and, right now, its benefits outweigh the risks,” she said.

You might also like...

Check out some other posts from University of Delaware

2 min

University of Delaware secures $13.1M grant to transform Alzheimer’s research and prevention

A new five-year $13.1 million grant will greatly expand the ability of University of Delaware researchers to pursue ways to prevent and treat Alzheimer's disease. The gift from the Delaware Community Foundation (DCF) is one of the largest in state history for Alzheimer’s research. UD's Christopher Martens called the grant "transformational," as it will support the expansion of a statewide prevention study, enable the purchase of a state-of-the-art MRI machine and drive discovery of new diagnostic tools and treatments. “It will also help grow the number of researchers in Delaware focused on Alzheimer’s disease, promoting an interdisciplinary approach." said Martens, director of UD's Delaware Center for Cognitive Aging Research (DECCAR) and professor of kinesiology and applied physiology in the College of Health Sciences. Bringing together researchers from multiple fields to collaborate on a critical challenge like Alzheimer’s disease is a key strength of the University of Delaware, said Interim President Laura Carlson. “Every one of us has a family member or friend who has been deeply affected by Alzheimer’s. I’m proud that UD is working better to understand this terrible disease and partnering with others throughout the state to work on its prevention, diagnosis and treatment,” Carlson said. “We are grateful to the Delaware Community Foundation for their support, which allows us to escalate our research and expand our community outreach.” “No one has to look very far afield to witness and understand the tragedy of Alzheimer’s, and the research supported by this grant will help UD researchers come ever-closer to uncovering life-improving and life-saving solutions,” said Stuart Comstock-Gay, President and CEO of the Delaware Community Foundation (DCF). “The grant was provided through the generosity of late Paul H. Boerger, who made a substantial legacy gift to the fund he had established at the DCF in his lifetime, and his foresight will help so many.” The gift is aimed at achieving the following goals: • Tracking Alzheimer’s risk over time – Expanding Delaware’s largest study of brain aging from 100 to 500 participants to uncover who develops dementia and why. • A simple blood test for early detection – Developing a first-of-its-kind test that could diagnose Alzheimer’s years earlier than current methods. • Cutting-edge brain imaging – Installing a $3.2 million MRI machine on UD’s STAR Campus to reveal hidden brain changes linked to memory loss. • Spotting the earliest warning signs – Exploring how subtle shifts in language and menopause-related hormone changes may predict Alzheimer’s risk. • Fueling prevention and cures – Creating powerful data and tools that will accelerate new treatments and bring researchers closer to stopping Alzheimer’s. To reach Martens for an interview, visit his profile and click on the "contact" button. Interviews with DCF officials can be arranged by emailing MediaRelations@udel.edu.

2 min

Empowering independence: Blue Envelope program facilitates safer communication between drivers with disabilities and police

University of Delaware, in close collaboration with Delaware State Police, the Delaware Association of Chiefs of Police, the Office of Highway Safety, and the Delaware DMV, has co-developed the Blue Envelope Program – now launched statewide as of Aug. 26, 2025. The program offers no-questions-asked, no-ID-required, free envelopes that drivers with disabilities (including communication differences, sensory needs, mobility limitations, or other differences) can keep in their vehicle. The envelope includes space for emergency contact or medical notes, instructions for law enforcement and tips to ensure safe, respectful, clear exchanges during traffic stops. The University of Delaware Center for Disabilities Studies helped review and approve the content and design to ensure inclusivity and accessibility. UD experts – including Sarah Mallory (Associate Director of the Center for Disabilities Studies) and Alisha Fletcher (Director, Delaware Network for Excellence in Autism) – are available to speak about how the program supports an underserved and underrepresented group and improves outcomes in law enforcement encounters. Why This Matters: Traffic stops can be stressful for drivers with disabilities and can lead to misinterpretations or heightened risk. The Blue Envelope helps reduce misunderstandings while preserving dignity and safety. Delaware joins around 10 other states (including Maine, Massachusetts, New Jersey, New York, Rhode Island, and Vermont) in adopting a traffic-stop communication aid for drivers with disabilities This is a practical, no-barrier solution that promotes equity, accessibility, and respectful law enforcement practices. To speak with either Mallory or Fletcher to learn more about the program's development, impact and what’s next, email mediarelations@udel.edu.

2 min

Spitting image: What the blunder by Philadelphia Eagles' Carter can teach us about teams

Social media caught fire when Philadelphia Eagles' defensive tackle Jalen Carter got tossed for spitting on Dallas Cowboys' quarterback Dak Prescott before the first snap of this year's NFL season opener. While the impact on the game was obvious, what unfolded on the field of play has lessons for the workplace and the boardroom. The University of Delaware's Kyle Emich can talk about the parallels between the two worlds when individuals let their teams down. Emich, a professor of management in UD's Lerner College of Business and Economics, said emotional events occur all the time in the workplace, especially in board rooms, where the atmosphere is often competitive. "Emotion regulation is a key part of harnessing motivation appropriately in a competitive context," Emich said. • Early on, the Cowboys were able to regulate their emotions to tap into the incident when they roared out to several seamless offensive drives. • Emich says the Eagles' young, inexperienced and not-yet-gelled defensive unit was unable to regulate their emotions and preserve their confidence (collective efficacy) after the incident. They were unable to stop Dallas in the first half. • Carter's act could also have served as an emotion regulation cue for both teams. The Eagles defense was unable to regulate and maintain stability, leading to a number of costly penalties. But the Cowboys seemed to have had the same issue when they retaliated with personal fouls of their own. •  In the end, the Eagles were able to come together under the leadership of their coach, Nick Sirianni, and quarterback, Jalen Hurts, to secure a 24-20 victory. To connect with Emich for an interview, visit his profile page and click on the "contact" button.

View all posts