Virtual reality training tool helps nurses learn patient-centered care

Apr 7, 2025

5 min



University of Delaware computer science students have developed a digital interface as a two-way system that can help nurse trainees build their communication skills and learn to provide patient-centered care across a variety of situations. This virtual reality training tool would enable users to rehearse their bedside manner with expectant mothers before ever encountering a pregnant patient in person.


The digital platform was created by students in Assistant Professor Leila Barmaki’s Human-Computer Interaction Laboratory, including senior Rana Tuncer, a computer science major, and sophomore Gael Lucero-Palacios.


Lucero-Palacios said the training helps aspiring nurses practice more difficult and sensitive conversations they might have with patients.


"Our tool is targeted to midwifery patients,” Lucero-Palacios said. “Learners can practice these conversations in a safe environment. It’s multilingual, too. We currently offer English or Turkish, and we’re working on a Spanish demo.”


This type of judgement-free rehearsal environment has the potential to remove language barriers to care, with the ability to change the language capabilities of an avatar. For instance, the idea is that on one interface the “practitioner” could speak in one language, but it would be heard on the other interface in the patient’s native language. The patient avatar also can be customized to resemble different health stages and populations to provide learners a varied experience.


Last December, Tuncer took the project on the road, piloting the virtual reality training program for faculty members in the Department of Midwifery at Ankara University in Ankara, Turkey. With technical support provided by Lucero-Palacios back in the United States, she was able to run a demo with the Ankara team, showcasing the UD-developed system’s interactive rehearsal environment’s capabilities.


Last winter, University of Delaware senior Rana Tuncer (left), a computer science major, piloted the virtual reality training program for Neslihan Yilmaz Sezer (right), associate professor in the Department of Midwifery, Ankara University in Ankara, Turkey.


Meanwhile, for Tuncer, Lucero-Palacios and the other students involved in the Human-Computer Interaction Laboratory, developing the VR training tool offered the opportunity to enhance their computer science, data science and artificial intelligence skills outside the classroom.


“There were lots of interesting hurdles to overcome, like figuring out a lip-sync tool to match the words to the avatar’s mouth movements and figuring out server connections and how to get the languages to switch and translate properly,” Tuncer said.


Lucero-Palacios was fascinated with developing text-to-speech capabilities and the ability to use technology to impact patient care.


“If a nurse is well-equipped to answer difficult questions, then that helps the patient,” said Lucero-Palacios.


The project is an ongoing research effort in the Barmaki lab that has involved many students. Significant developments occurred during the summer of 2024 when undergraduate researchers Tuncer and Lucero-Palacios contributed to the project through funding support from the National Science Foundation (NSF). However, work began before and continued well beyond that summer, involving many students over time. UD senior Gavin Caulfield provided foundational support to developing the program’s virtual environment and contributed to development of the text-to-speech/speech-to-text capabilities. CIS doctoral students Fahim Abrar and Behdokht Kiafar, along with Pinar Kullu, a postdoctoral fellow in the lab, used multimodal data collection and analytics to quantify the participant experience.


“Interestingly, we found that participants showed more positive emotions in response to patient vulnerabilities and concerns,” said Kiafar.



The work builds on previous research Barmaki, an assistant professor of computer and information sciences and resident faculty member in the Data Science Institute, completed with colleagues at New Jersey Institute of Technology and University of Central Florida in an NSF-funded project focused on empathy training for healthcare professionals using a virtual elderly patient. In the project, Barmaki employed machine learning tools to analyze a nursing trainee’s body language, gaze, verbal and nonverbal interactions to capture micro-expressions (facial expressions), and the presence or absence of empathy.


“There is a huge gap in communication when it comes to caregivers working in geriatric care and maternal fetal medicine,” said Barmaki. “Both disciplines have high turnover and challenges with lack of caregiver attention to delicate situations.”


UD senior Rana Tuncer (center) met with faculty members Neslihan Yilmaz Sezer (left) and Menekse Nazli Aker (right) of Ankara University in Ankara, Turkey, to educate them about the virtual reality training tool she and her student colleagues have developed to enhance patient-centered care skills for health care professionals.


When these human-human interactions go wrong, for whatever reason, it can extend beyond a single patient visit. For instance, a pregnant woman who has a negative health care experience might decide not to continue routine pregnancy care.


Beyond the project’s potential to improve health care professional field readiness, Barmaki was keen to note the benefits of real-world workforce development for her students.


“Perceptions still exist that computer scientists work in isolation with their computers and rarely interact, but this is not true,” Barmaki said, pointing to the multi-faceted team members involved in this project. “Teamwork is very important. We have a nice culture in our lab where people feel comfortable asking their peers or more established students for help.”


Barmaki also pointed to the potential application of these types of training environments, enabled by virtual reality, artificial intelligence and natural language processing, beyond health care. With the framework in place, she said, the idea could be adapted for other types of training involving human-human interaction, say in education, cybersecurity, even in emerging technology such as artificial intelligence (AI). Keeping people at the center of any design or application of this work is critical, particularly as uses for AI continue to expand.


“As data scientists, we see things as spreadsheets and numbers in our work, but it’s important to remember that the data is coming from humans,” Barmaki said.


While this project leverages computer vision and AI as a teaching tool for nursing assistants, Barmaki explained this type of system can also be used to train AI and to enable more responsible technologies down the road. She gave the example of using AI to study empathic interactions between humans and to recognize empathy.


“This is the most important area where I’m trying to close the loop, in terms of responsible AI or more empathy-enabled AI,” Barmaki said. “There is a whole area of research exploring ways to make AI more natural, but we can’t work in a vacuum; we must consider the human interactions to design a good AI system.”


Asked whether she has concerns about the future of artificial intelligence, Barmaki was positive.


“I believe AI holds great promise for the future, and, right now, its benefits outweigh the risks,” she said.

You might also like...

Check out some other posts from University of Delaware

3 min

AI-powered model predicts post-concussion injury risk in college athletes

Athletes who suffer a concussion have a serious risk of reinjury after returning to play, but identifying which athletes are most vulnerable has always been a bit of a mystery, until now. Using artificial intelligence (AI), University of Delaware researchers have developed a novel machine learning model that predicts an athlete’s risk of lower-extremity musculoskeletal (MKS) injury after concussion with 95% accuracy. A recent study published in Sports Medicine details the development of the AI model, which builds on previously published research showing that the risk of post-concussion injury doubles, regardless of the sport. The most common post-concussive injuries include sprains, strains, or even broken bones or torn ACLs. “This is due to brain changes we see post-concussion,” said Thomas Buckley, professor of kinesiology and applied physiology at the College of Health Sciences. These brain changes affect athletes’ balance, cognition, and reaction times and can be difficult to detect in standard clinical testing. “Even a minuscule difference in balance, reaction time, or cognitive processing of what’s happening around you can make the difference between getting hurt and not,” Buckley said. How AI is changing injury risk assessment Recognizing the need for enhanced injury reduction risk tools, Buckley collaborated with colleagues in UD’s College of Engineering, Austin Brockmeier, assistant professor of electrical and computer engineering, and César Claros, a fourth-year doctoral student; Wei Qian, associate professor of statistics in the College of Agriculture and Natural Resources; and former KAAP postdoctoral fellow Melissa Anderson, who’s now an assistant professor at Ohio University. To assess injury risk, Brockmeier and Claros developed a comprehensive AI model that analyzes more than 100 variables, including sports and medical histories, concussion type, and pre- and post-concussion cognitive data. “Every athlete is unique, especially across various sports,” said Brockmeier. “Tracking an athlete’s performance over time, rather than relying on absolute values, helps identify disturbances, deviations, or deficits that, when compared to their baseline, may signal an increased risk of injury.” While some sports, such as football, carry higher injury risk, the model revealed that individual factors are just as important as the sport played. “We tested a version of the model that doesn’t have access to the athlete’s sport, and it still accurately predicted injury risk,” Brockmeier said. “This highlights how unique characteristics—not just the inherent risks of a sport—play a critical role in determining the likelihood of future injury,” said Brockmeier. The research, which tracked athletes over two years, also found that the risk of MSK injury post-concussion extends well into the athlete’s return to play. “Common sense would suggest that injuries would occur early in an athlete’s return to play, but that’s simply not true,” said Buckley. “Our research shows that the risk of future injury increases over time as athletes compensate and adapt to small deficits they may not even be aware of.” The next step for Buckey’s Concussion Research Lab is to further collaborate with UD Athletics’ strength and conditioning staff to design real-time interventions that could reduce injury risk. Beyond sports: AI’s potential in aging research The implications of the UD-developed machine-learning model extend far beyond sports. Brockmeier believes the algorithm could be used to predict fall risk in patients with Parkinson’s disease. Claros is also exploring how the injury risk reduction model can be applied to aging research with the Delaware Center for Cognitive Aging. “We want to use brain measurements to investigate whether baseline lifestyle measurements such as weight, BMI, and smoking history are predictive of future mild cognitive impairment or Alzheimer’s disease,” said Claros. To arrange an interview with Buckley, email UD's media relations team at MediaRelations@udel.edu

1 min

University of Delaware's physical therapy program ranked #1 graduate school in the U.S.

The University of Delaware's physical therapy program has been ranked #1 in the 2026 edition of Best Graduate Schools, U.S. News and World Report. The program has revolutionized the use of prosthetics, helped students become trainers for Super Bowl champions and boasts unique specialized training. Darcy Reisman, chair of the program, can talk about the following: Research: One study incorporated walking into daily behavior for stroke patients. Our PT researchers have also revolutionized the use of prosthetics to improve the lives of those who have lost limbs. Professional outcomes: Two of our PT grads were on the Philadelphia Eagles’ training staff during their Super Bowl run. Another is working in Major League Soccer with a Tennessee-based team. Specialized training: UDPT has an accredited Manual Fellowship Program that provides post-professional training for physical therapists in the specialized area of Manual Therapy.Research In total, U.S. news ranked 24 UD graduate programs among the best in the nation. Among those, 13 were in the top 50, including chemical engineering at #8.

2 min

In new book, entomologist shows homeowners how to make changes in their yards

They asked, he answered. In his new book, "How Can I Help?: Saving Nature with Your Yard," nationally known University of Delaware entomologist Doug Tallamy addresses the most common questions he receives from homeowners looking to do their part to impact the food web, boost biodiversity and replace invasive plants with native ones. “Change is afoot!” Tallamy writes in the book, which was released today, April 8. “The cultural change from an adversarial relationship with nature to a collaborative one is starting to happen, and it gives me hope about the future of diversity and thus our own future.” Tallamy, TA Baker Professor of Agriculture and Natural Resources, wrote “How Can I Help” to tackle questions he’s received over email and during talks he has given around the U.S. “I get the same questions over and over again,” Tallamy said. “They fall into easily arranged categories: Questions about oaks, questions about ecology, questions about invasive plants. The book almost wrote itself in that sense.” Some of those common questions include: • Why should I care about the food web? • How should I choose the right native plants for my property? • What is the greatest threat to oaks? • How do we prioritize which invasive species to get rid of? • Are bug zappers hurting insect populations? • Is it better to have fewer plants of lots of species or more plants of fewer species? • Is it good to feed the birds? Tallamy is available for interviews to discuss "How Can I Help" or other relevant topics. To reach him directly, visit his profile and click on the "connect" button.

View all posts