Virtual reality training tool helps nurses learn patient-centered care

Apr 7, 2025

5 min



University of Delaware computer science students have developed a digital interface as a two-way system that can help nurse trainees build their communication skills and learn to provide patient-centered care across a variety of situations. This virtual reality training tool would enable users to rehearse their bedside manner with expectant mothers before ever encountering a pregnant patient in person.


The digital platform was created by students in Assistant Professor Leila Barmaki’s Human-Computer Interaction Laboratory, including senior Rana Tuncer, a computer science major, and sophomore Gael Lucero-Palacios.


Lucero-Palacios said the training helps aspiring nurses practice more difficult and sensitive conversations they might have with patients.


"Our tool is targeted to midwifery patients,” Lucero-Palacios said. “Learners can practice these conversations in a safe environment. It’s multilingual, too. We currently offer English or Turkish, and we’re working on a Spanish demo.”


This type of judgement-free rehearsal environment has the potential to remove language barriers to care, with the ability to change the language capabilities of an avatar. For instance, the idea is that on one interface the “practitioner” could speak in one language, but it would be heard on the other interface in the patient’s native language. The patient avatar also can be customized to resemble different health stages and populations to provide learners a varied experience.


Last December, Tuncer took the project on the road, piloting the virtual reality training program for faculty members in the Department of Midwifery at Ankara University in Ankara, Turkey. With technical support provided by Lucero-Palacios back in the United States, she was able to run a demo with the Ankara team, showcasing the UD-developed system’s interactive rehearsal environment’s capabilities.


Last winter, University of Delaware senior Rana Tuncer (left), a computer science major, piloted the virtual reality training program for Neslihan Yilmaz Sezer (right), associate professor in the Department of Midwifery, Ankara University in Ankara, Turkey.


Meanwhile, for Tuncer, Lucero-Palacios and the other students involved in the Human-Computer Interaction Laboratory, developing the VR training tool offered the opportunity to enhance their computer science, data science and artificial intelligence skills outside the classroom.


“There were lots of interesting hurdles to overcome, like figuring out a lip-sync tool to match the words to the avatar’s mouth movements and figuring out server connections and how to get the languages to switch and translate properly,” Tuncer said.


Lucero-Palacios was fascinated with developing text-to-speech capabilities and the ability to use technology to impact patient care.


“If a nurse is well-equipped to answer difficult questions, then that helps the patient,” said Lucero-Palacios.


The project is an ongoing research effort in the Barmaki lab that has involved many students. Significant developments occurred during the summer of 2024 when undergraduate researchers Tuncer and Lucero-Palacios contributed to the project through funding support from the National Science Foundation (NSF). However, work began before and continued well beyond that summer, involving many students over time. UD senior Gavin Caulfield provided foundational support to developing the program’s virtual environment and contributed to development of the text-to-speech/speech-to-text capabilities. CIS doctoral students Fahim Abrar and Behdokht Kiafar, along with Pinar Kullu, a postdoctoral fellow in the lab, used multimodal data collection and analytics to quantify the participant experience.


“Interestingly, we found that participants showed more positive emotions in response to patient vulnerabilities and concerns,” said Kiafar.



The work builds on previous research Barmaki, an assistant professor of computer and information sciences and resident faculty member in the Data Science Institute, completed with colleagues at New Jersey Institute of Technology and University of Central Florida in an NSF-funded project focused on empathy training for healthcare professionals using a virtual elderly patient. In the project, Barmaki employed machine learning tools to analyze a nursing trainee’s body language, gaze, verbal and nonverbal interactions to capture micro-expressions (facial expressions), and the presence or absence of empathy.


“There is a huge gap in communication when it comes to caregivers working in geriatric care and maternal fetal medicine,” said Barmaki. “Both disciplines have high turnover and challenges with lack of caregiver attention to delicate situations.”


UD senior Rana Tuncer (center) met with faculty members Neslihan Yilmaz Sezer (left) and Menekse Nazli Aker (right) of Ankara University in Ankara, Turkey, to educate them about the virtual reality training tool she and her student colleagues have developed to enhance patient-centered care skills for health care professionals.


When these human-human interactions go wrong, for whatever reason, it can extend beyond a single patient visit. For instance, a pregnant woman who has a negative health care experience might decide not to continue routine pregnancy care.


Beyond the project’s potential to improve health care professional field readiness, Barmaki was keen to note the benefits of real-world workforce development for her students.


“Perceptions still exist that computer scientists work in isolation with their computers and rarely interact, but this is not true,” Barmaki said, pointing to the multi-faceted team members involved in this project. “Teamwork is very important. We have a nice culture in our lab where people feel comfortable asking their peers or more established students for help.”


Barmaki also pointed to the potential application of these types of training environments, enabled by virtual reality, artificial intelligence and natural language processing, beyond health care. With the framework in place, she said, the idea could be adapted for other types of training involving human-human interaction, say in education, cybersecurity, even in emerging technology such as artificial intelligence (AI). Keeping people at the center of any design or application of this work is critical, particularly as uses for AI continue to expand.


“As data scientists, we see things as spreadsheets and numbers in our work, but it’s important to remember that the data is coming from humans,” Barmaki said.


While this project leverages computer vision and AI as a teaching tool for nursing assistants, Barmaki explained this type of system can also be used to train AI and to enable more responsible technologies down the road. She gave the example of using AI to study empathic interactions between humans and to recognize empathy.


“This is the most important area where I’m trying to close the loop, in terms of responsible AI or more empathy-enabled AI,” Barmaki said. “There is a whole area of research exploring ways to make AI more natural, but we can’t work in a vacuum; we must consider the human interactions to design a good AI system.”


Asked whether she has concerns about the future of artificial intelligence, Barmaki was positive.


“I believe AI holds great promise for the future, and, right now, its benefits outweigh the risks,” she said.

You might also like...

Check out some other posts from University of Delaware

4 min

Measuring how teachers' emotions can impact student learning

University of Delaware professor Leigh McLean has developed a new tool for measuring teachers’ emotional expressions and studying how these expressions affect their students’ attitudes toward learning. McLean uses this tool to gather new data showing emotional transmission between teachers and their students in fourth-grade classrooms. McLean and co-author Nathan Jones of Boston University share the results of their use of the tool in a new article in Contemporary Educational Psychology. They found that teachers displayed far more positive emotions than negative ones. But they also found that some teachers showed high levels of negative emotions. In these cases, teachers’ expressions of negative emotions were associated with reduced student enjoyment of learning and engagement. These findings add to a compelling body of research highlighting the importance of teachers’ and students’ emotional experiences within the context of teaching and learning. “Anyone who has been in a classroom knows that it is an inherently emotional environment, but we still don’t fully understand exactly how emotions, and especially the teachers’ emotions, work to either support or detract from students’ learning,” said McLean, who studies teachers’ emotions and well-being in the College of Education and Human Development’s School of Education (SOE) and Center Research in Education and Social Policy. “This new tool, and these findings, help us understand these processes more precisely and point to how we might provide emotion-centered classroom supports.” Measuring teacher and student emotions McLean and Jones collected survey data and video-recorded classroom observations from 65 fourth-grade teachers and 805 students in a Southwestern U.S. state. The surveys asked participants to report their emotions and emotion-related experiences — like feelings of enjoyment, worry or boredom — as well as their teaching and learning behaviors in mathematics and English language arts (ELA). Using the new observational tool they developed — the Teacher Affect Coding System — McLean and Jones also assessed teachers’ vocal tones, body posturing, body movements and facial expressions during classroom instruction and categorized outward displays of emotion as positive, negative or neutral. For example, higher-pitched or lilting vocal tones were categorized as positive, while noticeably harsh or sad vocal tones were categorized as negative. Overall, McLean and Jones found that teachers spent most of their instructional time displaying outward positive emotions. Interestingly though, they did not find any associations between these positive emotions and students’ content-related emotions or learning attitudes in ELA or math. “This lack of association might be because outward positivity is the relative ‘norm’ for elementary school teachers, and our data seem to support that,” McLean said. “That’s not to say that teachers’ positivity isn’t important, though. Decades of research has shown us that when teachers are warm, responsive and supportive, and when they foster positive relationships with their students, students do better in almost every way. It could be that positivity works best when done in tandem with other important teacher behaviors or routines, or it could be that it is more relevant for different student outcomes.” However, they did find that a small subset of teachers — about 10% — displayed notable amounts of negative emotions, with some showing negativity during as much as 80% of their instructional time. The students of these teachers reported reduced enjoyment and engagement in their ELA classes and reduced engagement in their math classes. “We think that these teachers are struggling with their real-time emotion regulation skills,” McLean said. “Any teacher, even a very positive one, will tell you that managing a classroom of students is challenging, and staying positive through the frustrating times takes a lot of emotional regulation. Emotion regulation is a particularly important skill for teachers because children inherently look to the social cues of adults in their immediate environment to gauge their level of safety and comfort. When a teacher is dysregulated, their students pick up on this in ways that can detract from learning.” Recommendations for supporting teacher well-being Given the findings of their study, McLean and Jones make several recommendations for teacher preparation and professional learning programs. As a first step, they recommend that teacher preparation and professional learning programs share information about how negative emotions and experiences are a normal part of the teaching experience. As McLean said, “It’s okay to be frustrated!” However, it is also important to be aware that repeated outward displays of negative emotion can impact students. McLean and Jones also suggest that these programs provide specific training to teachers on skills such as mindfulness and emotion regulation to help teachers manage negative emotions while they’re teaching. “Logically, these findings and recommendations make complete sense,” said Steve Amendum, professor and director of CEHD’s SOE, which offers a K-8 teacher education program. “After working with many, many teachers, I often see teachers' enthusiasm or dislike for a particular activity or content area transfer to their students.” McLean and Jones, however, emphasize that supporting teacher well-being can’t just be up to the teachers. Assistant principals, principals and other educational leaders should prioritize teacher wellness across the school and district. If teachers’ negative emotions in the classroom result in part from challenging working conditions or insufficient resources, educational leaders and policymakers should consider system-wide changes and supports to foster teacher well-being. To learn more about CEHD research in social and emotional development, visit its research page. To arrange an interview with McLean, connect with her directly by clicking on the contact button found on her ExpertFile profile page.

2 min

How old is your brain?

University of Delaware researchers have found that measuring brain stiffness is a reliable way to predict brain age. This information could be used to identify structural differences that indicate departure from the normal aging process, potentially identifying and addressing disorders such as Alzheimer’s disease and Parkinson’s disease. In recent findings, Curtis Johnson, associate professor of biomedical engineering, and Austin Brockmeier, assistant professor of electrical and computer engineering, show that measuring both brain stiffness and brain volume produces the most accurate predictions of chronological age. Their findings were published in a recent edition of the journal Biology Methods and Protocols. The pair worked with three current and former UD students to reach their conclusions. “Brain volume is a common measure that we use to study the brain,” Johnson said. “But something has to be happening to cause a brain to shrink. Something is happening at the microscale that causes it to shrink — changes in the tissue that also cause stiffness to change. And that precedes whatever happens when the volume changes.” “The stiffness maps all seem kind of random — until we see a large number of images and the randomness fades away and we start to see common patterns in stiffness,” Johnson said. “We sort of knew there was more [information] in there than what we were extracting." A cutting-edge magnetic resonance imaging (MRI) scanner at UD’s Center for Biomedical and Brain Imaging handled the brain scanning. On the artificial intelligence side, the brain maps were analyzed by three-dimensional “convolutional neural networks,” which — as the name suggests — are convoluted and complicated, incorporating many layers and dimensions. To arrange and interview with Johnson or Brockmeier, send an email to mediarelations@udel.edu

1 min

The hidden consequences of school suspensions: Insights from 'Suspended Education'

School suspensions have long been a traditional disciplinary strategy used by educational institutions to address behavioral issues. Often perceived as a straightforward solution to handle disruptive conduct, suspensions remove the student from the school environment, theoretically allowing learning to proceed unhindered. University of Delaware sociology professor Aaron Kupchik explores school suspensions in his new book ‘Suspended Education: School Punishment and the Legacy of Racial Injustice.' He looks at how this practice is intrinsically tied to racial inequality and can have negative long-term impacts on students. He notes that beneath this seemingly effective measure, a multitude of unintended consequences lurk, some of which profoundly affect both the individual student and the broader community. And often, there is more harm than good done by this measure, particularly for students of color.  Kupchik has appeared in a number of outlets including Time magazine and Delaware Public Media. He can be reached by clicking on his profile.

View all posts