Featured Post from University of Delaware

Virtual reality training tool helps nurses learn patient-centered care

Apr 7, 2025

5 min



University of Delaware computer science students have developed a digital interface as a two-way system that can help nurse trainees build their communication skills and learn to provide patient-centered care across a variety of situations. This virtual reality training tool would enable users to rehearse their bedside manner with expectant mothers before ever encountering a pregnant patient in person.


The digital platform was created by students in Assistant Professor Leila Barmaki’s Human-Computer Interaction Laboratory, including senior Rana Tuncer, a computer science major, and sophomore Gael Lucero-Palacios.


Lucero-Palacios said the training helps aspiring nurses practice more difficult and sensitive conversations they might have with patients.


"Our tool is targeted to midwifery patients,” Lucero-Palacios said. “Learners can practice these conversations in a safe environment. It’s multilingual, too. We currently offer English or Turkish, and we’re working on a Spanish demo.”


This type of judgement-free rehearsal environment has the potential to remove language barriers to care, with the ability to change the language capabilities of an avatar. For instance, the idea is that on one interface the “practitioner” could speak in one language, but it would be heard on the other interface in the patient’s native language. The patient avatar also can be customized to resemble different health stages and populations to provide learners a varied experience.


Last December, Tuncer took the project on the road, piloting the virtual reality training program for faculty members in the Department of Midwifery at Ankara University in Ankara, Turkey. With technical support provided by Lucero-Palacios back in the United States, she was able to run a demo with the Ankara team, showcasing the UD-developed system’s interactive rehearsal environment’s capabilities.


CaptionResizeWrap TextRemove
Last winter, University of Delaware senior Rana Tuncer (left), a computer science major, piloted the virtual reality training program for Neslihan Yilmaz Sezer (right), associate professor in the Department of Midwifery, Ankara University in Ankara, Turkey.


Meanwhile, for Tuncer, Lucero-Palacios and the other students involved in the Human-Computer Interaction Laboratory, developing the VR training tool offered the opportunity to enhance their computer science, data science and artificial intelligence skills outside the classroom.


“There were lots of interesting hurdles to overcome, like figuring out a lip-sync tool to match the words to the avatar’s mouth movements and figuring out server connections and how to get the languages to switch and translate properly,” Tuncer said.


Lucero-Palacios was fascinated with developing text-to-speech capabilities and the ability to use technology to impact patient care.


“If a nurse is well-equipped to answer difficult questions, then that helps the patient,” said Lucero-Palacios.


The project is an ongoing research effort in the Barmaki lab that has involved many students. Significant developments occurred during the summer of 2024 when undergraduate researchers Tuncer and Lucero-Palacios contributed to the project through funding support from the National Science Foundation (NSF). However, work began before and continued well beyond that summer, involving many students over time. UD senior Gavin Caulfield provided foundational support to developing the program’s virtual environment and contributed to development of the text-to-speech/speech-to-text capabilities. CIS doctoral students Fahim Abrar and Behdokht Kiafar, along with Pinar Kullu, a postdoctoral fellow in the lab, used multimodal data collection and analytics to quantify the participant experience.


“Interestingly, we found that participants showed more positive emotions in response to patient vulnerabilities and concerns,” said Kiafar.



The work builds on previous research Barmaki, an assistant professor of computer and information sciences and resident faculty member in the Data Science Institute, completed with colleagues at New Jersey Institute of Technology and University of Central Florida in an NSF-funded project focused on empathy training for healthcare professionals using a virtual elderly patient. In the project, Barmaki employed machine learning tools to analyze a nursing trainee’s body language, gaze, verbal and nonverbal interactions to capture micro-expressions (facial expressions), and the presence or absence of empathy.


“There is a huge gap in communication when it comes to caregivers working in geriatric care and maternal fetal medicine,” said Barmaki. “Both disciplines have high turnover and challenges with lack of caregiver attention to delicate situations.”


CaptionResizeWrap TextRemove
UD senior Rana Tuncer (center) met with faculty members Neslihan Yilmaz Sezer (left) and Menekse Nazli Aker (right) of Ankara University in Ankara, Turkey, to educate them about the virtual reality training tool she and her student colleagues have developed to enhance patient-centered care skills for health care professionals.


When these human-human interactions go wrong, for whatever reason, it can extend beyond a single patient visit. For instance, a pregnant woman who has a negative health care experience might decide not to continue routine pregnancy care.


Beyond the project’s potential to improve health care professional field readiness, Barmaki was keen to note the benefits of real-world workforce development for her students.


“Perceptions still exist that computer scientists work in isolation with their computers and rarely interact, but this is not true,” Barmaki said, pointing to the multi-faceted team members involved in this project. “Teamwork is very important. We have a nice culture in our lab where people feel comfortable asking their peers or more established students for help.”


Barmaki also pointed to the potential application of these types of training environments, enabled by virtual reality, artificial intelligence and natural language processing, beyond health care. With the framework in place, she said, the idea could be adapted for other types of training involving human-human interaction, say in education, cybersecurity, even in emerging technology such as artificial intelligence (AI). Keeping people at the center of any design or application of this work is critical, particularly as uses for AI continue to expand.


“As data scientists, we see things as spreadsheets and numbers in our work, but it’s important to remember that the data is coming from humans,” Barmaki said.


While this project leverages computer vision and AI as a teaching tool for nursing assistants, Barmaki explained this type of system can also be used to train AI and to enable more responsible technologies down the road. She gave the example of using AI to study empathic interactions between humans and to recognize empathy.


“This is the most important area where I’m trying to close the loop, in terms of responsible AI or more empathy-enabled AI,” Barmaki said. “There is a whole area of research exploring ways to make AI more natural, but we can’t work in a vacuum; we must consider the human interactions to design a good AI system.”


Asked whether she has concerns about the future of artificial intelligence, Barmaki was positive.


“I believe AI holds great promise for the future, and, right now, its benefits outweigh the risks,” she said.

Powered by

You might also like...

Check out some other posts from University of Delaware

2 min

How corporate competition can spur collaborative solutions to the world's problems

Why can’t large competitive companies come together to work on or solve environmental challenges, AI regulation, polarization or other huge problems the world is facing? They can, says the University of Delaware’s Wendy Smith. While it's difficult, the key is to have these companies collaborate under the guise of competition. Smith, a professor of management and an expert on these types of paradoxes, co-authored a recent three-year study of one of the most profound collaborations. Her team looked at the unlikely alliance of 13 competitive oil and gas companies that eventually formed Canada’s Oil Sands Innovation Alliance (COSIA), which works with experts worldwide to find innovative solutions for environmental and technical challenges in the region. Smith and her co-authors found that those companies were willing to collaborate, but only when collaboration was cast in the language, practices and goals of competition. Given the scope of our global problems, companies must continually work together to offer solutions. Creating that collaboration becomes critical, Smith said. This research offers important insight about how these collaborations are possible. Among the study's key findings: Competition can drive cooperation — if leaders harness it. It would make sense to assume that competition undermines collaboration. But the study finds that those who championed alliances used competitive dynamics to strengthen cooperation among rival firms. Rather than suppressing rivalry, leaders leveraged competition as a mechanism to enable joint action toward shared environmental goals. This reframes how organizations can manage tensions between competition and cooperation in partnerships. For example, COSIA leaders created competition between partners to see who would contribute the most valuable environmental innovations. Partners could only gain as much benefit from other company’s innovations commensurate with what they shared. A “Paradox Mindset” is key to complex collaborative success. The research identifies the importance of what the authors call a paradox mindset, which sees competition and cooperation not as opposites to be balanced but as interrelated forces that can be used in tandem. Leaders in the study who adopted this mindset were more thoughtful and creative about how to engage both competitive and collaborative practices in the same alliance. Traditional balance isn’t the goal — process over stability. Instead of pursuing a simplistic “balance” between competing and cooperating, the study shows that effective alliances evolve through process, where competition remains visible and even useful throughout the lifecycle of the alliance. To connect with Smith directly and arrange an interview, visit her profile and click on the "contact" button. Interested journalists can also send an email to MediaRelations@udel.edu.

1 min

Why homelessness is more than a housing issue for students

More than 4,400 students in Delaware were identified as experiencing homelessness during the 2022–23 school year, a number that continues to rise.  Ann M. Aviles, associate professor in the University of Delaware’s College of Education and Human Development, studies education equity, social policy and services for children and families. She is co-author of a new book, "Serving Students Who Are Homeless: A Resource Guide for Schools, Districts, Educational Leaders, and Community Partners", which offers practical guidance for educators navigating the challenges of student homelessness. Nationwide, more than 1.3 million school-aged children experience homelessness annually. While housing instability is often viewed as a social services issue, research shows it has direct and profound consequences for student learning, engagement and well-being. Housing instability affects every aspect of a student’s daily life. Students may be worried about where they will sleep, whether they will have food or how they’ll get home after school. That uncertainty makes it much harder to focus on learning, Aviles said. A key recommendation in Aviles’ new book is stronger collaboration between schools and community organizations. She encourages districts to develop community resource maps that identify local food pantries, shelters, health providers and other support services. She also emphasizes the importance of public understanding of homelessness as a systemic issue shaped by policy, affordability and access to services. To speak with Aviles further, email mediarelations@udel.edu. 

2 min

Maduro is gone; expert details potential impact on the Caribbean

Globally, the ousting of Nicolás Maduro in Venezuela has been met with a mix of reactions and cautious optimism. The University of Delaware’s Kalim Shah can discuss how regime change will play across the Caribbean and the spillover effect that will ripple throughout the region – and the world – in the years and decades to come. Shah, professor of energy and environmental policy and an expert on the island nations of the Caribbean, says that although public statements have been muted and restrained, there is a shared understanding. “For small island states that have absorbed the effects of Venezuelan collapse for more than two decades, this moment represents the possible end of a long and destabilizing chapter,” Shah said. Caribbean governments are not celebrating regime change, Shah said. Rather, they are responding to the prospect of reduced systemic risk. “A Venezuela that no longer exports large-scale displacement, opaque energy leverage and permissive criminal governance is objectively preferable for the region.” Shah can discuss several aspects of Venezuela’s political history, how the nation has arrived where it is, where it might be headed and the impact this will have on the Caribbean as a whole. Those include: • Venezuela’s political and economic deterioration during the Chávez–Maduro era and how that has translated directly into pressures felt across the Caribbean in the form of migration, fiscal exposure, security risks and regional uncertainty. • How the nation’s institutional collapse coincided with deepening organized crime activity across the Caribbean basin. Data from the United Nations Office on Drugs and Crime consistently places the region within major cocaine trafficking corridors linking South America with North American and European markets. For Caribbean governments, this meant higher interdiction costs, increased exposure to transnational criminal networks and growing pressure on already limited security institutions. • This moment invites a reassessment of China’s expanding footprint in the Caribbean, Shah says. He can discuss the ways in which Beijing has deepened its presence throughout the region. Shah says that as this transition unfolds, five policy developments will determine whether the cautious optimism proves warranted: • The impact on Venezuelan outward migration to the Caribbean. • Whether Caribbean public systems receive durable support rather than short-term humanitarian fixes. • Organized crime and drug trafficking pressures in the Caribbean basin. • External security engagement in the Caribbean. • Whether the region avoids a return to dependency-driven energy and infrastructure politics. “For the Caribbean, hope today is not naïve. It is conditional. The Chávez–Maduro years imposed real costs on the region. Their end creates an opening…but only if policy follows through,” Shah said. To contact Shah directly for interviews, visit his expert page and click on the "contact" button. Interested reporters can also send an email to mediarelations@udel.edu.

View all posts
Powered by