NASA Asks Researchers to Help Define Trustworthiness in Autonomous Systems

Bhattacharyya, Carroll Leading Interdisciplinary Team in Prestigious University Leadership Initiative Program

May 16, 2025

4 min

Meredith Carroll, Ph.D.




A Florida Tech-led group of researchers was selected to help NASA solve challenges in aviation through its prestigious University Leadership Initiative (ULI) program. Over the next three years, associate professor of computer science and software engineering Siddhartha Bhattacharyya and professor of aviation human factors Meredith Carroll will work to understand the vital role of trust in autonomy.


Their project, “Trustworthy Resilient Autonomous Agents for Safe City Transportation in the Evolving New Decade” (TRANSCEND), aims to establish a common framework for engineers and human operators to determine the trustworthiness of machine-learning-enabled autonomous aviation safety systems.


Autonomous systems are those that can perform independent tasks without requiring human control. The autonomy of these systems is expected to be enhanced with intelligence gained from machine learning. As a result, intelligence-based software is expected to be increasingly used in airplanes and drones. It may also be utilized in airports and to manage air traffic in the future.


Learning-enabled autonomous technology can also act as contingency management when used in safety applications, proactively addressing potential disruptions and unexpected aviation events.


TRANSCEND was one of three projects chosen for the latest ULI awards. The others hail from Embry-Riddle Aeronautical University in Daytona Beach – researching continuously updating, self-diagnostic vehicle health management to enhance the safety and reliability of Advanced Air Mobility vehicles – and University of Colorado Boulder – investigating tools for understanding and leveraging the complex communications environment of collaborative, autonomous airspace systems.


Florida Tech’s team includes nine faculty members from five universities: Penn State; North Carolina A&T State University; University of Florida; Stanford University; Santa Fe College. It also involves the companies Collins Aerospace in Cedar Rapids, Iowa and ResilienX of Syracuse, New York. Carroll and Bhattacharyya will also involve students throughout the project.


Human operators are an essential component of aviation technology – they monitor independent software systems and associated data and intervene when those systems fail. They may include flight crew members, air traffic controllers, maintenance personnel or safety staff monitoring overall system safety.


A challenge in implementing independent software is that engineers and operators have different interpretations of what makes a system “trustworthy,” Carroll and Bhattacharyya explained. Engineers who develop autonomous software measure trustworthiness by the system’s ability to perform as designed. Human operators, however, trust and rely on systems to perform as they expect – they want to feel comfortable relying on a system to make an aeronautical decision in flight, such as how to avoid a traffic conflict or a weather event. Sometimes, that reliance won’t align with design specifications.


Equally important, operators also need to trust that the software will alert them when it needs a human to take over. This may happen if the algorithm driving the software encounters a scenario it wasn’t trained for.


“We are looking at how we can integrate trust from different communities – from human factors, from formal methods, from autonomy, from AI…” Bhattacharyya said. “How do we convey assumptions for trust, from design time to operation, as the intelligent systems are being deployed, so that we can trust them and know when they’re going to fail, especially those that are learning-enabled, meaning they adapt based on machine learning algorithms?”


With Bhattacharyya leading the engineering side and Carroll leading the human factors side, the research group will begin bridging the trust gap by integrating theories, principles, methods, measures, visualizations, explainability and practices from different domains – this will build the TRANSCEND framework. Then, they’ll test the framework using a diverse range of tools, flight simulators and intelligent decision-making to demonstrate trustworthiness in practice. This and other data will help them develop a safety case toolkit of guidelines for development processes, recommendations and suggested safety measures for engineers to reference when designing “trustworthy,” learning-enabled autonomous systems.


Ultimately, Bhattacharyya and Carroll hope their toolkit will lay the groundwork for a future learning-enabled autonomous systems certification process.


“The goal is to combine all our research capabilities and pull together a unified story that outputs unified products to the industry,” Carroll said. “We want products for the industry to utilize when implementing learning-enabled autonomy for more effective safety management systems.”


The researchers also plan to use this toolkit to teach future engineers about the nuances of trust in the products they develop. Once developed, they will hold outreach events, such as lectures and camps, for STEM-minded students in the community.


If you're interested in connecting with Meredith Carroll or Siddhartha Bhattacharyya - simply click on the expert's profile or contact  Adam Lowenstein, Director of Media Communications at Florida Institute of Technology at adam@fit.edu to arrange an interview today.

Connect with:
Meredith Carroll, Ph.D.

Meredith Carroll, Ph.D.

Professor | College of Aeronautics

Dr. Carroll's research focuses on decision-making in complex systems, human-machine teaming, performance assessment and adaptive training.

Training Fidelity AnalysisAdaptive TrainingIndividual DifferencesUrban Air Mobility (UAM)Cybersecurity
Powered by

You might also like...

Check out some other posts from Florida Tech

Expert Q and A: Understanding "Punch," The Baby Monkey That Captured The World's Heart featured image

6 min

Expert Q and A: Understanding "Punch," The Baby Monkey That Captured The World's Heart

A tiny Japanese macaque named Punch has unexpectedly become one of the internet’s most talked-about animals. Born at a zoo in Japan and rejected by his mother shortly after birth, the young monkey was hand-raised by staff and given a stuffed toy for comfort—an image that quickly ricocheted across social media worldwide. Videos showing Punch tentatively approaching other macaques, sometimes being pushed away or corrected as he tried to socialize, struck an emotional chord. What began as a local zoo update rapidly turned into international headlines, with audiences from North America to Europe weighing in on what they saw as loneliness, resilience and the universal need for belonging. But experts say the story is more nuanced than a viral clip suggests. The interactions that many viewers interpreted as bullying are, in fact, typical components of macaque social development, part of how young primates learn boundaries, hierarchy and group norms. While Punch’s early maternal separation makes his integration more delicate, gradual acceptance into the troop is a positive sign. As internet users continue to share and comment, the moment has sparked broader conversations about animal emotion, anthropomorphism and the realities of wildlife behavior in managed care settings. Florida Tech's Catherine Talbot offered insight into the complexities of animal behavior.  Catherine F. Talbot is an assistant professor in the School of Psychology at Florida Tech and co-director of the Animal Cognitive Research Center at Brevard Zoo. Her overarching research goal has been to study the ultimate (evolutionary) and proximate (behavioral, biological, and developmental) mechanisms underlying sociality. Q: Is it normal for mother macaques to abandon their babies, or is this an unusual occurrence? What circumstances can cause this to happen?  It’s not necessarily normal, but also not that uncommon in primates, unfortunately. It’s more common in first time mothers that are inexperienced and sometimes lower ranking mothers. A number of factors can increase the likelihood of abandonment including stress on the mother and unfavorable conditions such as limited resources. Q: How does abandonment affect development in young macaques?  Early maternal contact is critical for normal behavioral and emotional development. Infants rely on their mothers for nutrition, warmth, protection and learning how to navigate social dynamics. When infants do not have their mothers during critical developmental periods like infancy, in the short term, they tend to have elevated stress responses and difficulty with emotional regulation. In the long-term, it depends on whether the infant is able to form other types of attachment. In the worst-case scenario, they may have increased aggression, abnormal and/or self-injurious behavior, digestive issues and may lack social skills. But primates are resilient, and with social support and gradual integration into a troop, Punch can form new attachments, learn socially appropriate behavior and ultimately live a fairly normal monkey life. Q: Is it obvious to the rest of the troop when a young macaque has no mother? How does this affect integration?  Japanese macaques have really complex social worlds, so they are really in tune with the relationships they have with one another and recognize the relationships between other individuals. That can certainly make it more difficult for Punch to be accepted back into the troop – he needs to find some friends and possibly even a surrogate parent. With social support, he should be able to recover from the absence of a mother. It’s really great to see that the care staff stepped in to support Punch as he begins to recovery from the stress of this experience. It’s even more important that Punch is around other monkeys of the same species so that he can continue to learn from them and respond appropriately to social communication cues. I’m thrilled to see that Punch is now making friends. Q: Punch is obviously attached to his stuffed orangutan. We can understand how this happens from our own human experience, but can you explain, on a biological level, how he bonded with this stuffed animal? Primates, including humans, are neurobiologically wired to form strong social bonds with a caregiver very early in life. In many primate species, infants are born highly dependent on their mother. Punch’s attachment to the stuffed orangutan reflects this need for attachment. That physical touch – warmth, softness, graspable limbs, a stable physical presence – can partially activate those same calming biological pathways, including the release of oxytocin which regulates stress and promotes feelings of safety. Without activation in those pathways, Punch would likely experience stronger feelings of separation or loneliness and ultimately social withdrawal. These biological pathways are crucial to proper social and emotional development of any primate species. Any way we can help mitigate those effects for Punch is crucial for successful integration back into his troop. Q: How does sociality among Japanese macaques compare to that of similar species? Japanese macaques live in large multi-male, multi-female social groups that can range from roughly 50 to 150 individuals. Like many macaques species, they form stable, female-bonded societies. Females remain in their natal group (or the group they were born into) for life, inherit their mother’s rank, and form strong kin- based alliances whereas males emigrate to a new group at adolescence. Their societies are organized around matrilines or extended female family lines in which rank is very important. They have strong dominance hierarchies and generally high levels of aggression, but levels of aggression and tolerance can vary a good amount from group to group. Entire matrilines can outrank others, which dictates access to food, grooming partners, and coalitions. Within a single troop, you often see multiple matrilines with long-standing dominance competitions. I sometimes compare it to a Romeo and Juliet-style Montague and Capulet dynamic, where beneath the surface of daily grooming and foraging is a complex political landscape structured by kinship and status. Q: What behaviors can Punch expect from the rest of the monkeys as he continues to integrate with the troop? What behaviors can the troop expect to see from him? As Punch continues to integrate into his troop, I would expect to see some social testing by other members of the group to see how Punch responds- they may use mild aggression like open mouth threats or direct stares (which arethreatening is macaques), brief chases, and displacement from resources like food/resting spots. These will help clarify Punch’s rank and help form and maintain a stable hierarchy. Therefore, I hope to see Punch make at least a few strong social bonds (friends), to help defend him against more intense aggression. As long as he makes a few friends, he should begin to receive more affiliative behavior. Integration is usually gradual as these bonds form and strengthen and these skills develop. I would expect to see more play and grooming with conspecifics and less reliance on his stuffed orangutan as real social bonds start to form. Grooming is especially important for forming and maintaining social bonds and there are already videos showing Punch receiving some grooming from older monkeys, which bodes well for him. He also needs to respond in socially appropriate ways, like grooming others and showing submission to higher ranking individuals. Essentially, he needs to understand and follow the rules of Japanese macaque society. Q: What message do you have as people continue to root for Punch?  It's uplifting to see how much support Punch has gained across the world. And while Punch is clearly adorable and so vulnerable that you just want to love him and give him (or other monkeys like him) a home, it’s important to remember that more than anything else, he needs to live with other monkeys so that he can live a life that is true to his species and nature. Unfortunately, many people still have monkeys as pets. The illegal wildlife trade is a multi-billion-dollar industry, ranking as the fourth largest illegal trade after drugs, arms, and human trafficking. Within the United States, it is estimated that there are more than 15,000 nonhuman primates living in unsuitable conditions. Primates are intelligent, sentient beings that need complex communities and relationships to thrive. There currently is no federal legislation that protects primates from private ownership, but the Captive Primate Safety Act (H.R.3199/ S.1594) has been proposed to prohibit the private possession of nonhuman primates and the sale or transportation of nonhuman primates for the wild pet trade. If you're interested in connecting with Catherine and learning more about animal behavior,  let us help. Contact  Adam Lowenstein, Assistant Vice President for External Affairs at Florida Institute of Technology, at adam@fit.edu to arrange an interview today.

Ape Ancestors and Neanderthals Likely Kissed, New Analysis Finds featured image

3 min

Ape Ancestors and Neanderthals Likely Kissed, New Analysis Finds

Kissing occurs in a variety of animals but presents an evolutionary puzzle: it appears to carry high risks, such as disease transmission, while offering no obvious reproductive or survival advantage. Despite kissing carrying cultural and emotional significance in many human societies, up to now researchers have paid little attention to its evolutionary history. In the new study, “A comparative approach to the evolution of kissing,” published this week in the journal Evolution and Human Behavior, the researchers carried out the first attempt to reconstruct the evolutionary history of kissing using a cross-species approach based on the primate family tree. The results indicate that kissing is an ancient trait in the large apes, evolving in the ancestor to that group 21.5 – 16.9 million years ago. Kissing was retained over the course of evolution and is still present in most of the large apes. The team also found that our extinct human relatives, Neanderthals, were likely to have engaged in kissing too. This finding, together with previous studies showing that humans and Neanderthals shared oral microbes (via saliva transfer) and genetic material (via interbreeding), strongly suggests that humans and Neanderthals kissed one another. “While kissing may seem like an ordinary or universal behavior, it is only documented in 46% of human cultures,” said Catherine Talbot, co-author and assistant professor in the College of Psychology at Florida Tech. “The social norms and context vary widely across societies, raising the question of whether kissing is an evolved behavior or cultural invention. This is the first step in addressing that question.” Matilda Brindle, lead author and evolutionary biologist at Oxford’s Department of Biology, said: “This is the first time anyone has taken a broad evolutionary lens to examine kissing. Our findings add to a growing body of work highlighting the remarkable diversity of sexual behaviors exhibited by our primate cousins.” To run the analyses, the team first defined what constitutes a kiss. This was challenging because many mouth-to-mouth behaviours look like kissing. Since the researchers were exploring kissing across different species, the definition also needed to be applicable to a wide range of animals. They therefore defined kissing as non-aggressive, mouth-to-mouth contact that did not involve food transfer. Having established this definition, the researchers collected data from the literature on which modern primate species have been observed kissing, focusing on the group of monkeys and apes that evolved in Africa, Europe and Asia. This included chimpanzees, bonobos, and orangutans, all of which have been observed kissing. They then ran a phylogenetic analysis, treating kissing as a ‘trait’ and mapping this to the family tree of primates. They used a statistical approach (called Bayesian modelling) to simulate different evolution scenarios along the branches of the tree, to estimate the probability that different ancestors also engaged in kissing. The model was run 10 million times to give robust statistical estimates. Stuart West, co-author and professor of evolutionary biology at Oxford, said, “By integrating evolutionary biology with behavioral data, we’re able to make informed inferences about traits that don’t fossilise – like kissing. This lets us study social behaviour in both modern and extinct species.” While the researchers caution that existing data are limited – particularly outside the large apes – the study offers a framework for future work and provides a way for primatologists to record kissing behaviors in nonhuman animals using a consistent definition.

Expert Insight: Dampening the Data Desert: A First Step Toward Improving Space Coast Climate Resilience featured image

3 min

Expert Insight: Dampening the Data Desert: A First Step Toward Improving Space Coast Climate Resilience

By Steven Lazarus Like many coastal regions, Florida’s Space Coast faces significant climate resilience challenges and risks. According to the National Oceanic and Atmospheric Administration (NOAA), Florida has over 8,000 miles of shoreline, more than any other state in the contiguous U.S. In addition, the 2020 census indicates that that there are 21 million Florida residents, 75-80% of which live in coastal counties. This makes our state particularly vulnerable to rising sea levels, which are directly responsible for a host of coastal impacts, such as saltwater intrusion, sunny-day (high-tide) flooding, worsening surge, etc. There is growing evidence that storms are becoming wetter as the atmosphere warms— increasing the threat associated with compound flooding, which involves the combined effects of storm surge, rainfall, tides and river flow. Inland flooding events are also increasing due to overdevelopment, heavy precipitation and aging and/or inadequate infrastructure. The economic ramifications of these problems are quite evident, as area residents are confronted with the rising costs of their homeowners and flood insurance policies. As the principal investigator on a recently funded Department of Energy grant, Space Coast ReSCUE (Resilience Solutions for Climate, Urbanization, and Environment), I am working with Argonne National Laboratory, Florida Tech colleagues, community organizations and local government to improve our climate resilience in East Central Florida. It is remarkable that, despite its importance for risk management, urban planning and evaluating the environmental impacts of runoff, official data regarding local flooding is virtually nonexistent! Working alongside a local nonprofit, we have installed 10 automated weather stations and manual rain gauges in what was previously a “data desert” east of the Florida Tech campus: one at Stone Magnet Middle School and others at local homes. “We think that a ‘best methods’ approach is proactive, informed and cost-effective. The foundation of good decision-making, assessment and planning is built on data (model and observations), which are critical to adequately addressing the impact of climate on our communities.” – steven lazarus, meteorology professor, ocean engineering and marine sciences Data from these stations are available, in real-time, from two national networks: CoCoRaHS and Weather Underground. The citizen science initiative involving the rain gauge measurements is designed to document flooding in a neighborhood with limited resources. In addition to helping residents make informed choices, these data will also provide a means by which we can evaluate our flood models that will be used to create highly detailed flood maps of the neighborhood. We are working with two historic extreme-precipitation events: Hurricane Irma (2017) and Tropical Storm Fay (2008)—both of which produced excessive flooding in the area. What might the local flooding look like, in the future, as storms become wetter? To find out, we plan to simulate these two storms in both present-day and future climate conditions. What will heat stress, a combination of temperature and humidity, feel like in the future? What impact will this have on energy consumption? The station data will also be used develop and test building energy-efficiency tools designed to help the community identify affordable ways to reduce energy consumption, as well as to produce high-precision urban heat island (heat stress) maps that account for the impact of individual buildings. The heat island and building energy modeling will be complemented by a drone equipped with an infrared camera, which will provide an observation baseline. We think that a “best methods” approach is proactive, informed and cost-effective. The foundation of good decision-making, assessment and planning is built on data (model and observations), which are critical to adequately addressing the impact of climate on our communities.

View all posts