NASA Asks Researchers to Help Define Trustworthiness in Autonomous Systems

Bhattacharyya, Carroll Leading Interdisciplinary Team in Prestigious University Leadership Initiative Program

May 16, 2025

4 min

Meredith Carroll, Ph.D.




A Florida Tech-led group of researchers was selected to help NASA solve challenges in aviation through its prestigious University Leadership Initiative (ULI) program. Over the next three years, associate professor of computer science and software engineering Siddhartha Bhattacharyya and professor of aviation human factors Meredith Carroll will work to understand the vital role of trust in autonomy.


Their project, “Trustworthy Resilient Autonomous Agents for Safe City Transportation in the Evolving New Decade” (TRANSCEND), aims to establish a common framework for engineers and human operators to determine the trustworthiness of machine-learning-enabled autonomous aviation safety systems.


Autonomous systems are those that can perform independent tasks without requiring human control. The autonomy of these systems is expected to be enhanced with intelligence gained from machine learning. As a result, intelligence-based software is expected to be increasingly used in airplanes and drones. It may also be utilized in airports and to manage air traffic in the future.


Learning-enabled autonomous technology can also act as contingency management when used in safety applications, proactively addressing potential disruptions and unexpected aviation events.


TRANSCEND was one of three projects chosen for the latest ULI awards. The others hail from Embry-Riddle Aeronautical University in Daytona Beach – researching continuously updating, self-diagnostic vehicle health management to enhance the safety and reliability of Advanced Air Mobility vehicles – and University of Colorado Boulder – investigating tools for understanding and leveraging the complex communications environment of collaborative, autonomous airspace systems.


Florida Tech’s team includes nine faculty members from five universities: Penn State; North Carolina A&T State University; University of Florida; Stanford University; Santa Fe College. It also involves the companies Collins Aerospace in Cedar Rapids, Iowa and ResilienX of Syracuse, New York. Carroll and Bhattacharyya will also involve students throughout the project.


Human operators are an essential component of aviation technology – they monitor independent software systems and associated data and intervene when those systems fail. They may include flight crew members, air traffic controllers, maintenance personnel or safety staff monitoring overall system safety.


A challenge in implementing independent software is that engineers and operators have different interpretations of what makes a system “trustworthy,” Carroll and Bhattacharyya explained. Engineers who develop autonomous software measure trustworthiness by the system’s ability to perform as designed. Human operators, however, trust and rely on systems to perform as they expect – they want to feel comfortable relying on a system to make an aeronautical decision in flight, such as how to avoid a traffic conflict or a weather event. Sometimes, that reliance won’t align with design specifications.


Equally important, operators also need to trust that the software will alert them when it needs a human to take over. This may happen if the algorithm driving the software encounters a scenario it wasn’t trained for.


“We are looking at how we can integrate trust from different communities – from human factors, from formal methods, from autonomy, from AI…” Bhattacharyya said. “How do we convey assumptions for trust, from design time to operation, as the intelligent systems are being deployed, so that we can trust them and know when they’re going to fail, especially those that are learning-enabled, meaning they adapt based on machine learning algorithms?”


With Bhattacharyya leading the engineering side and Carroll leading the human factors side, the research group will begin bridging the trust gap by integrating theories, principles, methods, measures, visualizations, explainability and practices from different domains – this will build the TRANSCEND framework. Then, they’ll test the framework using a diverse range of tools, flight simulators and intelligent decision-making to demonstrate trustworthiness in practice. This and other data will help them develop a safety case toolkit of guidelines for development processes, recommendations and suggested safety measures for engineers to reference when designing “trustworthy,” learning-enabled autonomous systems.


Ultimately, Bhattacharyya and Carroll hope their toolkit will lay the groundwork for a future learning-enabled autonomous systems certification process.


“The goal is to combine all our research capabilities and pull together a unified story that outputs unified products to the industry,” Carroll said. “We want products for the industry to utilize when implementing learning-enabled autonomy for more effective safety management systems.”


The researchers also plan to use this toolkit to teach future engineers about the nuances of trust in the products they develop. Once developed, they will hold outreach events, such as lectures and camps, for STEM-minded students in the community.


If you're interested in connecting with Meredith Carroll or Siddhartha Bhattacharyya - simply click on the expert's profile or contact  Adam Lowenstein, Director of Media Communications at Florida Institute of Technology at adam@fit.edu to arrange an interview today.

Connect with:
Meredith Carroll, Ph.D.

Meredith Carroll, Ph.D.

Professor | College of Aeronautics

Dr. Carroll's research focuses on decision-making in complex systems, human-machine teaming, performance assessment and adaptive training.

Training Fidelity AnalysisAdaptive TrainingIndividual DifferencesUrban Air Mobility (UAM)Cybersecurity

You might also like...

Check out some other posts from Florida Tech

3 min

Ape Ancestors and Neanderthals Likely Kissed, New Analysis Finds

Kissing occurs in a variety of animals but presents an evolutionary puzzle: it appears to carry high risks, such as disease transmission, while offering no obvious reproductive or survival advantage. Despite kissing carrying cultural and emotional significance in many human societies, up to now researchers have paid little attention to its evolutionary history. In the new study, “A comparative approach to the evolution of kissing,” published this week in the journal Evolution and Human Behavior, the researchers carried out the first attempt to reconstruct the evolutionary history of kissing using a cross-species approach based on the primate family tree. The results indicate that kissing is an ancient trait in the large apes, evolving in the ancestor to that group 21.5 – 16.9 million years ago. Kissing was retained over the course of evolution and is still present in most of the large apes. The team also found that our extinct human relatives, Neanderthals, were likely to have engaged in kissing too. This finding, together with previous studies showing that humans and Neanderthals shared oral microbes (via saliva transfer) and genetic material (via interbreeding), strongly suggests that humans and Neanderthals kissed one another. “While kissing may seem like an ordinary or universal behavior, it is only documented in 46% of human cultures,” said Catherine Talbot, co-author and assistant professor in the College of Psychology at Florida Tech. “The social norms and context vary widely across societies, raising the question of whether kissing is an evolved behavior or cultural invention. This is the first step in addressing that question.” Matilda Brindle, lead author and evolutionary biologist at Oxford’s Department of Biology, said: “This is the first time anyone has taken a broad evolutionary lens to examine kissing. Our findings add to a growing body of work highlighting the remarkable diversity of sexual behaviors exhibited by our primate cousins.” To run the analyses, the team first defined what constitutes a kiss. This was challenging because many mouth-to-mouth behaviours look like kissing. Since the researchers were exploring kissing across different species, the definition also needed to be applicable to a wide range of animals. They therefore defined kissing as non-aggressive, mouth-to-mouth contact that did not involve food transfer. Having established this definition, the researchers collected data from the literature on which modern primate species have been observed kissing, focusing on the group of monkeys and apes that evolved in Africa, Europe and Asia. This included chimpanzees, bonobos, and orangutans, all of which have been observed kissing. They then ran a phylogenetic analysis, treating kissing as a ‘trait’ and mapping this to the family tree of primates. They used a statistical approach (called Bayesian modelling) to simulate different evolution scenarios along the branches of the tree, to estimate the probability that different ancestors also engaged in kissing. The model was run 10 million times to give robust statistical estimates. Stuart West, co-author and professor of evolutionary biology at Oxford, said, “By integrating evolutionary biology with behavioral data, we’re able to make informed inferences about traits that don’t fossilise – like kissing. This lets us study social behaviour in both modern and extinct species.” While the researchers caution that existing data are limited – particularly outside the large apes – the study offers a framework for future work and provides a way for primatologists to record kissing behaviors in nonhuman animals using a consistent definition.

3 min

Expert Insight: Dampening the Data Desert: A First Step Toward Improving Space Coast Climate Resilience

By Steven Lazarus Like many coastal regions, Florida’s Space Coast faces significant climate resilience challenges and risks. According to the National Oceanic and Atmospheric Administration (NOAA), Florida has over 8,000 miles of shoreline, more than any other state in the contiguous U.S. In addition, the 2020 census indicates that that there are 21 million Florida residents, 75-80% of which live in coastal counties. This makes our state particularly vulnerable to rising sea levels, which are directly responsible for a host of coastal impacts, such as saltwater intrusion, sunny-day (high-tide) flooding, worsening surge, etc. There is growing evidence that storms are becoming wetter as the atmosphere warms— increasing the threat associated with compound flooding, which involves the combined effects of storm surge, rainfall, tides and river flow. Inland flooding events are also increasing due to overdevelopment, heavy precipitation and aging and/or inadequate infrastructure. The economic ramifications of these problems are quite evident, as area residents are confronted with the rising costs of their homeowners and flood insurance policies. As the principal investigator on a recently funded Department of Energy grant, Space Coast ReSCUE (Resilience Solutions for Climate, Urbanization, and Environment), I am working with Argonne National Laboratory, Florida Tech colleagues, community organizations and local government to improve our climate resilience in East Central Florida. It is remarkable that, despite its importance for risk management, urban planning and evaluating the environmental impacts of runoff, official data regarding local flooding is virtually nonexistent! Working alongside a local nonprofit, we have installed 10 automated weather stations and manual rain gauges in what was previously a “data desert” east of the Florida Tech campus: one at Stone Magnet Middle School and others at local homes. “We think that a ‘best methods’ approach is proactive, informed and cost-effective. The foundation of good decision-making, assessment and planning is built on data (model and observations), which are critical to adequately addressing the impact of climate on our communities.” – steven lazarus, meteorology professor, ocean engineering and marine sciences Data from these stations are available, in real-time, from two national networks: CoCoRaHS and Weather Underground. The citizen science initiative involving the rain gauge measurements is designed to document flooding in a neighborhood with limited resources. In addition to helping residents make informed choices, these data will also provide a means by which we can evaluate our flood models that will be used to create highly detailed flood maps of the neighborhood. We are working with two historic extreme-precipitation events: Hurricane Irma (2017) and Tropical Storm Fay (2008)—both of which produced excessive flooding in the area. What might the local flooding look like, in the future, as storms become wetter? To find out, we plan to simulate these two storms in both present-day and future climate conditions. What will heat stress, a combination of temperature and humidity, feel like in the future? What impact will this have on energy consumption? The station data will also be used develop and test building energy-efficiency tools designed to help the community identify affordable ways to reduce energy consumption, as well as to produce high-precision urban heat island (heat stress) maps that account for the impact of individual buildings. The heat island and building energy modeling will be complemented by a drone equipped with an infrared camera, which will provide an observation baseline. We think that a “best methods” approach is proactive, informed and cost-effective. The foundation of good decision-making, assessment and planning is built on data (model and observations), which are critical to adequately addressing the impact of climate on our communities.

4 min

Simulations of Exoplanet Formation May Help Inform Search for Extraterrestrial Life

Florida Tech astrophysicist Howard Chen is offering new insights to help aid NASA’s search for life beyond Earth. His latest theoretical work investigates the TRAPPIST-1 planetary system, one of the most widely studied exoplanetary systems in the galaxy. It has captured scientists’ attention for its potential to host water, and thus possibly life, on its planets. Now, he’s offering an explanation for why telescopes have yet to find definitive signs of either. The paper “Born Dry or Born Wet? A Palette of Water Growth Histories in TRAPPIST-1 Analogs and Compact Planetary Systems” was authored by Chen, an assistant professor of space sciences, and researchers from NASA, Johns Hopkins University and Harvard University, was published in The Astrophysical Journal Letters in September. It explores the likelihood that TRAPPIST-1’s three innermost exoplanets contained no water when they formed, despite existing in a zone where water is viable. TRAPPIST-1 is a red dwarf star located about 40 light-years away from us. (One light year is about 6 trillion miles.) It is thought to be about 7.6 billion years old, or 3 billion years older than our Sun. Astronomers are captivated by the TRAPPIST-1 system because its seven known planets are rocky and Earth-like. They also fall within the star’s habitable zone: the distance range from a star at which temperatures are not too hot or cold to support liquid water. Researchers are searching for any evidence of water on these planets, but have yet to detect anything. Some think a lack of gas in the atmosphere is disrupting the light needed to pick up detailed visuals. Others predict water could have escaped the planets’ atmospheres throughout their evolution. Chen and his team, however, decided to research a different theory: that there was no water to begin with because there was no gas to contain it. He would test it not from an observational perspective, but with mathematical modeling of the planets’ initial formation. “You have astronomers who are using telescopes to see what’s out there. I come from a different perspective,” Chen said. “I’m both trying to explain what we’re seeing while trying to make predictions about what we can’t.” The researchers created models that examined the composition and growth of these planets starting when they were as small as one kilometer wide. They simulated how material aggregated during collisions with other celestial objects until they reached their final planetary formations. There are several key factors in collision events that heavily influence a planet’s final composition. Chen’s models incorporated impact delivery, which is the transfer of materials like water and gases during a celestial collision; impact erosion, which refers to the removal of materials in a planet’s atmosphere due to impact; and mantle-atmosphere exchange, which is the transfer of water and gases between a planet’s atmosphere and mantle to maintain its conditions. The team ran hundreds of collision simulations, which returned thousands of different possibilities for how TRAPPIST-1’s planets might have formed. They varied several components, such as the amount of water available to the system, the profile of the initial planet formation environment, the planets’ density profiles and the initial system conditions. For the inner worlds, specifically the first three planets, most of the simulations came back dry. “Whatever we did, we couldn’t get much water in these inner planets,” Chen said. He believes that the main reason the planets couldn’t acquire water is due to the nature of the collision events. Compact planet collisions are higher velocity, so they are more aggressive and energetic, Chen said. This means that instead of acquiring material for a gaseous atmosphere, planets’ atmospheres were completely cleared out by the power of the collisions. With no gas in the atmosphere to contain water, it’s possible that any previously existing water escaped back into space during these collision events. Understanding a planet’s earliest characteristics, its water, air and carbon content, builds the foundation for how they evolve. That way, when researchers identify a planet that seems viable for life at the surface level, they can use Chen’s model to simulate what these distant worlds might be like on the inside, on the surface and in the air. Combining the theoretical context of a planet’s formation with the state in which it was discovered can help researchers – and NASA – make informed, efficient decisions on which planets are worth investigating and when it’s time to move on to the next. If you're interested in connecting with Howard Chen about the search for life beyond Earth, let us help. Contact Adam Lowenstein, Assistant Vice President for External Affairs at Florida Institute of Technology, at adam@fit.edu to arrange an interview today.

View all posts