NASA Asks Researchers to Help Define Trustworthiness in Autonomous Systems

Bhattacharyya, Carroll Leading Interdisciplinary Team in Prestigious University Leadership Initiative Program

May 16, 2025

4 min

Meredith Carroll, Ph.D.




A Florida Tech-led group of researchers was selected to help NASA solve challenges in aviation through its prestigious University Leadership Initiative (ULI) program. Over the next three years, associate professor of computer science and software engineering Siddhartha Bhattacharyya and professor of aviation human factors Meredith Carroll will work to understand the vital role of trust in autonomy.


Their project, “Trustworthy Resilient Autonomous Agents for Safe City Transportation in the Evolving New Decade” (TRANSCEND), aims to establish a common framework for engineers and human operators to determine the trustworthiness of machine-learning-enabled autonomous aviation safety systems.


Autonomous systems are those that can perform independent tasks without requiring human control. The autonomy of these systems is expected to be enhanced with intelligence gained from machine learning. As a result, intelligence-based software is expected to be increasingly used in airplanes and drones. It may also be utilized in airports and to manage air traffic in the future.


Learning-enabled autonomous technology can also act as contingency management when used in safety applications, proactively addressing potential disruptions and unexpected aviation events.


TRANSCEND was one of three projects chosen for the latest ULI awards. The others hail from Embry-Riddle Aeronautical University in Daytona Beach – researching continuously updating, self-diagnostic vehicle health management to enhance the safety and reliability of Advanced Air Mobility vehicles – and University of Colorado Boulder – investigating tools for understanding and leveraging the complex communications environment of collaborative, autonomous airspace systems.


Florida Tech’s team includes nine faculty members from five universities: Penn State; North Carolina A&T State University; University of Florida; Stanford University; Santa Fe College. It also involves the companies Collins Aerospace in Cedar Rapids, Iowa and ResilienX of Syracuse, New York. Carroll and Bhattacharyya will also involve students throughout the project.


Human operators are an essential component of aviation technology – they monitor independent software systems and associated data and intervene when those systems fail. They may include flight crew members, air traffic controllers, maintenance personnel or safety staff monitoring overall system safety.


A challenge in implementing independent software is that engineers and operators have different interpretations of what makes a system “trustworthy,” Carroll and Bhattacharyya explained. Engineers who develop autonomous software measure trustworthiness by the system’s ability to perform as designed. Human operators, however, trust and rely on systems to perform as they expect – they want to feel comfortable relying on a system to make an aeronautical decision in flight, such as how to avoid a traffic conflict or a weather event. Sometimes, that reliance won’t align with design specifications.


Equally important, operators also need to trust that the software will alert them when it needs a human to take over. This may happen if the algorithm driving the software encounters a scenario it wasn’t trained for.


“We are looking at how we can integrate trust from different communities – from human factors, from formal methods, from autonomy, from AI…” Bhattacharyya said. “How do we convey assumptions for trust, from design time to operation, as the intelligent systems are being deployed, so that we can trust them and know when they’re going to fail, especially those that are learning-enabled, meaning they adapt based on machine learning algorithms?”


With Bhattacharyya leading the engineering side and Carroll leading the human factors side, the research group will begin bridging the trust gap by integrating theories, principles, methods, measures, visualizations, explainability and practices from different domains – this will build the TRANSCEND framework. Then, they’ll test the framework using a diverse range of tools, flight simulators and intelligent decision-making to demonstrate trustworthiness in practice. This and other data will help them develop a safety case toolkit of guidelines for development processes, recommendations and suggested safety measures for engineers to reference when designing “trustworthy,” learning-enabled autonomous systems.


Ultimately, Bhattacharyya and Carroll hope their toolkit will lay the groundwork for a future learning-enabled autonomous systems certification process.


“The goal is to combine all our research capabilities and pull together a unified story that outputs unified products to the industry,” Carroll said. “We want products for the industry to utilize when implementing learning-enabled autonomy for more effective safety management systems.”


The researchers also plan to use this toolkit to teach future engineers about the nuances of trust in the products they develop. Once developed, they will hold outreach events, such as lectures and camps, for STEM-minded students in the community.


If you're interested in connecting with Meredith Carroll or Siddhartha Bhattacharyya - simply click on the expert's profile or contact  Adam Lowenstein, Director of Media Communications at Florida Institute of Technology at adam@fit.edu to arrange an interview today.

Connect with:
Meredith Carroll, Ph.D.

Meredith Carroll, Ph.D.

Professor | College of Aeronautics

Dr. Carroll's research focuses on decision-making in complex systems, human-machine teaming, performance assessment and adaptive training.

Training Fidelity AnalysisAdaptive TrainingIndividual DifferencesUrban Air Mobility (UAM)Cybersecurity

You might also like...

Check out some other posts from Florida Tech

3 min

Expert Insight: Dampening the Data Desert: A First Step Toward Improving Space Coast Climate Resilience

By Steven Lazarus Like many coastal regions, Florida’s Space Coast faces significant climate resilience challenges and risks. According to the National Oceanic and Atmospheric Administration (NOAA), Florida has over 8,000 miles of shoreline, more than any other state in the contiguous U.S. In addition, the 2020 census indicates that that there are 21 million Florida residents, 75-80% of which live in coastal counties. This makes our state particularly vulnerable to rising sea levels, which are directly responsible for a host of coastal impacts, such as saltwater intrusion, sunny-day (high-tide) flooding, worsening surge, etc. There is growing evidence that storms are becoming wetter as the atmosphere warms— increasing the threat associated with compound flooding, which involves the combined effects of storm surge, rainfall, tides and river flow. Inland flooding events are also increasing due to overdevelopment, heavy precipitation and aging and/or inadequate infrastructure. The economic ramifications of these problems are quite evident, as area residents are confronted with the rising costs of their homeowners and flood insurance policies. As the principal investigator on a recently funded Department of Energy grant, Space Coast ReSCUE (Resilience Solutions for Climate, Urbanization, and Environment), I am working with Argonne National Laboratory, Florida Tech colleagues, community organizations and local government to improve our climate resilience in East Central Florida. It is remarkable that, despite its importance for risk management, urban planning and evaluating the environmental impacts of runoff, official data regarding local flooding is virtually nonexistent! Working alongside a local nonprofit, we have installed 10 automated weather stations and manual rain gauges in what was previously a “data desert” east of the Florida Tech campus: one at Stone Magnet Middle School and others at local homes. “We think that a ‘best methods’ approach is proactive, informed and cost-effective. The foundation of good decision-making, assessment and planning is built on data (model and observations), which are critical to adequately addressing the impact of climate on our communities.” – steven lazarus, meteorology professor, ocean engineering and marine sciences Data from these stations are available, in real-time, from two national networks: CoCoRaHS and Weather Underground. The citizen science initiative involving the rain gauge measurements is designed to document flooding in a neighborhood with limited resources. In addition to helping residents make informed choices, these data will also provide a means by which we can evaluate our flood models that will be used to create highly detailed flood maps of the neighborhood. We are working with two historic extreme-precipitation events: Hurricane Irma (2017) and Tropical Storm Fay (2008)—both of which produced excessive flooding in the area. What might the local flooding look like, in the future, as storms become wetter? To find out, we plan to simulate these two storms in both present-day and future climate conditions. What will heat stress, a combination of temperature and humidity, feel like in the future? What impact will this have on energy consumption? The station data will also be used develop and test building energy-efficiency tools designed to help the community identify affordable ways to reduce energy consumption, as well as to produce high-precision urban heat island (heat stress) maps that account for the impact of individual buildings. The heat island and building energy modeling will be complemented by a drone equipped with an infrared camera, which will provide an observation baseline. We think that a “best methods” approach is proactive, informed and cost-effective. The foundation of good decision-making, assessment and planning is built on data (model and observations), which are critical to adequately addressing the impact of climate on our communities.

4 min

Simulations of Exoplanet Formation May Help Inform Search for Extraterrestrial Life

Florida Tech astrophysicist Howard Chen is offering new insights to help aid NASA’s search for life beyond Earth. His latest theoretical work investigates the TRAPPIST-1 planetary system, one of the most widely studied exoplanetary systems in the galaxy. It has captured scientists’ attention for its potential to host water, and thus possibly life, on its planets. Now, he’s offering an explanation for why telescopes have yet to find definitive signs of either. The paper “Born Dry or Born Wet? A Palette of Water Growth Histories in TRAPPIST-1 Analogs and Compact Planetary Systems” was authored by Chen, an assistant professor of space sciences, and researchers from NASA, Johns Hopkins University and Harvard University, was published in The Astrophysical Journal Letters in September. It explores the likelihood that TRAPPIST-1’s three innermost exoplanets contained no water when they formed, despite existing in a zone where water is viable. TRAPPIST-1 is a red dwarf star located about 40 light-years away from us. (One light year is about 6 trillion miles.) It is thought to be about 7.6 billion years old, or 3 billion years older than our Sun. Astronomers are captivated by the TRAPPIST-1 system because its seven known planets are rocky and Earth-like. They also fall within the star’s habitable zone: the distance range from a star at which temperatures are not too hot or cold to support liquid water. Researchers are searching for any evidence of water on these planets, but have yet to detect anything. Some think a lack of gas in the atmosphere is disrupting the light needed to pick up detailed visuals. Others predict water could have escaped the planets’ atmospheres throughout their evolution. Chen and his team, however, decided to research a different theory: that there was no water to begin with because there was no gas to contain it. He would test it not from an observational perspective, but with mathematical modeling of the planets’ initial formation. “You have astronomers who are using telescopes to see what’s out there. I come from a different perspective,” Chen said. “I’m both trying to explain what we’re seeing while trying to make predictions about what we can’t.” The researchers created models that examined the composition and growth of these planets starting when they were as small as one kilometer wide. They simulated how material aggregated during collisions with other celestial objects until they reached their final planetary formations. There are several key factors in collision events that heavily influence a planet’s final composition. Chen’s models incorporated impact delivery, which is the transfer of materials like water and gases during a celestial collision; impact erosion, which refers to the removal of materials in a planet’s atmosphere due to impact; and mantle-atmosphere exchange, which is the transfer of water and gases between a planet’s atmosphere and mantle to maintain its conditions. The team ran hundreds of collision simulations, which returned thousands of different possibilities for how TRAPPIST-1’s planets might have formed. They varied several components, such as the amount of water available to the system, the profile of the initial planet formation environment, the planets’ density profiles and the initial system conditions. For the inner worlds, specifically the first three planets, most of the simulations came back dry. “Whatever we did, we couldn’t get much water in these inner planets,” Chen said. He believes that the main reason the planets couldn’t acquire water is due to the nature of the collision events. Compact planet collisions are higher velocity, so they are more aggressive and energetic, Chen said. This means that instead of acquiring material for a gaseous atmosphere, planets’ atmospheres were completely cleared out by the power of the collisions. With no gas in the atmosphere to contain water, it’s possible that any previously existing water escaped back into space during these collision events. Understanding a planet’s earliest characteristics, its water, air and carbon content, builds the foundation for how they evolve. That way, when researchers identify a planet that seems viable for life at the surface level, they can use Chen’s model to simulate what these distant worlds might be like on the inside, on the surface and in the air. Combining the theoretical context of a planet’s formation with the state in which it was discovered can help researchers – and NASA – make informed, efficient decisions on which planets are worth investigating and when it’s time to move on to the next. If you're interested in connecting with Howard Chen about the search for life beyond Earth, let us help. Contact Adam Lowenstein, Assistant Vice President for External Affairs at Florida Institute of Technology, at adam@fit.edu to arrange an interview today.

2 min

Expert Insight: Understanding the Pacific Ocean's Missing Cold Water Surge

There's a mystery brewing in the Pacific Ocean, and it's worrying marine researchers. Every winter, between January and April, a blast of cold water surges from the bottom to the top of the Gulf of Panama. The cold surge helps marine life survive heat waves. However, this year, there was no blast. Researchers are concerned about the disappearance and believe it could be a sign of a larger problem. The phenomenon has garnered the attention of reporters from outlets like the New York Times, as well as others from across the nation. They're looking for answers.  To help find those answers, experts such as the Florida Institute of Technology's Richard Aronson are available to help explain what's happening deep beneath the surface. Each year between January and April, a blob of cold water rises from the depths of the Gulf of Panama to the surface, playing an essential role in supporting marine life in the region. But this year, it never arrived. “It came as a surprise,” said Ralf Schiebel, a paleoceanographer at the Max Planck Institute for Chemistry who studies the region. “We’ve never seen something like this before.” Richard Aronson, a professor of marine sciences at the Florida Institute of Technology, has studied this particular patch of ocean off the coast of Panama for decades. The cold blob gives those corals a better chance of surviving marine heat waves than other areas, he said. Heat stress has plunged the world’s coral reefs into ongoing mass bleaching that began in January 2023. About 85 percent of the world’s coral reef areas have been affected, according to the National Oceanic and Atmospheric Administration. “The climate is warming, that’s putting coral reefs at risk,” said Dr. Aronson, who was not involved with the paper. While corals can adapt to changes in temperature, the climate is changing too quickly for them to keep up in the long run, he said. Sea surface temperatures have risen by more than 1 degree Celsius since humans began burning fossil fuels during the Industrial Revolution, breaking records in 2024 and 2023. It’s too soon to tell if the blob will return in future years. But if it disappears repeatedly, then “it’s cause for grave concern,” Dr. Aronson said. If you’re covering this topic or looking to speak with an expert about climate change and its impact on our oceans, Richard Aronson is available for interviews. Simply click the icon below to connect with him today.

View all posts