Jeff Schneider

Research Professor, Robotics Institute Carnegie Mellon University

  • Pittsburgh PA

Jeff Schneider is researching how to use machine learning to control fusion reactions.

Contact

Carnegie Mellon University

View more experts managed by Carnegie Mellon University

Biography

Dr. Schneider's research interests are in all areas of machine learning and data mining. He has over 15 years experience developing, publishing, and applying machine learning algorithms in government, science, and industry. He has over a hundred publications and has given numerous invited talks and tutorials on the subject. His student Ian Char, a doctoral candidate in the Machine Learning Department, used reinforcement learning to control the hydrogen plasma of the tokamak machine at the DIII-D National Fusion Facility in San Diego.

Dr. Schneider was the co-founder and CEO of Schenley Park Research, Inc. (SPR), a company dedicated to bringing new machine learning algorithms to industry. Later, he developed a new machine-learning based CNS drug discovery system and spent a two-year sabbatical as the Chief Informatics Officer of Psychogenics, Inc. to commercialize the system. During his most recent sabbatical he helped launch Uber's self driving car program in Pittsburgh where he built autonomy, data science, and machine learning teams.

Jeff does consulting on a regular basis. Through his work at CMU and his commercial and consulting efforts, he has worked with several dozen companies and government agencies including ten Fortune 500 companies, and many international groups around the world.

Areas of Expertise

Artifical Intelligence
Motion Control
Robotics Foundations
Learning and Classification
Self-Driving Cars
Reinforcement Learning
Motion Planning
Multi-Robot Planning & Coordination
Deep Learning
Data Mining

Media Appearances

Power Shift: How CMU Is Leading America’s Energy Evolution

CMU News  online

2025-07-11

From reimagining AI data centers to modernizing and securing the electric grid, CMU researchers are working on practical solutions to pressing challenges in how the U.S. produces, moves and secures energy.

“Many of the world's grand challenges like a sufficient food supply, clean water availability and climate issues are actually just energy problems," says Jeff Schneider, a research professor in CMU’s School of Computer Science. "Nuclear fusion and its promise of limitless clean energy would solve many of them."

View More

CMU Experts at the Intersection of Energy and Innovation

CMU News  online

2025-07-11

Carnegie Mellon University experts are developing practical solutions for a fast-changing energy system.

"This moment in energy history is unique because AI will play a central role in accelerating the development, optimization and operation of our energy sources,"says Jeff Schneider, Research Professor in Carnegie Mellon University's Robotics Institute. "Generative AI models now usefully represent and exploit the domain knowledge for these tasks while reinforcement learning and other discovery and control learning algorithms can now solve real-world problems much faster than the old human-only method of making technological progress.

View More

Research Using AI in Energy Applications at CMU Showcases the Frontier of Opportunities

Carnegie Mellon University  online

2025-03-24

Using AI could help unlock a new potential source of energy to solve that problem, including work by Jeff Schneider, research professor in the School of Computer Science, and his research team studying nuclear fusion.

View More

Spotlight

1 min

CMU Experts at the Intersection of Energy and Innovation

Carnegie Mellon University experts are developing practical solutions for a fast-changing energy system. Their work modernizes infrastructure, accelerates innovation and harnesses AI for a more efficient and resilient future at a moment when the stakes for national competitiveness and public well-being have never been higher. Learn what CMU experts have to say about their Work That Matters.

Jeff SchneiderHarry KrejsaValerie KarplusChris TelmerErica FuchsBurcu Akinci

Media

Social

Industry Expertise

Computer Networking
Education/Learning

Education

Michigan State University

B.S.

Computer Science

University of Rochester

Ph.D.

Computer Science

Event Appearances

Reinforcement Learning: From Self-Driving Cars to Nuclear Fusion

2023 | CMS Large Hadron Collider Annual Meeting  Pittsburgh, PA

Reinforcement Learning for Controlled Nuclear Fusion in Tokamaks

2023 | General Electric EDGE Symposium  Niskayuna, NY

Robots and Autonomy

2023 | US Coast Guard AI Boot Camp  Online

Patents

Motion prediction for autonomous devices

US11635764

Systems, methods, tangible non-transitory computer-readable media, and devices associated with the motion prediction and operation of a device including a vehicle are provided. For example, a vehicle computing system can access state data including information associated with locations and characteristics of objects over a plurality of time intervals. Trajectories of the objects at subsequent time intervals following the plurality of time intervals can be determined based on the state data and a machine-learned tracking and kinematics model. The trajectories of the objects can include predicted locations of the objects at subsequent time intervals that follow the plurality of time intervals. Further, the predicted locations of the objects can be based on physical constraints of the objects.

View more

Object motion prediction and autonomous vehicle control

US11835951

2021-10-25 Assigned to UBER TECHNOLOGIES, INC. reassignment UBER TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: RADOSAVLJEVIC, VLADAN, HUANG, TZU-KUO, CHOU, FANG-CHIEH, CUI, Henggang, DJURIC, Nemanja, LIN, TSUNG-HAN, NGUYEN, Thi Duong, SCHNEIDER, Jeff

View more

Determining autonomous vehicle routes

US11953901

An autonomous vehicle includes one or more sensors for detecting an object in an environment surrounding the autonomous vehicle and a vehicle computing system comprising one or more processors receiving canonical route data associated with at least one canonical route, and controlling travel of the autonomous vehicle based on sensor data from the one or more sensors and the canonical route data associated with the at least one canonical route. The at least one canonical route comprises at least one roadway connected with another roadway in a plurality of roadways in a geographic location that satisfies at least one route optimization function derived based on trip data associated with one or more traversals of the plurality of roadways in a geographic location by one or more autonomous vehicles.

View more

Articles

Exploring data-driven models for spatiotemporally local classification of Alfvén eigenmodes

Nuclear Fusion

2022

Alfvén eigenmodes (AEs) are an important and complex class of plasma dynamics commonly observed in tokamaks and other plasma devices. In this work, we manually labeled a small database of 26 discharges from the DIII-D tokamak in order to train simple neural-network-based models for classifying AEs. The models provide spatiotemporally local identification of four types of AEs by using an array of 40 electron cyclotron emission (ECE) signals as inputs. Despite the minimal dataset, this strategy performs well at spatiotemporally localized classification of AEs, indicating future opportunities for more sophisticated models and incorporation into real-time control strategies.

View more

Exploration via planning for information about the optimal trajectory

Advances in Neural Information Processing Systems

2022

Many potential applications of reinforcement learning (RL) are stymied by the large numbers of samples required to learn an effective policy. This is especially true when applying RL to real-world control tasks, eg in the sciences or robotics, where executing a policy in the environment is costly. In popular RL algorithms, agents typically explore either by adding stochasticity to a reward-maximizing policy or by attempting to gather maximal information about environment dynamics without taking the given task into account. In this work, we develop a method that allows us to plan for exploration while taking both the task and the current knowledge about the dynamics into account. The key insight to our approach is to plan an action sequence that maximizes the expected information gain about the optimal trajectory for the task at hand.

View more

PID-inspired inductive biases for deep reinforcement learning in partially observable control tasks

Advances in Neural Information Processing Systems

2023

Deep reinforcement learning (RL) has shown immense potential for learning to control systems through data alone. However, one challenge deep RL faces is that the full state of the system is often not observable. When this is the case, the policy needs to leverage the history of observations to infer the current state. At the same time, differences between the training and testing environments makes it critical for the policy not to overfit to the sequence of observations it sees at training time. As such, there is an important balancing act between having the history encoder be flexible enough to extract relevant information, yet be robust to changes in the environment. To strike this balance, we look to the PID controller for inspiration. We assert the PID controller's success shows that only summing and differencing are needed to accumulate information over time for many control tasks.

View more

Show All +