Jeff Schneider

Research Professor, Robotics Institute Carnegie Mellon University

  • Pittsburgh PA

Jeff Schneider is researching how to use machine learning to control fusion reactions.

Contact

Carnegie Mellon University

View more experts managed by Carnegie Mellon University

Biography

Dr. Schneider's research interests are in all areas of machine learning and data mining. He has over 15 years experience developing, publishing, and applying machine learning algorithms in government, science, and industry. He has over a hundred publications and has given numerous invited talks and tutorials on the subject. His student Ian Char, a doctoral candidate in the Machine Learning Department, used reinforcement learning to control the hydrogen plasma of the tokamak machine at the DIII-D National Fusion Facility in San Diego.

Dr. Schneider was the co-founder and CEO of Schenley Park Research, Inc. (SPR), a company dedicated to bringing new machine learning algorithms to industry. Later, he developed a new machine-learning based CNS drug discovery system and spent a two-year sabbatical as the Chief Informatics Officer of Psychogenics, Inc. to commercialize the system. During his most recent sabbatical he helped launch Uber's self driving car program in Pittsburgh where he built autonomy, data science, and machine learning teams.

Jeff does consulting on a regular basis. Through his work at CMU and his commercial and consulting efforts, he has worked with several dozen companies and government agencies including ten Fortune 500 companies, and many international groups around the world.

Areas of Expertise

Artifical Intelligence
Motion Control
Robotics Foundations
Learning and Classification
Self-Driving Cars
Reinforcement Learning
Motion Planning
Multi-Robot Planning & Coordination
Deep Learning
Data Mining

Media Appearances

Research Using AI in Energy Applications at CMU Showcases the Frontier of Opportunities

Carnegie Mellon University  online

2025-03-24

Using AI could help unlock a new potential source of energy to solve that problem, including work by Jeff Schneider, research professor in the School of Computer Science, and his research team studying nuclear fusion.

View More

Media

Social

Industry Expertise

Computer Networking
Education/Learning

Education

University of Rochester

Ph.D.

Computer Science

Michigan State University

B.S.

Computer Science

Event Appearances

Robots and Autonomy

2023 | US Coast Guard AI Boot Camp  Online

Reinforcement Learning for Controlled Nuclear Fusion in Tokamaks

2023 | General Electric EDGE Symposium  Niskayuna, NY

Reinforcement Learning: From Self-Driving Cars to Nuclear Fusion

2023 | CMS Large Hadron Collider Annual Meeting  Pittsburgh, PA

Patents

Determining autonomous vehicle routes

US11953901

An autonomous vehicle includes one or more sensors for detecting an object in an environment surrounding the autonomous vehicle and a vehicle computing system comprising one or more processors receiving canonical route data associated with at least one canonical route, and controlling travel of the autonomous vehicle based on sensor data from the one or more sensors and the canonical route data associated with the at least one canonical route. The at least one canonical route comprises at least one roadway connected with another roadway in a plurality of roadways in a geographic location that satisfies at least one route optimization function derived based on trip data associated with one or more traversals of the plurality of roadways in a geographic location by one or more autonomous vehicles.

View more

Object motion prediction and autonomous vehicle control

US11835951

2021-10-25 Assigned to UBER TECHNOLOGIES, INC. reassignment UBER TECHNOLOGIES, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: RADOSAVLJEVIC, VLADAN, HUANG, TZU-KUO, CHOU, FANG-CHIEH, CUI, Henggang, DJURIC, Nemanja, LIN, TSUNG-HAN, NGUYEN, Thi Duong, SCHNEIDER, Jeff

View more

Motion prediction for autonomous devices

US11635764

Systems, methods, tangible non-transitory computer-readable media, and devices associated with the motion prediction and operation of a device including a vehicle are provided. For example, a vehicle computing system can access state data including information associated with locations and characteristics of objects over a plurality of time intervals. Trajectories of the objects at subsequent time intervals following the plurality of time intervals can be determined based on the state data and a machine-learned tracking and kinematics model. The trajectories of the objects can include predicted locations of the objects at subsequent time intervals that follow the plurality of time intervals. Further, the predicted locations of the objects can be based on physical constraints of the objects.

View more

Articles

Preemptive tearing mode suppression using real-time ECH steering machine learning stability predictions on DIII-D

Bulletin of the American Physical Society

2024

Developing and maintaining safe operating regimes are necessary for tokamak-based commercial fusion power plants while tearing modes pose a threat to steady state operation. Future machines plan to have active tearing mode (TM) control by driving current using electron cyclotron heating (ECH), but plans based on previous experiments have the restrictions of wastefully using ECH for TM suppression or needing to wait …

View more

Automated experimental design of safe rampdowns via probabilistic machine learning

Nuclear Fusion

2024

Typically the rampdown phase of a shot consists of a decrease in current and injected power and optionally a change in shape, but there is considerable flexibility in the rate, sequencing, and duration of these changes. On the next generation of tokamaks it is essential that this is done safely as the device could be damaged by the stored thermal and electromagnetic energy present in the plasma. This works presents a procedure for automatically choosing experimental rampdown designs to rapidly converge to an effective rampdown trajectory. This procedure uses probabilistic machine learning methods paired with acquisition functions taken from Bayesian optimization. In a set of 2022 experiments at DIII-D, the rampdown designs produced by our method maintained plasma control down to substantially lower current and energy levels than are typically observed.

View more

PID-inspired inductive biases for deep reinforcement learning in partially observable control tasks

Advances in Neural Information Processing Systems

2023

Deep reinforcement learning (RL) has shown immense potential for learning to control systems through data alone. However, one challenge deep RL faces is that the full state of the system is often not observable. When this is the case, the policy needs to leverage the history of observations to infer the current state. At the same time, differences between the training and testing environments makes it critical for the policy not to overfit to the sequence of observations it sees at training time. As such, there is an important balancing act between having the history encoder be flexible enough to extract relevant information, yet be robust to changes in the environment. To strike this balance, we look to the PID controller for inspiration. We assert the PID controller's success shows that only summing and differencing are needed to accumulate information over time for many control tasks.

View more

Show All +