Meng, Yue (孟岳)

I am a 3rd year PhD student at MIT AeroAstro, working in REALM lab.
My research topic is using machine learning techniques to safely and stably control robots.
Before that, I was an AI Resident at IBM Thomas J. Waston Research Center.
I received an M.S. degree in ECE at UC San Diego and worked in ERL and WCSNG,
and a B.S. degree in the Department of Automation from Tsinghua University.

MIT UCSD Tsinghua Tsinghua Veterans Soccer San Diego Red Army Soccer Calblue Soccer Team
Microsoft Research MIT-IBM Watson AI Lab Google
Honda Research TuSimple Singapore-MIT Alliance



Density Planner: Minimizing Collision Risk in Motion Planning with Dynamic Obstacles using Density-based Reachability

L. Lützow, Y. Meng, A. C. Armijos, C. Fan
IEEE Int. Conf. on Robotics and Automation (ICRA), 2023
[arXiv] [video] [code]

We propose a density-based method which uses a neural network and the Liouville equation to learn the density evolution for a system with an uncertain initial state. We conduct motion planning experiments on simulated environments and environments generated from real-world data and outperform baseline methods such as model predictive control and nonlinear programming. While our method requires offline planning, the online run speed is 100times faster compared to model predictive control.

Density of Reachable States and How to Use it for Safe Autonomous Motion Planning

Y. Meng, Z. Qiu, M. T. B. Waez, C. Fan
NASA Formal Methods Symposium (NFM), 2022

Recent work provides a data-driven approach to compute the density distribution of autonomous systems’ forward reachable states online. In this paper, we study the use of such approach in combination with model predictive control for verifiable safe path planning under uncertainties. We design two challenging scenarios (autonomous driving and hovercraft control) for safe motion planning in environments with obstacles under system uncertainties. By leveraging the estimated risk, our algorithm achieves the highest success rate in goal reaching when enforcing the safety rate above 0.99.

Learning Density Distribution of Reachable States for Autonomous Systems

Y. Meng, D. Sun, Z. Qiu, M. T. B. Waez, C. Fan
Conference of Robotics and Learning (CoRL), 2021

In this work, we propose a data-driven method to compute the density distribution of reachable states for nonlinear systems. Our approach learns system dynamics and the state density jointly from trajectory data, guided by the fact that the state density evolution follows the Liouville partial differential equation. We show that our learned solution can produce a much more accurate estimate on density distribution, and can quantify risks less conservatively and flexibly compared with worst-case analysis.

Reactive and Safe Road User Simulations using Neural Barrier Certificates

Y. Meng, Z. Qin, C. Fan
IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2021.

We proposed a reactive agent model which can ensure safety by learning high-level decisions from expert data and a low level decentralized controller guided by the jointly learned decentralized barrier certificates. Empirical results show that our approach can achieve a significant improvement in safety while being similar to human behaviors.

AdaFuse: Adaptive Temporal Fusion Network for Efficient Action Recognition

Y. Meng, R. Panda, C. Lin, P. Sattigeri, L. Karlinsky, K. Saenko, A. Oliva and R. Feris
Int. Conf. on Learning Representations (ICLR), 2021.

This paper introduces an adaptive temporal fusion, AdaFuse, that dynamically fuses channels for strong temporal modelling. Extensive experiments on SomethingV1\&V2, Jester and Mini-Kinetics show AdaFuse achieves 40\% computation savings with comparable accuracy to state-of-the-art methods

AR-Net: Adaptive Frame Resolution for Efficient Action Recognition

Y. Meng, C. Lin, R. Panda, P. Sattigeri, L. Karlinsky, K. Saenko, A. Oliva and R. Feris
European Conf. on Computer Vision (ECCV), 2020.

This paper proposes a novel approach, AR-Net (Adaptive Resolution Network), that selects on-the-fly the optimal resolution for each frame conditioned on the input for efficient action recognition in long untrimmed videos. Extensive experiments on several action recognition datasets well demonstrate the efficacy of our method over state-of-the-art.

Learning 3D-aware Egocentric Spatial-Temporal Interaction via Graph Convolutional Networks

C. Li, Y. Meng, S. Chan and Y. Chen
IEEE Int. Conf. on Robotics and Automation (ICRA), 2020.

This paper proposes a 3D-aware egocentric spatial-temporalinteraction framework for automated driving applications. Graph convolution networks (GCN) is devised for interaction modeling. Extensive experiments are conducted using Honda Research Institute Driving Dataset.

Localization and Mapping using Instance-specific Mesh Models

Q. Feng, Y. Meng, M. Shan and N. Atanasov
IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), 2019.

This paper focuses on building semantic maps, containing object poses and shapes, using a monocular camera. Our contribution is an instance-specific mesh model of object shape that can be optimized online based on semantic information extracted from camera images.

SIGNet: Semantic Instance Aided Unsupervised 3D Geometry Perception

Y. Meng, Y. Lu, A. Raj, S. Sunarjo, R. Guo, T. Javidi, G. Bansal and D. Bharadia
IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2019.

This paper introduces SIGNet, a novel framework that provides robust geometry perception without requiring geometrically informative labels. SIGNet is shown to improve upon the state of art unsupervised learning for geometry perception by 30%

Dense Spatial Segmentation from Sparse Semantic Information

Q. Feng, Y. Meng and N. Atanasov
Workshop at Robotics: Science and Systems (RSS), 2018.

This paper develops an environment representation that affords reasoning about the occupancy of space, necessary for safe navigation, and about the identity of objects, necessary for complex task interpretation.

Cooperative Driving Strategies for Nonsignalized Intersections

Yue Meng, Li Li, Fei-Yue Wang, Keqiang Li and Zhiheng Li
IEEE Transactions on Vehicular Technology (TVT), 2017.

We study the difference between two major strategies of cooperative driving at intersections: the “ad hoc negotiation based” strategy and the "planning based" strategy. We carry out a series of simulations under different traffic scenarios for comparison. Results indicate the performance of a strategy mainly depends on the passing order of vehicles that it finds.


Collecting (click to see more)







Soccer (click to see more)


High school friends in THU-PKU Derby, 2014


Champion at Tsinghua Futsal Tournament, 2014


Champion at Automation Tournament, 2016


Champion at Chinese Alumni League, 2017


Champion at SV Alumni Soccer Tournament, 2019

Running (click to see more)


High school record, 2012 (3000m race)


Unlimited relay race champion at BUAA, 2014


1500m race champion, Tsinghua Sports Meeting, 2015


4*800m race champion, Tsinghua Sports Meeting, 2015


4*400m race champion, Tsinghua Sports Meeting, 2016