Vehicle Trajectory Predictions Using Monocular Depth and Pose Estimations

Download or read book Vehicle Trajectory Predictions Using Monocular Depth and Pose Estimations written by Abraham Yesgat and published by . This book was released on 2022 with total page 0 pages. Available in PDF, EPUB and Kindle. Book excerpt: "In recent years, autonomous driving has become one of the most studied topics in the field of computer vision and machine learning. Various problems have been studied, such as object detection, motion prediction, or even collision detection. This thesis focuses on the specific problem of predicting the motion of agents on the road based on their surroundings. Most modern autonomous driving solutions require costly sensors such as LiDAR. This thesis attempts to predict vehicle trajectories using only RGB images captured by an ego vehicle, bypassing the need for costly sensors. We utilize both pose and depth estimation values to predict the trajectory (i.e. positions and orientations) of agents in a scene. Our research on agent trajectory predictions is divided into two stages. In the first stage, only a single vehicle (i.e the ego vehicle) is considered for trajectory prediction (Single-Agent Trajectory predictions). We present a baseline 2D kinematics model that extrapolates the future coordinates of the agent, based on its history. We then improve on the results by using our novel convolutional neural network (CNN), EgoResNet3D, extracting spatio-temporal information pertaining to the ego vehicle's surroundings to predict its trajectory. In the second stage of the project, we predict trajectories for all detected agents in the scene as well as the ego vehicle (Multi-Agent Trajectory predictions). Once again, we present a 2D kinematics baseline model to predict the trajectories of all the agents. We then improve on its results by using Transformer architectures and Attention mechanisms for multi-agent trajectory predictions"--