BiPOCO: Bi-Directional Trajectory Prediction with Pose Constraints for Pedestrian Anomaly Detection

Abstract We present BiPOCO, a Bi-directional trajectory predictor with POse COnstraints, for detecting anomalous activities of pedestrians in videos. In contrast to prior work based on feature reconstruction, our work identifies pedestrian anomalous events by forecasting their future trajectories and comparing the predictions with their expectations. We introduce a set of novel compositional pose-based losses …

Angle-Regulated Transformer Network for Pedestrian Trajectory Prediction

Abstract Pedestrian trajectory prediction is an important topic in autonomous vehicle (AV) research. Accurate predictions of future pedestrian locations and movements are essential for AVs to safely and efficiently navigate in dense urban environments. The recently developed Transformer (TF) network has shown superior results for applications such as natural language processing and machine translation, but …

BiTraP: Bi-directional Pedestrian Trajectory Prediction with Multi-modal Goal Estimation

Abstract Pedestrian trajectory prediction is an essential task in robotic applications such as autonomous driving and robot navigation. State-of-the-art trajectory predictors use a conditional variational autoencoder (CVAE) with recurrent neural networks (RNNs) to encode observed trajectories and decode multi-modal future trajectories. This process can suffer from accumulated errors over long prediction horizons (>=2 seconds). This …

Unsupervised Pedestrian Pose Prediction: A deep predictive coding network-based approach for autonomous vehicle perception

Abstract Pedestrian pose prediction is an important topic related closely to robotics and automation. Accurate predictions of human pose and motion can facilitate a more thorough understanding and analysis of human behavior, which benefits real-world applications, such as human-robot interaction, humanoid and bipedal robot design, and safe navigation of mobile robots and autonomous vehicles. This …

Pedestrian Planar LiDAR Pose (PPLP) Network for Oriented Pedestrian Detection Based on Planar LiDAR and Monocular Images

Abstract Pedestrian detection is an important task for human-robot interaction and autonomous driving applications. Most previous pedestrian detection methods rely on data collected from three-dimensional (3D) Light Detection and Ranging (LiDAR) sensors in addition to camera imagery, which can be expensive to deploy. In this letter, we propose a novel Pedestrian Planar LiDAR Pose Network …

Stochastic Sampling Simulation for Pedestrian Trajectory Prediction

Abstract Urban environments pose a significant challenge for autonomous vehicles (AVs) as they must safely navigate while in close proximity to many pedestrians. It is crucial for the AV to correctly understand and predict the future trajectories of pedestrians to avoid collision and plan a safe path. Deep neural networks (DNNs) have shown promising results …

Bio-LSTM: A Biomechanically Inspired Recurrent Neural Network for 3D Pedestrian Pose and Gait Prediction

Abstract In applications such as autonomous driving, it is important to understand, infer, and anticipate the intention and future behavior of pedestrians. This ability allows vehicles to avoid collisions and improve ride safety and quality. This paper proposes a biomechanically inspired recurrent neural network (Bio-LSTM) that can predict the location and 3D articulated body pose …