Anomaly detection in pedestrian walkways is a vital research area that uses remote sensing, which helps to optimize pedestrian traffic and enhance flow to improve pedestrian safety in intelligent transportation systems (ITS). Engineers and researchers can formulate more potential techniques and tools with the power of computer vision (CV) and machine learning (ML) for mitigating potential safety hazards and identifying anomalies (i.e., vehicles) in pedestrian walkways. The real-world challenges of scenes and dynamics of environmental complexity cannot be handled by the conventional offline learning-based vehicle detection method and shallow approach. With recent advances in deep learning (DL) and ML areas, authors have found that the image detection issue ought to be devised as a two-class classification problem. Therefore, this study presents an Anomaly Detection in Pedestrian Walkways for Intelligent Transportation Systems using Federated Learning and Harris Hawks Optimizer (ADPW-FLHHO) algorithm on remote sensing images. The presented ADPW-FLHHO technique focuses on the identification and classification of anomalies, i.e., vehicles in the pedestrian walkways. To accomplish this, the ADPW-FLHHO technique uses the HybridNet model for feature vector generation. In addition, the HHO approach is implemented for the optimal hyperparameter tuning process. For anomaly detection, the ADPW-FLHHO technique uses a multi deep belief network (MDBN) model. The experimental results illustrated the promising performance of the ADPW-FLHHO technique over existing models with a maximum AUC score of 99.36%, 99.19%, and 98.90% on the University of California San Diego (UCSD) Ped1, UCSD Ped2, and avenue datasets, respectively. Therefore, the proposed model can be employed for accurate and automated anomaly detection in the ITS environment.