A novel hybrid deep learning model for earlier accident prediction using computer vision on surveillance camera

Thumbnail Image
Supplementary material
Other Title
Authors
Mojumder, Atanu
Author ORCID Profiles (clickable)
Degree
Master of Applied Technologies (Computing)
Grantor
Unitec, Te Pūkenga – New Zealand Institute of Skills and Technology
Date
2024
Supervisors
Keivanmarz, Ali
Pashna, Mohsen
Type
Masters Thesis
Ngā Upoko Tukutuku (Māori subject headings)
Keyword
traffic accidents
traffic safety
computer vision
object recognition
deep learning
real-time data processing
neural networks
Citation
Mojumder, A. (2024). A novel hybrid deep learning model for earlier accident prediction using computer vision on surveillance camera (Unpublished document submitted in partial fulfilment of the requirements for the degree of Master of Applied Technologies (Computing)). Unitec, Te Pūkenga - New Zealand Institute of Skills and Technology. https://hdl.handle.net/10652/6747
Abstract
Frequent incidence of road accidents worldwide drives continuous efforts toward accident prediction to ensure road safety. Road accidents pose a significant global issue that causes millions of causalities with huge economic losses. Human errors, unsafe roads, and risky weather conditions usually cause those accidents. Early accident detection is a significant factor in preventing road accidents by enabling real-time alerts and faster response and reducing the causality from road accidents. Using advanced computer vision and object recognition models, early accident detection systems provide practical solutions for preventing road accidents using real-time alerts and faster responses. In this research, we’ll present a hybrid model that can detect accidents earlier by focusing on improving accuracy and prediction time. We collected videos from the CADP dataset and used a custom dataset for forecasting, and we pre-processed the data by labeling, modifying, and converting it into images. The study reviews computer vision, machine learning methods, and technologies used in earlier traffic accident prediction by proposing a hybrid model using multiple versions of the YOLO model, like YOLOv8, YOLOv10, YOLOv10, YOLOv11, and Faster R-CNN. We trained all those models on fifty custom datasets multiple times with different parameters for better detection accu racy and output. In the result analysis, the individual models like YOLOv8, YOLOv10, YOLOv11, and Faster R-CNN, achieved an accuracy of 57.14%, 60%, and 42.86% for both YOLOv11 and Faster R-CNN, respectively. In individual comparison, YOLOv10 has the best maximum detection time at 2.228 seconds, and YOLOv11 has the best average accident detection time at 1.125 seconds. From comparison, the hybrid model has the best performance, with the best average detection time of 2.067 seconds and the best maximum detection time of 3.567 seconds. The proposed Hybrid model contains three trained models, which consist of YOLOv8, YOLOv10, and Faster R-CNN, with an accuracy of accident forecasting 88.57% accuracy, where this model predicts thirty-one incident videos out of thirty-five incidents in video data
Publisher
Link to ePress publication
DOI
Copyright holder
Author
Copyright notice
All rights reserved
Copyright license
Available online at