The main aim of this research project is to make an automation system algorithm to detect crime and criminal activity from real-time video data and inform the nearest authorised person for further action. The system helps to decrease the crime rate and make a smart way to detect criminal. Would be a part of Smart Surveillance System.