Internet of things module accelerated dense deep learning for crime detection in surveillance systems

V Sowmeya; R. Jaya Karthik

doi:10.53730/ijhs.v6nS1.6353

Authors

Sowmeya V Research Scholar, Department of Computer Science, Vels Institute of Science Technology and Advanced Studies, Chennai
R. Jaya Karthik Assistant Professor, Department of Computer Science, Vels Institute of Science Technology and Advanced Studies, Chennai

Keywords:

Crime Scene, Internet of Things, DenseNet, Surveillance System

Abstract

The smart surveillance system is becoming a vital application in each streets or houses. Most of the streets are prone to several misbehavior conducts for instance theft in atm, robbery, fights etc. and hence it is necessary to detect and analyse the crime scenes for finding the suspects. However, most of the surveillance system suffers from poor detection of objects due to poor camera resolution, absence of light and other factors. In order to improve the detection of faces after detecting the objects using ResNet, it is necessary to adapt some advanced devices for image capturing and analyzing. In this paper, Internet of Things (IoT) based ESP32 CAM WiFi Module Bluetooth with OV2640 Camera Module 2MP is used for image acquisition that capture better images from the scenes. The study uses dense convolutional network namely DenseNet to detect the faces present in the crime scenes after the object detection. The deep learning module is trained with selected crime scenes for training the classifier. The simulation is conducted further to validate the model with other variants of deep learning.

Downloads

Download data is not yet available.

References

Zheng, J., Patel, V. M., & Chellappa, R. (2017). Recent developments in video-based face recognition. In Handbook of Biometrics for Forensic Science (pp. 149-175). Springer, Cham.

Pagano, C., Granger, E., Sabourin, R., Marcialis, G. L., & Roli, F. (2014). Adaptive ensembles for face recognition in changing video surveillance environments. Information sciences, 286, 75-101.

Bashbaghi, S., Granger, E., Sabourin, R., & Bilodeau, G. A. (2017). Dynamic ensembles of exemplar-svms for still-to-video face recognition. Pattern recognition, 69, 61-81.

Matta, F., & Dugelay, J. L. (2009). Person recognition using facial video information: A state of the art. Journal of Visual Languages & Computing, 20(3), 180-187.

Dewan, M. A. A., Granger, E., Marcialis, G. L., Sabourin, R., & Roli, F. (2016). Adaptive appearance model tracking for still-to-video face recognition. Pattern recognition, 49, 129-151.

Huang, Z., Shan, S., Wang, R., Zhang, H., Lao, S., Kuerban, A., & Chen, X. (2015). A benchmark and comparative study of video-based face recognition on cox face database. IEEE Transactions on Image Processing, 24(12), 5967-5981.

Bashbaghi, S., Granger, E., Sabourin, R., & Bilodeau, G. A. (2014, August). Watch-list screening using ensembles based on multiple face representations. In 2014 22nd International Conference on Pattern Recognition (pp. 4489-4494). IEEE.

Bashbaghi, S., Granger, E., Sabourin, R., & Bilodeau, G. A. (2017). Robust watch-list screening using dynamic ensembles of svms based on multiple face representations. Machine vision and applications, 28(1-2), 219-241.

Kamgar-Parsi, B., Lawson, W., & Kamgar-Parsi, B. (2011). Toward development of a face recognition system for watchlist surveillance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(10), 1925-1937.

Mokhayeri, F., Granger, E., & Bilodeau, G. A. (2015, September). Synthetic face generation under various operational conditions in video surveillance. In 2015 IEEE International Conference on Image Processing (ICIP) (pp. 4052-4056). IEEE.

Ma, A. J., Li, J., Yuen, P. C., & Li, P. (2015). Cross-domain person reidentification using domain adaptation ranking svms. IEEE transactions on image processing, 24(5), 1599-1613.

Yang, M., Van Gool, L., & Zhang, L. (2013). Sparse variation dictionary learning for face recognition with a single training sample per person. In Proceedings of the IEEE international conference on computer vision (pp. 689-696).

Huang, G. B., Lee, H., & Learned-Miller, E. (2012, June). Learning hierarchical representations for face verification with convolutional deep belief networks. In 2012 IEEE conference on computer vision and pattern recognition (pp. 2518-2525). IEEE.

Taigman, Y., Yang, M., Ranzato, M. A., & Wolf, L. (2014). Deepface: Closing the gap to human-level performance in face verification. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1701-1708).

Schroff, F., Kalenichenko, D., & Philbin, J. (2015). Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 815-823).

Ding, C., & Tao, D. (2017). Trunk-branch ensemble convolutional neural networks for video-based face recognition. IEEE transactions on pattern analysis and machine intelligence, 40(4), 1002-1014.

Parchami, M., Bashbaghi, S., & Granger, E. (2017, May). Video-based face recognition using ensemble of haar-like deep convolutional neural networks. In 2017 International Joint Conference on Neural Networks (IJCNN) (pp. 4625-4632). IEEE.

Parchami, M., Bashbaghi, S., Granger, E., & Sayed, S. (2017, August). Using deep autoencoders to learn robust domain-invariant representations for still-to-video face recognition. In 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) (pp. 1-6). IEEE.

Chellappa, R., Chen, J. C., Ranjan, R., Sankaranarayanan, S., Kumar, A., Patel, V. M., & Castillo, C. D. (2016, October). Towards the design of an end-to-end automated system for image and video-based recognition. In 2016 Information Theory and Applications Workshop (ITA) (pp. 1-7). IEEE.

Sun, Y., Wang, X., & Tang, X. (2014). Deep learning face representation from predicting 10,000 classes. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1891-1898).

Sun, Y., Wang, X., & Tang, X. (2015). Deeply learned face representations are sparse, selective, and robust. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2892-2900).

Taigman, Y., Yang, M., Ranzato, M. A., & Wolf, L. (2014). Deepface: Closing the gap to human-level performance in face verification. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1701-1708).

Sun, Y., Wang, X., & Tang, X. (2013). Hybrid deep learning for face verification. In Proceedings of the IEEE international conference on computer vision (pp. 1489-1496).

Parchami, M., Bashbaghi, S., & Granger, E. (2017, August). Cnns with cross-correlation matching for face recognition in video surveillance using a single training sample per person. In 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS) (pp. 1-6). IEEE.

Canziani, A., Paszke, A., & Culurciello, E. (2016). An analysis of deep neural network models for practical applications. arXiv preprint arXiv:1605.07678.

Vincent, P., Larochelle, H., Lajoie, I., Bengio, Y., Manzagol, P. A., & Bottou, L. (2010). Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of machine learning research, 11(12).

Gao, S., Zhang, Y., Jia, K., Lu, J., & Zhang, Y. (2015). Single sample face recognition via learning deep supervised autoencoders. IEEE transactions on information forensics and security, 10(10), 2108-2118.

Zhu, Z., Luo, P., Wang, X., & Tang, X. (2014). Recover canonical-view faces in the wild with deep neural networks. arXiv preprint arXiv:1404.3543.

Yim, J., Jung, H., Yoo, B., Choi, C., Park, D., & Kim, J. (2015). Rotating your face using multi-task deep neural network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 676-684).

Ghodrati, A., Jia, X., Pedersoli, M., & Tuytelaars, T. (2015). Towards automatic image editing: Learning to see another you. arXiv preprint arXiv:1511.08446.