Analysis of recent advancement in unsupervised deep learning
Keywords:
Deep Learning, Supervised based Learning, Semi Supervised based Learning, Unsupervised Deep Learning, Auto Encoder, Recurrent Neural Network (RNN), Convolution Neural Network (CNN)Abstract
Deep Learning (DL) has experienced considerable reach and success in the number of various application areas in recent years. The modern era of Machine learning has been rapidly developing and extended to most Convolutional fields of practice, as also to some new fields with more number of opportunities. Based on various categories of learning, numerous approaches have been suggested, including supervised, semi-supervised and unsupervised deep learning. The unsupervised deep learning aims to understand transferable image or video representations without manual annotations. Also, unsupervised approaches are needed when patterns that discern abnormal and normal behavior. In this paper, the recent development methods that are emerged in the domain of unsupervised deep learning are discussed. The various developments in the field of Auto Encoder are explained. The Deep learning structure like Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) is considered as a recent method which is in development for improving the accuracy and to perform the classification in an efficient way.
Downloads
References
Huang, J., Dong, Q., Gong, S. and Zhu, X., 2019. Unsupervised deep learning by neighbourhood discovery. arXiv preprint arXiv:1904.11567.
Xu, D., Sheng, J.Q., Hu, P.J.H., Huang, T.S. and Hsu, C.C., 2020. A Deep Learning Based Unsupervised Method to Impute Missing Values in Patient Records for Improved Management of Cardiovascular Patients. IEEE Journal of Biomedical and Health Informatics.
Janarthanan, R., Doss, S. and Baskar, S., 2020. Optimized unsupervised Deep learning assisted reconstructed coder in the on-nodule wearable sensor for Human Activity Recognition. Measurement, p.108050.
Zhang, Y., Chen, Y. and Gao, C., Deep unsupervised multi-modal fusion network for detecting driver distraction. Neurocomputing, 421, pp.26-38.
Mao, X., Yang, H., Huang, S., Liu, Y. and Li, R., 2019. Extractive summarization using supervised and unsupervised learning. Expert Systems with Applications, 133, pp.173-181.
Schmidt, B. and Hildebrandt, A., 2020. Deep learning in next-generation sequencing. Drug Discovery Today.
Jiang, P., Maghrebi, M., Crosky, A. and Saydam, S., 2017. Unsupervised deep learning for data-driven reliability and risk analysis of engineered systems. In Handbook of Neural Computation (pp. 417-431). Academic Press.
Hussein, S., Kandel, P., Bolan, C.W., Wallace, M.B. and Bagci, U., 2019. Lung and pancreatic tumor characterization in the deep learning era: novel supervised and unsupervised learning approaches. IEEE transactions on medical imaging, 38(8), pp.1777-1787.
Kabir, M.A. and Luo, X., 2020, August. Unsupervised Learning for Network Flow Based Anomaly Detection in the Era of Deep Learning. In 2020 IEEE Sixth International Conference on Big Data Computing Service and Applications (BigDataService) (pp. 165-168). IEEE.
Xu, D., Wang, Y., Zhang, X., Zhang, N. and Yu, S., 2020. Infrared and Visible Image Fusion Using a Deep Unsupervised Framework With Perceptual Loss. IEEE Access, 8, pp.206445-206458.
Tian, L., Tu, Z., Zhang, D., Liu, J., Li, B. and Yuan, J., 2020. Unsupervised Learning of Optical Flow With CNN-Based Non-Local Filtering. IEEE Transactions on Image Processing, 29, pp.8429-8442.
Zhan, X., Xie, J., Liu, Z., Ong, Y.S. and Loy, C.C., 2020. Online Deep Clustering for Unsupervised Representation Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 6688-6697).
Liang, K., Zhang, L., Yang, H., Chen, Z. and Xing, Y., 2020. A Model-Based Unsupervised Deep Learning Method for Low-Dose CT Reconstruction. IEEE Access, 8, pp.159260-159273.
Kuang, X., Cheung, J.P., Wu, H., Dokos, S. and Zhang, T., 2020, July. MRI-SegFlow: a novel unsupervised deep learning pipeline enabling accurate vertebral segmentation of MRI images. In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (pp. 1633-1636). IEEE.
Merrill, N. and Eskandarian, A., 2020. Modified Autoencoder Training and Scoring for Robust Unsupervised Anomaly Detection in Deep Learning. IEEE Access.
Pattanaik, P.A., Mittal, M. and Khan, M.Z., 2020. Unsupervised Deep Learning CAD Scheme for the Detection of Malaria in Blood Smear Microscopic Images. IEEE Access, 8, pp.94936-94946..
Hwang, R.H., Peng, M.C., Huang, C.W., Lin, P.C. and Nguyen, V.L., 2020. An Unsupervised Deep Learning Model for Early Network Traffic Anomaly Detection. IEEE Access, 8, pp.30387-30399.
Xu, Y., 2020, June. Unsupervised Deep Learning for Text Steganalysis. In 2020 International Workshop on Electronic Communication and Artificial Intelligence (IWECAI) (pp. 112-115). IEEE.
He, Z., Chen, P., Li, X., Wang, Y., Yu, G., Chen, C., Li, X. and Zheng, Z., 2020. A Spatiotemporal Deep Learning Approach for Unsupervised Anomaly Detection in Cloud Systems. IEEE Transactions on Neural Networks and Learning Systems.
Qi, H., Fuin, N., Cruz, G., Pan, J., Kuestner, T., Bustin, A., Botnar, R.M. and Prieto, C., 2020. Non-rigid Respiratory Motion Estimation of Whole-heart Coronary MR Images using Unsupervised Deep Learning. IEEE Transactions on Medical Imaging.
Li, X., Fu, X.M., Xiong, F.R. and Bai, X.M., 2020. Deep learning-based unsupervised representation clustering methodology for automatic nuclear reactor operating transient identification. Knowledge-Based Systems, 204, p.106178.
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y,. Generative adversarial nets. In Proceedings of the Conference on Neural Information Processing Systems (NeurIPS), pp. 2672–2680, 2014.
LeCun, Y., Bengio, Y., and Hinton, G. Deep learning. Nature, 521(7553):436, 2015.
Krizhevsky, A. and Hinton, G., 2009. Learning multiple layers of features from tiny images..
Dong, Q., Gong, S. and Zhu, X., 2018. Imbalanced deep learning by minority class incremental rectification. IEEE transactions on pattern analysis and machine intelligence, 41(6), pp.1367-1381.
Dong, Q., Zhu, X. and Gong, S., 2019, July. Single-label multi-class image classification by deep logistic regression. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 33, pp. 3486-3493).
Wu, Z., Xiong, Y., Yu, S.X. and Lin, D., 2018. Unsupervised feature learning via non-parametric instance discrimination. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 3733-3742)..
Caron, M., Bojanowski, P., Joulin, A. and Douze, M., 2018. Deep clustering for unsupervised learning of visual features. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 132-149).
Alom, M.Z., Taha, T.M., Yakopcic, C., Westberg, S., Sidike, P., Nasrin, M.S., Hasan, M., Van Essen, B.C., Awwal, A.A. and Asari, V.K., 2019. A state-of-the-art survey on deep learning theory and architectures. Electronics, 8(3), p.292.
Murray, J.F., Hughes, G.F. and Kreutz-Delgado, K., 2005. Machine learning methods for predicting failures in hard drives: A multiple-instance application. Journal of Machine Learning Research, 6(May), pp.783-816.
Saha, B., Goebel, K., Poll, S. and Christophersen, J., 2007. A Bayesian Framework for Remaining Useful Life Estimation. In AAAI Fall Symposium: Artificial Intelligence for Prognostics (pp. 97-102).
Dempster, M.A. and Leemans, V., 2006. An automated FX trading system using adaptive reinforcement learning. Expert Systems with Applications, 30(3), pp.543-552.
Tang, T.A., Mhamdi, L., McLernon, D., Zaidi, S.A.R. and Ghogho, M., 2016, October. Deep learning approach for network intrusion detection in software defined networking. In 2016 International Conference on Wireless Networks and Mobile Communications (WINCOM) (pp. 258-263). IEEE.
Potluri, S. and Diedrich, C., 2016, September. Accelerated deep neural networks for enhanced intrusion detection system. In 2016 IEEE 21st international conference on emerging technologies and factory automation (ETFA) (pp. 1-8). IEEE.
Kwon, D., Natarajan, K., Suh, S.C., Kim, H. and Kim, J., 2018, July. An empirical study on network anomaly detection using convolutional neural networks. In 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS) (pp. 1595-1598). IEEE.
Kim, J., Kim, J., Thu, H.L.T. and Kim, H., 2016, February. Long short term memory recurrent neural network classifier for intrusion detection. In 2016 International Conference on Platform Technology and Service (PlatCon) (pp. 1-5). IEEE.
Yin, C., Zhu, Y., Fei, J. and He, X., 2017. A deep learning approach for intrusion detection using recurrent neural networks. Ieee Access, 5, pp.21954-21961.
Javaid, A., Niyaz, Q., Sun, W. and Alam, M., 2016, May. A deep learning approach for network intrusion detection system. In Proceedings of the 9th EAI International Conference on Bio-inspired Information and Communications Technologies (formerly BIONETICS) (pp. 21-26).
Caron, M., Bojanowski, P., Joulin, A. and Douze, M., 2018. Deep clustering for unsupervised learning of visual features. In Proceedings of the European Conference on Computer Vision (ECCV) (pp. 132-149).
Ramotsoela, D., Abu-Mahfouz, A. and Hancke, G., 2018. A survey of anomaly detection in industrial wireless sensor networks with critical water system infrastructure as a case study. Sensors, 18(8), p.2491.
Chalapathy, R. and Chawla, S., 2019. Deep learning for anomaly detection: A survey. arXiv preprint arXiv:1901.03407.
Published
How to Cite
Issue
Section
Copyright (c) 2022 International journal of health sciences
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Articles published in the International Journal of Health Sciences (IJHS) are available under Creative Commons Attribution Non-Commercial No Derivatives Licence (CC BY-NC-ND 4.0). Authors retain copyright in their work and grant IJHS right of first publication under CC BY-NC-ND 4.0. Users have the right to read, download, copy, distribute, print, search, or link to the full texts of articles in this journal, and to use them for any other lawful purpose.
Articles published in IJHS can be copied, communicated and shared in their published form for non-commercial purposes provided full attribution is given to the author and the journal. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
This copyright notice applies to articles published in IJHS volumes 4 onwards. Please read about the copyright notices for previous volumes under Journal History.
