TY - JOUR
T1 - Improved Sparse Representation based Robust Hybrid Feature Extraction Models with Transfer and Deep Learning for EEG Classification
AU - Prabhakar, Sunil Kumar
AU - Lee, Seong Whan
N1 - Funding Information:
This work was supported by Institute for Information & Communications Technology Promotion (IITP) grant funded by Korea government (No. 2017-0-00451, Development of BCI based Brain and Cognitive Computing Technology for Recognizing User’s Intentions using Deep Learning; No. 2019-0-00079, Artificial Intelligence Graduate School Program (Korea University))
Publisher Copyright:
© 2022 Elsevier Ltd
PY - 2022/7/15
Y1 - 2022/7/15
N2 - Numerous studies in the field of cognitive research is dependent on Electroencephalography (EEG) as it apprehends the neural correspondences of various mental activities such as memory, speech, or attention related activities with millisecond precision. In this work, initially sparse rendition is imposed on EEG signals and then sparse optimization is performed to it. For sparse representation, initially the work utilized both K-Singular Value Decomposition (K-SVD) for dictionary learning along with Orthogonal Matching Pursuit (OMP) for sparse coding. Later an advanced OMP technique was developed which made a significant improvement, and then instead of K-SVD, K-means and Method of Optimal direction (MOD) techniques were utilized with it and as a result, totally six different combinations in sparse representation optimization were developed. Then, it is modelled into clusters using seven different hybrid models developed here for the purpose of feature extraction and selection. Out of the seven models, two models are already existing such as Finite Mixture Logistic Regression Model (FMLR) and Expectation-Maximization based Gaussian Mixture Model (EM-GMM) which are widely used. The remaining five hybrid models are proposed as variations of GMM such as Variational Bayesian Matrix Factorization (VBMF) based GMM (VBMF-GMM), VBMF and Probabilistic Principal Component Analysis (PCA) with GMM (VBMF-PCA-GMM), VBMF and Partial Least Squares (PLS) with GMM (VBMF-PLS-GMM), VBMF and Canonical Correlation Analysis (CCA) with GMM (VBMF-CCA-GMM) and Empirical VBMF with GMM (EVBMF-GMM). This model is validated on two unique EEG datasets, such as epilepsy dataset and schizophrenia dataset, and the results have been classified with the standard machine learning techniques, transfer learning techniques and the proposed deep learning techniques leading to a total of twelve different classifiers and a comprehensive analysis is made in this work with very promising results in terms of classification accuracy reporting more than 95% for most of the proposed cases.
AB - Numerous studies in the field of cognitive research is dependent on Electroencephalography (EEG) as it apprehends the neural correspondences of various mental activities such as memory, speech, or attention related activities with millisecond precision. In this work, initially sparse rendition is imposed on EEG signals and then sparse optimization is performed to it. For sparse representation, initially the work utilized both K-Singular Value Decomposition (K-SVD) for dictionary learning along with Orthogonal Matching Pursuit (OMP) for sparse coding. Later an advanced OMP technique was developed which made a significant improvement, and then instead of K-SVD, K-means and Method of Optimal direction (MOD) techniques were utilized with it and as a result, totally six different combinations in sparse representation optimization were developed. Then, it is modelled into clusters using seven different hybrid models developed here for the purpose of feature extraction and selection. Out of the seven models, two models are already existing such as Finite Mixture Logistic Regression Model (FMLR) and Expectation-Maximization based Gaussian Mixture Model (EM-GMM) which are widely used. The remaining five hybrid models are proposed as variations of GMM such as Variational Bayesian Matrix Factorization (VBMF) based GMM (VBMF-GMM), VBMF and Probabilistic Principal Component Analysis (PCA) with GMM (VBMF-PCA-GMM), VBMF and Partial Least Squares (PLS) with GMM (VBMF-PLS-GMM), VBMF and Canonical Correlation Analysis (CCA) with GMM (VBMF-CCA-GMM) and Empirical VBMF with GMM (EVBMF-GMM). This model is validated on two unique EEG datasets, such as epilepsy dataset and schizophrenia dataset, and the results have been classified with the standard machine learning techniques, transfer learning techniques and the proposed deep learning techniques leading to a total of twelve different classifiers and a comprehensive analysis is made in this work with very promising results in terms of classification accuracy reporting more than 95% for most of the proposed cases.
KW - Classification
KW - Deep learning
KW - EEG
KW - Hybrid feature extraction
KW - Sparse representation
KW - Transfer learning
UR - http://www.scopus.com/inward/record.url?scp=85126312780&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2022.116783
DO - 10.1016/j.eswa.2022.116783
M3 - Article
AN - SCOPUS:85126312780
SN - 0957-4174
VL - 198
JO - Expert Systems with Applications
JF - Expert Systems with Applications
M1 - 116783
ER -