Research

Deep Learning-based Quantitative Analysis of Optical Coherence Tomography (OCT) Images for Early Dental Caries Detection (NSF MRI-1920345)

Dental caries are common chronic infectious oral diseases affecting more than 90 percent of all dentate adults and more than two-thirds of children in the United States. Early Detection of carious lesions can result in the implementation of non-surgical preventive approaches to reverse the demineralization process. The conventional approach for diagnosing dental caries is clinical examination supplemented by radiographic evaluation. However, studies based on the clinical and radiographic examination methods often show low sensitivity and high specificity. Optical coherence tomography (OCT) is a noninvasive optical imaging modality based on low-coherence interferometry that utilizes non-ionizing near-infrared laser to obtain images with micrometer resolution. Currently, the major biomedical application of OCT is in ophthalmology. Many other applications of OCT are under investigation as researchers take advantage of the ability to rapidly acquire images noninvasively. Machine learning and deep learning techniques can be used to supplement OCT imaging system to more accurately identify diseased and damaged tissue. In this research, we investigate novel approaches combining OCT imaging modality and deep convolutional neural networks (CNN) for the early detection of occlusal carious lesions. In this project, we also develop signal and image processing algorithms to extract meaningful features from OCT data for image classification and analysis.

Processing and analysis of OCT imaging data using advanced image processing methods and deep learning models: 

M. Mahdian, H. S. Salehi, A. G. Lurie, S. Yadav, A. Tadinada, Elsevier Journal of Oral Surg. Med. Path. Radiology 122(1), 98-103 (2016). Link

H. S. Salehi, M. Mahdian, et al., OSA International Biomed. Optics Congress, JTu3A.52 (2016). Link

H. S. Salehi, A. Kosa, M. Mahdian, et al., Proc. SPIE BIOS 10044, Lasers in Dentistry XXIII, 1004406 (2017). Link

H. S. Salehi, M. Mahdian, M. M. Murshid, S. Judex, and A. Tadinada, Proc. SPIE BIOS 10857, Lasers in Dentistry XXV, 108570H (2019). Link

H. S. Salehi, M. Barchini, and M. Mahdian, Proc. SPIE BIOS 11217, Lasers in Dentistry XXVI, 112170G (2020). Link

H. S. Salehi, M. Barchini, Q. Chen, and M. Mahdian, Proc. SPIE 11600, Medical Imaging 2021: Biomedical Applications in Molecular, Structural, and Functional Imaging, 1160014 (2021). Link

H. S. Salehi, A. Granados, and M. Mahdian, Proc. SPIE 12036, Medical Imaging 2022: Biomedical Applications in Molecular, Structural, and Functional Imaging, 1203613 (2022). Link

Deep Learning and Image Processing-based Morphological Analysis of 2D and 3D Dental Images using Fluorescence Imaging and Structured Light Scanner

3D Digitization of dental model is growing in popularity for dental application. Classification of tooth type from single 3D point cloud model without assist of relative position among teeth is still a challenging task. In this research, 8-class posterior tooth type classification is investigated using convolutional neural network (CNN)-based occlusal surface morphology analysis. Considering the logical hierarchy of tooth categories, a hierarchical classification structure is proposed to decompose 8-class classification task into two-stage cascaded classification subtasks. Image augmentations including traditional geometrical transformation and deep convolutional generative adversarial networks (DCGANs) are applied for each subnetwork and cascaded network. Grad-cam, a visualization method for explaining the decision-making process of CNN-based models, is employed to highlight the important region where the network pays more attention to identify a specific class in the input image. The proposed method has advantages of easy training, great ability to learn discriminative features from small image region.

The accumulation of dental plaque on a tooth surface plays a crucial role in developing dental caries. In this research, fluorescence imaging modality with structured light-based intraoral 3D scanner are combined to investigate the 3D distribution of dental plaque. The traditional fluorescence imaging method only reveals the 2D spatial distribution of the dental plaque on a tooth surface. To visualize the 3D distribution of the dental plaque on an occlusal surface, we investigate mapping 2D fluorescence images to 3D occlusal surfaces. The 3D distribution of occlusal plaque reveals that dental plaque accumulation relates to the local and global morphology of the tooth surface. The investigation of the 3D distribution of occlusal plaque using 2D-3D registration paves the path for the quantitative analysis of the tooth surface morphology to perform plaque-guided caries risk assessment.

Development of  digital image processing and machine learning/deep learning techniques with 2D and 3D imaging: 

Q. Chen, X. Jin, H. Zhu, H. S. Salehi, and K. Wei, Elsevier Journal of Computers in Biology and Medicine 123, 103860 (2020). Link

Q. Chen, X. Jin, H. Zhu, and H. S. Salehi, Proc. SPIE BIOS 11217, Lasers in Dentistry XXVI, 112170E (2020). Link

Q. Chen, J. Huanga, H. S. Salehi, H. Zhu, L. Lian, X. Lai, and K. Wei, Elsevier Journal of Computer Methods and Programs in Biomedicine 208, 106295 (2021). Link

Sensors, Signal Processing, and Machine Learning for Healthcare and Robotics

Migraines are the sixth most disabling disease in the world, affecting more than 1 billion people worldwide and are just one illness affected by environmental triggers due to changes to that occur inside the home. Due to migraines similarities to sinus headaches, migraines affected by environmental triggers can often be misdiagnosed. In this research work, an iOS-based environmental analyzer was designed, implemented and evaluated for migraine sufferers with the use of sensors. After the data collection and cleaning (data from a user’s surroundings, i.e. temperature, humidity, pressure and altitude), five machine learning model were used to estimate prediction accuracy of migraines in terms of the environment. Preliminary results demonstrate the feasibility of using machine learning algorithms to perform the automated recognition of migraine trigger areas in the environment. (Sponsored by iDevices)

Another research project is focused on novel approaches combining machine learning and digital signal processing for real-time robot arm manipulation to pave the path for developing smart prosthetic devices for amputees and innovative robotic rehabilitation systems. The Electromyography (EMG) signals are generated by human muscle systems when there are any movements and muscular activities. These signals are detected over different areas from the skin surfaces and each movement corresponds to a specific activation pattern of several muscles. In this study, multi-channel EMG measurements were performed with electrodes placed on involved arm muscles. The EMG signals were digitally recorded and processed using digital filters, feature extraction methods, and classification algorithms. 

Development of smart interior environmental mobile app: R. J. Day and H. S. Salehi, IEEE Green Technologies Conference (GreenTech), Austin, TX, pp. 115-118 (2018). Link

IoT environmental analyzer using sensors and machine learning: R. J. Day, H. S. Salehi, and M. Javadi, IEEE International Conference on Machine Learning and Applications (ICMLA), Boca Raton, FL, USA, pp. 1460-1465, (2019). Link

EMG signal processing and analysis with SVM: M. M. Murshid and H. S. Salehi, Proc. SPIE DCS 11423, Signal Processing, Sensor/Information Fusion, and Target Recognition XXIX, 1142313 (2020). Link

Deep learning-based machine vision: J. M. Rathod and H. S. Salehi, Proc. SPIE DCS 11400, Pattern Recognition and Tracking XXXI, 1140009 (2020). Link

Development of Low-Cost Photoacoustic Imaging System

Photoacoustic imaging is an emerging imaging modality that images optical absorption contrast in tissue based on the thermoelastic induction of acoustic signals as a result of the absorption of pulsed or modulated optical energy. To obtain photoacoustic images, an optical pulse propagates into a tissue sample diffusively and the photoacoustic signals arising from tissue thermoelastic expansion caused by the optical irradiation are measured around the sample via ultrasound transduction. In this project, we develop and investigate low-cost photoacoustic microscopy system, which is capable of mapping microvasculature networks in biological tissue and resolving blood vessels with much higher spatial resolution than conventional photoacoustic imaging with ultrasound array transducers. We also analyze photoacoustic images using machine learning, pattern recognition, and signal/image processing techniques.

Low-cost photoacoustic microscopy system: T. Wang, S. Nandy, H. S. Salehi, P. D. Kumavor, and Q. Zhu, Journal of Bio. Optics Express 5(9), 3053-3058 (2014). Link

Design of miniaturized probe and optimal light delivery systems for photoacoustic imaging: H. S. Salehi, T. Wang, P. D. Kumavor, H. Li, and Q. Zhu, Journal of Bio. Optics Express 5(9), 3074-3079 (2014). Link

H. S. Salehi, P. D. Kumavor, U. Alqasemi, H. Li, T. Wang, C. Xu, and Q. Zhu, Elsevier Photoacoustics Journal 3(3), 114-122 (2015). Link

Co-registered photoacoustic and ultrasound imaging and machine learning models: H. S. Salehi, H. Li, A. Merkulov, P. D. Kumavor, H. Vavadi, M. Sanders, A. Kueck, M. A. Brewer, and Q. Zhu, Journal of Biomed. Optics 21(4), 046006 (2016). Link

Design of low-cost linear laser scanning system: H. S. Salehi and J. D. Schad, Proc. SPIE BIOS 11240, Photons Plus Ultrasound: Imaging and Sensing, 112403I (2020). Link

Development of Deep Learning-based Digital Image Analysis Tool for Legume Nodule Characterization (Funded by CSU ARI Grant)

Legume crops such as pea and bean develop symbiosis with a group of bacteria, called Rhizobia, and obtain their nitrogen requirement from the atmosphere. The process of biological nitrogen fixation (BNF) takes place in small nodules that are formed on the legume root system. Due to their capability for biological nitrogen fixation, legumes do not need nitrogen fertilizers, and can add to soil nitrogen for succeeding crop. Thus, legume crops are well known for their contribution to soil nitrogen through the BNF. However, the nitrogen benefits of legumes significantly affected by cultural practices and environment. Sophisticated methods such as staple isotope technique is used to estimate the nitrogen benefits of legumes. In addition, it is very common to quantify plant nitrogen fixation through counting the number of nodules on the legume root system. Nodule number, nodule mass, and nodule shape are seen to be correlated with legume’s BNF. Due to the slow process of counting nodules by hand, this valuable trait is not often included in legume research. In collaboration with College of Agriculture at California State University, Chico, we develop deep learning models and digital image processing techniques to analyze legume roots and characterize their nodulation. 

Deep Learning-based Digital Image Analysis Tool for Characterization of Legumes Nodules: 

The preliminary results of this research were presented at 2020 California Plant and Soil Conference.

M. Barchini, H. S. Salehi, K. Brasier, and H. Zakeri, ASA, CSSA, SSSA International Annual Meeting, Salt Lake City, UT, USA (2021). Link

H. S. Salehi, M. Barchini, K. Braiser, and H. Zakeri "Development of GUI-based deep learning and image processing system for legume nodule segmentation and classification," Proc. SPIE DCS 12527, Pattern Recognition and Tracking XXXIV, 1252703 (2023). Link