Detecting Multiple Mixed Bacteria Using Dual-Mode Hyperspectral Imaging and Deep Neural Networks

Identifying and analyzing mixed pathogenic bacteria is important for clinical diagnosis and antibiotic therapy of multiple bacterial infection. In this paper, a dual-mode hyperspectral microscopic detection technology with hybrid deep neural networks (DNNs) was proposed for simultaneous quantitative analysis of four kinds of pathogenic bacteria in mixed samples. To acquire both transmission and fluorescence spectra regarding the mixed pathogens, we developed a dual-mode hyperspectral detection system with fine spectral resolution and wide wavelength range, which can also generate spatial images that can be used to calculate the total amount of mixed bacteria. The dual-mode spectra were regarded as mixed proportion characteristics and the input of the neural network for predicting the proportion of each bacterium present in the mixture. To better analyze the dual-mode spectral data, we customized a mixed bacteria measurement network (MB-Net) with hybrid DNNs architectures based on spectral feature fusion. Using the fusion strategy, two DNNs frameworks applied for transmission/fluorescence spectral feature processing were stacked to form the MB-Net that processes these features simultaneously, and the achieved average coefficient of determination (R2) and RMSE of validation set are 0.96 and 0.03, respectively. To the best of our knowledge, it is the first time of simultaneously detecting four types of mixed pathogenic bacteria using spectral detection technology, showing excellent potential in clinical practice.