COVID-19 Mortality Risk Prediction Using X-Ray Images.

Jesús Prada Alonso; Yvonne Gala García; Ana Luisa Sierra Bañón

doi:10.9781/ijimai.2021.04.001

Authors

Jesús Prada Alonso Universidad Autónoma de Madrid
Yvonne Gala García Universidad Autónoma de Madrid
Ana Luisa Sierra Bañón Universidad Complutense de Madrid

DOI:

https://doi.org/10.9781/ijimai.2021.04.001

Keywords:

Convolutional Neural Network (CNN), Coronavirus COVID-19, Deep Learning, Machine Learning, Medical Images

Supporting Agencies

We would like to thank SERAM and the University of Montreal for the public COVID-19 dataset they made available.

Abstract

The pandemic caused by coronavirus COVID-19 has already had a massive impact in our societies in terms of health, economy, and social distress. One of the most common symptoms caused by COVID-19 are lung problems like pneumonia, which can be detected using X-ray images. On the other hand, the popularity of Machine Learning models has grown exponentially in recent years and Deep Learning techniques have become the state-of-the-art for image classification tasks and is widely used in the healthcare sector nowadays as support for clinical decisions. This research aims to build a prediction model based on Machine Learning, including Deep Learning, techniques to predict the mortality risk of a particular patient given an X-ray and some basic demographic data. Keeping this in mind, this paper has three goals. First, we use Deep Learning models to predict the mortality risk of a patient based on this patient X-ray images. For this purpose, we apply Convolutional Neural Networks as well as Transfer Learning techniques to mitigate the effect of the reduced amount of COVID19 data available. Second, we propose to combine the prediction of this Convolutional Neural Network with other patient data, like gender and age, as input features of a final Machine Learning model, that will act as second and final layer. This second model layer will aim to improve the goodness of fit and prediction power of our first layer. Finally, and in accordance with the principle of reproducible research, the data used for the experiments is publicly available and we make the implementations developed easily accessible via public repositories. Experiments over a real dataset of COVID-19 patients yield high AUROC values and show our two-layer framework to obtain better results than a single Convolutional Neural Network (CNN) model, achieving close to perfect classification.

Downloads

Download data is not yet available.

References

C. M. Bishop, Pattern recognition and machine learning, New York, USA: Springer, 2006.

T. Kimoto, K. Asakawa, M. Yoda, and M. Takeoka, “Stock market prediction system with modular neural networks”, in International joint conference on neural networks, San Diego, USA, 1990, pp. 1-6.

S. Maes, K. Tuyls, B. Vanschoenwinkel, and B. Manderick, “Credit card fraud detection using Bayesian and neural networks”, in Proceedings of the 1st international naiso congress on neuro fuzzy technologies, Havana, Cuba, 2002, pp. 261-270.

Y. Gala, A. Fernandez, J. Diaz, and. J. R. Dorronsoro, “Support vector forecasting of solar radiation values”, in Hybrid Artificial Intelligent Systems, Salamanca, Spain, 2013, pp. 51-60.

J. Prada, and J. Dorronsoro, “General noise support vector regression with non-constant uncertainty intervals for solar radiation prediction”, Journal of Modern Power Systems and Clean Energy, vol. 6, no. 2, pp. 268-280, 2018, doi: 10.1007/s40565-018-0397-1.

I. Goodfellow, Y. Bengio, and A. Courville, Deep learning, Cambridge, USA: MIT press, 2016.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks”, in Advances in neural information processing systems, Nevada, USA., 2012, pp. 1097-1105.

H. Kaiming, Z. Xiangyu, R. Shaoqing, and S. Jian, “Deep residual learning for image recognition”, in Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, USA., 2016, pp. 770-778.

R Caruana, and A. Niculescu-Mizil, “An empirical comparison of supervised learning algorithms”, Proceedings of the 23rd international conference on Machine learning, New York, USA., 2006, pp. 161-168.

R. Gargeya, and T. Leng, “Automated identification of diabetic retinopathy using deep learning”, Ophthalmology, vol. 124, no. 7, pp. 962-969, 2017, doi: 10.1016/j.ophtha.2017.02.008.

K. Sirinukunwattana, S. Raza, Y. Tsang, D. Snead, I. Cree, and N. Rajpoot, “Locality sensitive deep learning for detection and classification of nuclei in routine colon cancer histology images”, IEEE transactions on medical imaging, vol. 35, no. 5, pp. 1196-1206, 2016, doi: 10.1016/10.1109/TMI.2016.2525803.

A. Akselrod-Ballin, L. Karlinsky, S. Alpert, S. Hasoul, R. Ben-Ari and E. Barkan, “A region based convolutional network for tumor detection and classification in breast mammography”, Deep learning and data labeling for medical applications, Athens, Greece., 2016, pp. 197-205.

S. Haykin, Neural networks: a comprehensive foundation, New Jersey, USA: Prentice Hall PTR, 1994.

C. Chang, and C. Lin, “LIBSVM: A library for support vector machines”, ACM transactions on intelligent systems and technology (TIST), vol. 2, no. 3, pp. 1-27, 2011.

T. Chen, and. C. Guestrin, “Xgboost: A scalable tree boosting system”, in Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining, New York, USA, 2015, pp. 785-794.

L. Breiman, “Random forests”, Machine learning, vol. 45, no. 1, pp. 5-32, 2001.

S. J. Pan, and Q. Yang, “A survey on transfer learning”, IEEE Transactions on knowledge and data engineering, vol. 22, no. 10, pp. 1345-1359, 2009, doi: 10.1109/TKDE.2009.191.

J. Zech, M. Badgeley, M. Liu, A. Costa, J. Titano, and E. K. Oermann, “Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: a cross-sectional study”, PLoS medicine, vol. 15, no. 11, pp. 962-969, 2018, doi: 10.1371/journal.pmed.1002683.

I. Apostolopoulos, D. Ioannis, and T. A. Mpesiana, “Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks”, Physical and Engineering Sciences in Medicine, vol. 1, no. 1, pp. 14-26, 2020.

M. Ahsan, T. Alam, T. Theodore and P. Huebner, “Deep MLP-CNN model using mixed-data to distinguish between COVID-19 and Non-COVID-19 patients”, Symmetry, vol. 12, no. 9, pp. 1526, 2020.

S. Ahuja, B.K. Panigrahi, N. Dey, V. Rajinikanth, and T.K. Gandhi, “Deep transfer learning-based automated detection of COVID-19 from lung CT scan slices”, TechRxiv, 2020.

S. Fong, N. Dey, and J. Chaki, “AI-enabled technologies that fight the coronavirus outbreak”, Artificial Intelligence for Coronavirus Outbreak, 2020, pp. 23-45.

N. Cristianini, J. Shaew-Taylor, An introduction to support vector machines and other kernel-based learning methods, Cambridge, England: Cambridge university press, 2000.

R. Fletcher, Practical methods of optimization, New Jersey, USA: John Wiley & Sons, 2013.

H. Q. Minh, P. Niyogi, and. Y. Yao, “Mercer’s theorem, feature maps, and smoothing”, in International Conference on Computational Learning Theory, Pittsburgh, USA, 2006, pp. 154-168.

N. B. Karayiannis, “Reformulated radial basis neural networks trained by gradient descent”, IEEE transactions on neural networks, vol. 10, no. 3, pp. 657-671, 1999, doi: 10.1109/72.761725.

H. Lee, R. Grosse, R. Ranganath, and A. Y. Ng, “Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations”, in Proceedings of the 26th annual international conference on machine learning, New York, USA, 2009, pp. 609-616.

D. Díaz-Vico, J. Prada, and J. R. Dorronsoro, “Deep Support Vector Classification and Regression”, in International Work-Conference on the Interplay Between Natural and Artificial Computation, Almería, Spain, 2019, pp. 33-43.

M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, et al., “Tensorflow: A system for large-scale machine learning”, in 12th Symposium on Operating Systems Design and Implementation, Savannah, USA, 2016, pp. 265-283.

A. Gulli, and S. Palm, Deep learning with Keras, Birmingham, UK: Packt Publishing Ltd, 2017.

P. Rajpurkar, J. Irvin, K. Zhu, B. Yang, H. Mehta, T. Duan, et al., “Chexnet: Radiologist-level pneumonia detection on chest x-rays with deep learning”, Computer Vision and Pattern Recognition, preprint.

M. Stone, “Cross-validatory choice and assessment of statistical predictions”, Journal of the Royal Statistical Society: Series B (Methodological), vol. 36, no. 2, pp. 111-133, 1974.

J. Wang, and L. Perez, “The effectiveness of data augmentation in image classification using deep learning”, Convolutional Neural Networks Vis. Recognit, 2017, preprint.

X. Mao, Q. Li, H. Xie, R. Lau, Z. Wang, and. S. S. Paul, “Least squares generative adversarial networks”, in Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 2017, pp. 2794-2802.

J. B. Dowd, L. Andriano, D. M. Brazel, V. Rotondi, P. Block, X. Ding, et al., “Demographic science aids in understanding the spread and fatality rates of COVID-19”, Proceedings of the National Academy of Sciences, vol. 117, no. 18, pp. 9696-9698, 2020, doi: 10.1073/pnas.2004911117.

E. Wu, K. Wu, D. Cox, and. W. Lotter, “Conditional infilling GANs for data augmentation in mammogram classification”, in Image Analysis for Moving Organ, Breast, and Thoracic Images, Granada, Spain, 2018, pp. 98-106.