Model Regularization of Deep Neural Networks for Robust Clinical Opinion Generation from General Blood Test Results

Abstract

The deep neural network (DNN) that models characteristics of general blood test (GBT) results was used in clinical opinions generation. The DNN that generates clinical opinions has the complex structure, which causes overfitting problem. The relatively small size of medical dataset also contributes to the occurrence of overfitting. In order to deal with overfitting, we apply two techniques that solve overfitting of DNN, which are dropout, and batch normalization. Dropout is inserted into the network in various ways in order to find out the optimal structure of the network. Batch normalization is also added in various ways for the same purpose. The experiment conducted on GBT dataset shows that DNNs with dropout and batch normalization outperform the simple DNN in generating clinical opinions for our GBT dataset. Besides, dropout shows slightly better performance compared to batch normalization.