TY - JOUR
T1 - CNN cascades for segmenting sparse objects in gigapixel whole slide images
AU - Gadermayr, M.
AU - Dombrowski, A.-K.
AU - Klinkhammer, B.M.
AU - Boor, P.
AU - Merhof, D.
N1 - Cited By :42
Export Date: 14 December 2023
CODEN: CMIGE
Correspondence Address: Gadermayr, M.; Kopernikusstr. 16Germany; email: [email protected]
Funding details: Deutsche Forschungsgemeinschaft, DFG, BO 3755/3-1, BO 3755/6-1, ME 3737/3-1
Funding details: Bundesministerium für Bildung und Forschung, BMBF, 01GM1518A
Funding text 1: This work was supported by financial research grants of the German Research Foundation (DFG) under Grant No. ME 3737/3-1 to DM, Grant No. BO 3755/3-1 , BO 3755/6-1 to PB, DFG Sonderforschungsbereich-Transregio 57 “Mechanisms of organ fibrosis” to PB and German Ministry of Education and Research (Consortium sop focal segmental glomerulosclerosis number 01GM1518A) to PB.
References: Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Zheng, X., TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems (2015), https://www.tensorflow.org/; Barker, J., Hoogi, A., Depeursinge, A., Rubin, D.L., Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles (2016) Med. Image Anal., 30, pp. 60-71; BenTaieb, A., Hamarneh, G., Topology aware fully convolutional networks for histology gland segmentation (2016) Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’16), pp. 460-468; Bi, L., Kim, J., Ahn, E., Kumar, A., Fulham, M., Feng, D., Dermoscopic image segmentation via multistage fully convolutional networks (2017) IEEE Trans. Biomed. Eng., 64, pp. 2065-2074; Boor, P., Bábíčková, J., Steegh, F., Hautvast, P., Martin, I.V., Djudjaj, S., Nakagawa, T., Ostendorf, T., Role of platelet-derived growth factor-CC in capillary rarefaction in renal fibrosis (2015) Am. J. Pathol., 185, pp. 2132-2142; Chollet, F., Keras (2015), https://github.com/fchollet/keras; Christ, P.F., Elshaer, M.E.A., Ettlinger, F., Tatavarty, S., Bickel, M., Bilic, P., Rempfler, M., Menze, B.H., Automatic Liver and Lesion Segmentation In Ct Using Cascaded Fully Convolutional Neural Networks and 3d Conditional Random Fields (2016); Ciresan, D., Giusti, A., Gambardella, L.M., Schmidhuber, J., Deep neural networks segment neuronal membranes in electron microscopy images (2012) Advances in Neural Information Processing Systems, , Curran Associates, Inc; Dou, Q., Chen, H., Yu, L., Qin, J., Heng, P.A., Multilevel contextual 3-d CNNs for false positive reduction in pulmonary nodule detection (2017) IEEE Trans. Biomed. Eng., 64, pp. 1558-1567; Dou, Q., Chen, H., Yu, L., Zhao, L., Qin, J., Wang, D., Mok, V.C., Heng, P.A., Automatic detection of cerebral microbleeds from MR images via 3d convolutional neural networks (2016) IEEE Trans. Med. Imaging, 35, pp. 1182-1195; Gadermayr, M., Klinkhammer, B.M., Boor, P., Merhof, D., Do we need large annotated training data for detection applications in biomedical image data? A case study in renal glomeruli detection (2016) Proceedings of the International MICCAI Workshop on Machine Learning in Medical Imaging (MLMI’16); Girshick, R., Donahue, J., Darrell, T., Malik, J., Rich feature hierarchies for accurate object detection and semantic segmentation (2014) Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’14); Herve, N., Servais, A., Thervet, E., Olivo-Marin, J.C., Meas-Yedid, V., Statistical color texture descriptors for histological images analysis (2011) Proceedings of the International Conference on Biomedical Imaging (ISBI’11), pp. 724-727; Hou, L., Samaras, D., Kurc, T.M., Gao, Y., Davis, J.E., Saltz, J.H., Patch-based convolutional neural network for whole slide tissue image classification (2016) Proceedings of the International Conference of Computer Vision (CVPR’16); Jackson, A.S., Valstar, M., Tzimiropoulos, G., A CNN cascade for landmark guided semantic part segmentation (2016) Proceedings of the European Conference on Computer Vision (ECCV’16), pp. 143-155; Kato, T., Relator, R., Ngouv, H., Hirohashi, Y., Takaki, O., Kakimoto, T., Okada, K., Segmental HOG: new descriptor for glomerulus detection in kidney microscopy image (2015) BMC Bioinform., 16; Kingma, D.P., Ba, J., (2014), http://arxiv.org/abs/1412.6980, Adam: A Method for Stochastic Optimization. CoRR abs/1412.6980; Leng, B., Liu, Y., Yu, K., Xu, S., Yuan, Z., Qin, J., Cascade shallow CNN structure for face verification and identification (2016) Neurocomputing, 215, pp. 232-240; Li, H., Lin, Z., Shen, X., Brandt, J., Hua, G., A convolutional neural network cascade for face detection (2015) Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’15), IEEE; Long, J., Shelhamer, E., Darrell, T., Fully convolutional networks for semantic segmentation (2015) Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’15); Ma, J., Wu, F., Jiang, T., Zhu, J., Kong, D., Cascade convolutional neural networks for automatic detection of thyroid nodules in ultrasound images (2017) Med. Phys., 44, pp. 1678-1691; Naylor, P., Laé, M., Reyal, F., Walter, T., Nuclei segmentation in histopathology images using deep neural networks (2017) Proceedings of the International Symposium on Biomedical Imaging (ISBI’17), pp. 933-936; Pedraza, A., Gallego, J., Lopez, S., Gonzalez, L., Laurinavicius, A., Bueno, G., Glomerulus classification with convolutional neural networks (2017) Proceedings of the 21st Annual Conference of Medical Image Understanding and Analysis (MIUA’17), pp. 839-849; Ronneberger, O., Fischer, P., Brox, T., U-net: convolutional networks for biomedical image segmentation (2015) Proceedings of the International Conference on Medical Image Computing and Computer Aided Interventions (MICCAI’15), Springer International Publishing, Springer LNCS, pp. 234-241; Samsi, S., Jarjour, W.N., Krishnamurthy, A., Glomeruli segmentation in H&E stained tissue using perceptual organization (2012) Proceedings of the IEEE Signal Processing in Medicine and Biology Symposium (SPMB’12), pp. 1-5; Sertel, O., Kong, J., Shimada, H., Catalyurek, U.V., Saltz, J.H., Gurcan, M.N., Computer-aided prognosis of neuroblastoma on whole-slide images: classification of stromal development (2009) Pattern Recognit., 42, pp. 1093-1103; Seyedhosseini, M., Sajjadi, M., Tasdizen, T., Image segmentation with cascaded hierarchical models and logistic disjunctive normal networks (2013) Proceedings of the IEEE International Conference on Computer Vision (ICCV’13); Shelhamer, E., Long, J., Darrell, T., Fully convolutional networks for semantic segmentation (2017) IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI), 39, pp. 640-651; Simard, P.Y., Steinkraus, D., Platt, J.C., Best practices for convolutional neural networks applied to visual document analysis (2003) International Conference on Document Analysis and Recognition; Sun, Y., Wang, X., Tang, X., Deep convolutional network cascade for facial point detection (2013) Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’13); Veta, M., Diest, P.J.V., Pluim, J.P.W., Cutting out the middleman: measuring nuclear area in histopathology slides without segmentation (2016) Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’16); Viola, P., Jones, M., Rapid object detection using a boosted cascade of simple features (2001) Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’01); Wan, L., Liu, N., Huo, H., Fang, T., Selective convolutional neural networks and cascade classifiers for remote sensing image classification (2017) Rem. Sens. Lett., 8, pp. 917-926; Wong, S.C., Gatt, A., Stamatescu, V., McDonnell, M.D., Understanding data augmentation for classification: when to warp? (2016) Proceedings of the IEEE International Conference on Digital Image Computing: Techniques and Applications (DICTA’16)
PY - 2018
Y1 - 2018
N2 - Due to the increasing availability of whole slide scanners facilitating digitization of histopathological tissue, large amounts of digital image data are being generated. Accordingly, there is a strong demand for the development of computer based image analysis systems. Here, we address application scenarios in histopathology consisting of sparse, small objects-of-interest occurring in the large gigapixel images. To tackle the thereby arising challenges, we propose two different CNN cascade approaches which are subsequently applied to segment the glomeruli in whole slide images of the kidney and compared with conventional fully-convolutional networks. To facilitate unbiased evaluation, eight-fold cross-validation is performed and finally means and standard deviations are reported. Overall, with the best performing cascade approach, single CNNs are outperformed and a pixel-level Dice similarity coefficient of 0.90 is obtained (precision: 0.89, recall: 0.92). Combined with qualitative and further object-level analyses the obtained results are assessed as excellent also compared to previous approaches. We can state that especially one of the proposed cascade networks proved to be a highly powerful tool providing the best segmentation accuracies and also keeping the computing time at the lowest level. This work facilitates accurate automated segmentation of renal whole slide images which consequently allows fully-automated big data analyses for the assessment of medical treatments. Furthermore, this approach can also easily be adapted to other similar biomedical application scenarios. © 2018 Elsevier Ltd
AB - Due to the increasing availability of whole slide scanners facilitating digitization of histopathological tissue, large amounts of digital image data are being generated. Accordingly, there is a strong demand for the development of computer based image analysis systems. Here, we address application scenarios in histopathology consisting of sparse, small objects-of-interest occurring in the large gigapixel images. To tackle the thereby arising challenges, we propose two different CNN cascade approaches which are subsequently applied to segment the glomeruli in whole slide images of the kidney and compared with conventional fully-convolutional networks. To facilitate unbiased evaluation, eight-fold cross-validation is performed and finally means and standard deviations are reported. Overall, with the best performing cascade approach, single CNNs are outperformed and a pixel-level Dice similarity coefficient of 0.90 is obtained (precision: 0.89, recall: 0.92). Combined with qualitative and further object-level analyses the obtained results are assessed as excellent also compared to previous approaches. We can state that especially one of the proposed cascade networks proved to be a highly powerful tool providing the best segmentation accuracies and also keeping the computing time at the lowest level. This work facilitates accurate automated segmentation of renal whole slide images which consequently allows fully-automated big data analyses for the assessment of medical treatments. Furthermore, this approach can also easily be adapted to other similar biomedical application scenarios. © 2018 Elsevier Ltd
KW - Cascades
KW - Fully-convolutional network
KW - Kidney
KW - Segmentation
KW - Big data
KW - Cascades (fluid mechanics)
KW - Computer aided analysis
KW - Convolution
KW - Image analysis
KW - Medical applications
KW - Medical imaging
KW - Pixels
KW - Application scenario
KW - Automated segmentation
KW - Biomedical applications
KW - Convolutional networks
KW - Image analysis systems
KW - Segmentation accuracy
KW - Similarity coefficients
KW - Image segmentation
KW - article
KW - data analysis
KW - glomerulus
KW - histopathology
KW - human
KW - recall
KW - validation process
KW - animal
KW - diagnostic imaging
KW - image processing
KW - kidney
KW - mouse
KW - procedures
KW - Animals
KW - Image Processing, Computer-Assisted
KW - Mice
KW - Neural Networks, Computer
U2 - 10.1016/j.compmedimag.2018.11.002
DO - 10.1016/j.compmedimag.2018.11.002
M3 - Article
SN - 0895-6111
VL - 71
SP - 40
EP - 48
JO - Computerized Medical Imaging and Graphics
JF - Computerized Medical Imaging and Graphics
ER -