Artificial Intelligence Merges Histology, Genomics to Predict Survival

A deep learning computational approach can predict survival with brain tumors directly from digital histological images and genomic biomarkers, according to a study published online March 12 in the Proceedings of the National Academy of Sciences. The so-called survival convolutional neural networks (SCNNs) show accuracy that surpasses the current clinical paradigm for predicting the overall survival of patients diagnosed with glioma, the authors say. Human assessments of histology, while an important tool in cancer diagnosis and prognostication, are highly subjective. Machine learning or artificial intelligence has emerged as an important image analysis tool for medical imaging. The present study explains the SCNN approach, which combines deep learning with traditional survival models to identify survival-related patterns from histology images. Hematoxylin and eosin stain-stained tissue sections are first digitized to whole-slide images. These images are reviewed using a web-based viewer to identify regions of interest that contain viable tumor with certain histologic characteristics. An image sampling and risk filtering technique significantly improves prediction accuracy by minimizing the effects of intratumoral heterogeneity. High-power fields are sampled from these regions of interest and are used to train the neural network to predict patient survival. (SCNNs recognize important structures, like microvascular proliferation, that are used […]