3-D Visualization of a patient CT image with highlighted metastases of the spine. Deep learning methods help discover bone metastases, which can be overlooked in clinical routine. Credit: CT dataset courtesy of Radboudumc, Nijmegen, NL Physicians have long used visual judgment of medical images to determine the course of cancer treatment. A new program package from Fraunhofer researchers reveals changes in images and facilitates this task using deep learning. The experts will demonstrate this software in Chicago from November 27 to December 2 at RSNA, the world's largest radiology meeting.
Has a tumor shrunk during the course of treatment over several months, or have new tumors developed? To answer questions like these, physicians often perform CT and MRI scans. Tumors are usually evaluated only visually, and new tumors are often overlooked. "Our program package increases confidence during tumor measurement and follow-up," explains Mark Schenk from the Fraunhofer Institute for Medical Image Computing MEVIS in Bremen, Germany. "The software can, for example, determine how the volume of a tumor changes over time and supports the detection of new tumors." The package consists of modular processing components and can help medical technology manufacturers automate progress monitoring.
The computer learns on its own
The package is unique in its use of deep learning, a new type of machine learning that reaches far beyond existing approaches. This method is helpful for image segmentation, during which experts designate exact organ outlines. Existing computer segmentation programs seek clearly defined image features such as certain gray values. "How-
ever, this can often lead to errors," according to Fraunhofer researcher Markus Harz. "The software assigns areas to the liver that do not belong to the organ." These errors must be corrected by physicians, a process which can often be quite time-consuming.
The new deep learning approaches promise improved results and should save physicians valuable time. To demonstrate their self-learning methods, Fraunhofer scientists trained the software with CT liver images from 149 patients. Results showed that the more data the program analyzed, the better it could automatically identify liver contours.
Finding hidden metastases
A further application of the approach is image registration, in which software aligns images from different patient visits so that physicians can easily compare them. Machine learning can aid the particularly difficult task of locating bone metastases in the torso in which hip bones, ribs, and spine are visible. Currently, these metastases are often overlooked due to time constraints in clinical practice. Deep learning methods can help reliably discover metastases and thus improve treatment outcomes.
Researchers focus on a combination of classical approaches and machine learning: "We wish to harness existing expertise to implement deep learning as effectively and reliably as possible," stresses Harz. Fraunhofer MEVIS builds upon years of experience in practical application: for example, the algorithms for highly precise lung image registration have been integrated into several commercial medical software applications.
Explore further: Tumor segmentation software receives 510k clearance from FDA