TEMPORAL DISEASE STATE COMPARISON USING MULTIMODAL DATA

A system and method for visualizing and annotating temporal trends of an abnormal condition in patient data. A classification and visualization module detects one or more conditions in one or more images, e.g. X-ray images, and visualizes the condition on the image. A temporal disease state extraction module analyzes text, e.g. radiology reports, for indications of a change in the condition. A multimodal disease state comparison module fuses the extracted data into a compact representation of the condition changes over time.