Integrating Color Deconvolution Thresholding and Weakly Supervised Learning for Automated Segmentation of Neurofibrillary Tangle and Neuropil Threads

Abnormally phosphorylated tau proteins are known to be a major indicator of Alzheimer's Disease (AD) with strong association with memory loss and cognitive decline. Automated generation of pixel-wise accurate neurofibrillary tangles (NFTs) and neuropil threads (NTs) segmentation is a challenging task, due to lack of ground truth segmentation data of these abnormal tau pathology. This problem is most prominent in the case of segmenting NTs, where the small threadlike morphology makes pixel-wise labeling a laborious task and unrealistic for large-scale studies. Lack of ground truth data poses a significant limitation for many learning-based methods to generate accurate segmentations of NFTs and NTs. This work presents an automated pipeline for pixel level segmentation of NFTs and NTs that does not rely on ground truth segmentation data. The pipeline is composed of four main steps: (1) color deconvolution is used to separate histopathology images into staining channels (DAB, Hematoxylin, and Eosin), (2) Otsu's thresholding is used on the DAB stain channel to generate pixel level segmentation of abnormal tau proteins staining, (3) a weakly-supervised learning paradigm (WildCat), using only global descriptors of images, is used to generate density maps of potential regions of NFTs and NTs, and (4) density maps and segmentations are then integrated using connected component analysis to localize NFTs and NTs in the detected tau segmentations. Our results show high global classification accuracy for NFTs (Acc:0.96) and NTs (Acc:0.91), and statistically significant distinctions when evaluating the percent area occupied of the detected NTs relative to expert ratings of NTs severity. Qualitative assessment of the NFTs and NTs results showed accurate pixel-level segmentations of the NFTs, while modest performance for NTs.