Simplifying Access to Large-scale Structured Datasets by Meta-Profiling with Scalable Training Set Enrichment

Accessing large-scale structured datasets such as WDC [19], having millions of tables coming from hundreds of thousands of sources is very challenging [7, 8, 16]. Even if one topic (e.g. Job postings) is of interest, Jobs tables in different sources have hundreds of different schemas, which significantly complicates both finding and querying them. Here we demonstrate our scalable Meta-data profiler, capable of constructing a standardized interface to a topic of interest in large-scale structured datasets using Deep-Learning and our new unsupervised, scalable training set enrichment algorithm. This interface, called Meta-profile represents a meta-data summary per each topic, representative of the entire dataset. It helps data scientists and end users get access to all relevant topical tables, even in ultra large-scale datasets such as WDC, which would be very difficult or impossible otherwise [25].