The dark data extraction or knowledge base construction (KBC) problem is to populate a
SQL database with information from unstructured data sources including emails, webpages,
and pdf reports. KBC is a long-standing problem in industry and research that encompasses
problems of data extraction, cleaning, and integration. We describe DeepDive, a system that
combines database and machine learning ideas to help develop KBC systems. The key idea
in DeepDive is that statistical inference and machine learning are key tools to attack …

The dark data extraction or knowledge base construction (KBC) problem is to populate a
relational database with information from unstructured data sources, such as emails,
webpages, and PDFs. KBC is a long-standing problem in industry and research that
encompasses problems of data extraction, cleaning, and integration. We describe
DeepDive, a system that combines database and machine learning ideas to help to develop
KBC systems. The key idea in DeepDive is to frame traditional extract-transform-load (ETL) …