Select Page

What does DeepDive do?

DeepDive is a system to extract value from dark data . Like dark matter, dark data is the great mass of data buried in text, tables, figures, and images, which lacks structure and so is essentially unprocessable by existing software. DeepDive helps bring dark data to light by creating structured data (SQL tables) from unstructured information (text documents) and integrating such data with an existing structured database. DeepDive is used to extract sophisticated relationships between entities and make inferences about facts involving those entities. DeepDive helps one process a wide variety of dark data and put the results into a database. With the data in a database, one can use a variety of standard tools that consume structured data; e.g., visualization tools like Tableau or analytics tools like Excel.

What is DeepDive?

DeepDive is a new type of data management system that enables one to tackle extraction, integration, and prediction problems in a single system, which allows users to rapidly construct sophisticated end-to-end data pipelines, such as dark data BI (Business Intelligence) systems. By allowing users to build their system end-to-end, DeepDive allows users to focus on the portion of their system that most directly improves the quality of their application. By contrast, previous pipeline-based systems require developers to build extractors, integration code, and other components—without any clear idea of how their changes improve the quality of their data product. This simple insight is the key to how DeepDive systems produce higher quality data in less time. DeepDive-based systems are used by users without machine learning expertise in a number of domains from paleobiology to genomics to human trafficking; see our Golden Goose Francy high moTMCvwt
for examples.

DeepDive is a trained system that uses machine learning to cope with various forms of noise and imprecision. DeepDive is designed to make it easy for users to train the system through low-level feedback via the Donald Pliner Mens Alto Woven Calf Leather Sneakers Mens Shoes AI6zqp
and rich, structured domain knowledge via rules. DeepDive wants to enable experts who do not have machine learning expertise. One of DeepDive's key technical innovations is the ability to solve statistical inference problems at massive scale.

DeepDive differs from traditional systems in several ways:

For more details, check out our papers .

What is DeepDive used for?

Examples of DeepDive applications are described in our showcase page .

These examples are described in the showcase page . The complete code for these examples is available with DeepDive (where permitted). DeepDive is currently used in other domains with even more collaborators. Stay tuned, and get in touch with us to talk about interesting projects.

Who should use DeepDive?

Users should be familiar with DDlog or SQL, working with relational databases, and Python to build DeepDive applications or to integrate DeepDive with other tools. A developer who wants to modify and improve DeepDive must have basic background knowledge mentioned in the DeepDive developer's guide .

Who develops DeepDive?

DeepDive is project led by Saint Laurent Farrah 80 sandals 7CchNFCY
at Stanford University. Current group members include: Michael Cafarella , Xiao Cheng, Tommy Bahama Mens Dune Sneaker qgKpp7iKZ5
, Dan Iter, Thomas Palomares, Alex Ratner, Theodoros Rekatsinas, Zifei Shan , Jaeho Shin , Feiran Wang, Sen Wu , and Ce Zhang .


Getting Started

Background Reading

DeepDive Application Development


Advanced topics

Updates / Changelog


We gratefully acknowledge the support of the Defense Advanced Research Projects Agency (DARPA) XDATA Program under No. FA8750-12-2-0335 and DEFT Program under No. FA8750-13-2-0039, DARPA's MEMEX program, the National Science Foundation (NSF) CAREER Award under No. IIS-1353606 and EarthCube Award under No. ACI-1343760, the Sloan Research Fellowship, the Office of Naval Research (ONR) under awards No. N000141210041 and No. N000141310129, the Moore Foundation, American Family Insurance, CHTC, Google, Lightspeed Ventures, and Toshiba. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of DARPA, AFRL, NSF, ONR, or the U.S. government.

DeepDive asks the developer to think about features—not algorithms . In contrast, other machine learning systems require the developer think about which clustering algorithm, which classification algorithm, etc. to use. In DeepDive's joint inference based approach, the user only specifies the necessary signals or features .

SLIDE of 12

Twitter reacts to Trevor Siemian's first tweet

you're the greatest of all time

SLIDE of 12

Twitter reacts to Trevor Siemian's first tweet

delete your account

SLIDE of 12

Twitter reacts to Trevor Siemian's first tweet


SLIDE of 12

Twitter reacts to Trevor Siemian's first tweet

What's your favorite cut of steak?

SLIDE of 12

Twitter reacts to Trevor Siemian's first tweet

you have to start week 1. Your name is too perfect for fantasy football

SLIDE of 12

Twitter reacts to Trevor Siemian's first tweet

By Chad Jensen

Wide receiver has not been a roster weakness of the Denver Broncos, per say. With Salvatore Ferragamo Chunky loafers Xha9hS1Xi
and UGG® Australia Catton LaceUp Shoe fdZnIBP
having combined for seven Pro Bowls in Denver, the top of the depth chart has produced at a high level over the years.

The dearth of quality quarterback play finally caught up to Thomas and Sanders, as their numbers dropped in 2016, and precipitously further in 2017. But as we saw last season with both players approaching the dreaded 30-year-old mark, Father TIme is beginning to take his toll.

Sanders missed significant time with an ankle injury, and while Thomas still appeared in all 16 games,he seemed to lack that explosive element that once defined his game. The Broncos had to turn to the depth of their receiving corps andit wasfound wanting.

Jimmy choo Suede Billie Heels 4Yovrd
and Cody Latimer were allowed to leave in free agency, while Stuart Weitzman Woman Metermaid Velvet Boots Size 6 PmrJv
remains. But let’s face it, as savvy as Taylor is, he’s not exactly the second coming of Ed McCaffrey.

The team knew that it had to bolster the wide receiving corps, especially on the heels of Carlos Henderson and Isaiah McKenzie ’s inability to make a dent last year. And so, for the second consecutive year, the Broncos took two wideouts in the NFL Draft.

SMU’s Courtland Sutton was picked in round two, with Penn State’s ASOS JULINA Embroidery Espadrilles JF8JO
in the fifth. Right out of the gates, it was clear that there was something different about this duo.

QA Calendar

Mon 16
Tue 17
Wed 18
Thu 19
Fri 20
Sat 21
Sun 22
Sports Columnist Tom Boswell answered reader questions about the Redskins, the Capitals, the Nationals, baseball, the NFL and more.
The Post's travel writers and editors discuss your travel stories, questions, gripes and more.
Gene Weingarten brings you an update to his monthly Chatological Humor live chat.
Send in your questions to Dr. Andrea Bonior about relationships, mental health, work-life balance, family drama and more.
Live chat with Eugene Robinson about his latest columns and political news.
Washington Post food critic Tom Sietsema entertains your dining questions, rants and raves.
Have cooking questions? We have answers. Ask us now.
The Washington Post's home and design writer hosts a live chat every week for readers.
Post columnist Michelle Singletary offers her advice and answers your questions.
Submit your questions now and join us at noon on July 19.
Washington Post beer and bar reporter Fritz Hahn discusses happy hours, new bars, weekend getaways and other ideas for local entertainment.
Advice Columnist Carolyn Hax takes your questions and tackles your problems.

No Shows Scheduled

Search past Carolyn Hax live chats and find answers to your questions even if she is offline by clicking .

Every Friday at noon, Carolyn takes your questions and comments about her columns and the strange train we call life.

Search Previous Discussions
Chaco Mens Z/cloud 2 Sport Sandal bl78gFfU

Food critic Tom Sietsema takes your dining rants and raves every Wednesday at 11 a.m. ET.

Lulus Morgan Teal Brocade Espadrille Wedges Lulus zrfckf

On one Tuesday each month, columnist Gene Weingarten is online to take your questions and abuse on anything and everything.

Previous Discussions

Regular Chats

Sports columnist Tom Boswell takes your questions about baseball, the Redskins, the Wizards and more every Monday.

Follow Us
AccuWeather Traffic Video Photos
Philadelphia Pennsylvania New Jersey Delaware
Investigation Troubleshooters Consumer Healthcheck Chloé Ankle Boots OLW6g
Art of Aging
About 6abc/Contact Us! Action News Biographies 6abc Contests Promotions TV Listings Jobs Internships at 6abc Community
ALEXANDRE BIRMAN Exclusive to mytheresacom 6eFrasPt
Children's Privacy Policy Your California Privacy Rights
Roger Vivier Gold Flower Mocassins kP83ndW5D
Interest-Based Ads Quiksilver MONKEY ABYSS Tbar sandals demitasse lUabG9fs
Copyright © 2018 ABC Inc., WPVI-TV Philadelphia. All Rights Reserved.