Developing Trust in Aggregated Government Data: Provenance, Interpretation Knowledge and URI Design for Incremental Enhancement of Tabular Data

Printer-friendly version

Authors:Tim Lebo


A wealth of interesting data is still not accessible via semantic web technologies. This is particularly true within the government sector, where very large organizations create disparate datasets describing related content. Fortunately, the tabular structure is a common representation paradigm that can be cast into RDF -- but not all RDF is created equal. In this talk, I will argue that a naïve translation of tabular data to RDF is insufficient to realize the full potential that the semantic web provides. I will then introduce, an interpretation vocabulary that allows explicit parameterization for how tabular data should be restructured to produce representations that more closely match the world they describe. This, along with our implementation, addresses the needs of data curators that collect from third party sources and provide to subsequent third party consumers. Finally, I address the essential need for provenance within data curation, describe the current aspects that we capture, and explore additional aspects that should be incorporated.

Related Projects:

Inference Web Project LogoInference Web
Principal Investigator: Deborah L. McGuinness
Description: The Inference Web is a Semantic Web based knowledge provenance infrastructure that supports interoperable explanations of sources, assumptions, learned information, and answers as an enabler for trust. Provenance - if users (humans and agents) are to use and integrate data from unknown, uncertain, or multiple sources, they need provenance metadata for evaluation Interoperability - more systems are using varied sources and multiple information manipulation engines, thus increasing interoperability requirements Explanation/Justification - if information has been manipulated (i.e., by sound deduction or by heuristic processes), information manipulation trace information should be available Trust - if some sources are more trustworthy than others, trust ratings are desired The Inference Web consists of two important components: Proof Markup Language (PML) Ontology - Semantic Web based representation for exchanging explanations including provenance information - annotating the sources of knowledge justification information - annotating the steps for deriving the conclusions or executing workflows trust information - annotating trustworthiness assertions about knowledge and sources IW Toolkit - Web-based and standalone tools that facilitate human users to browse, debug, explain, and abstract the knowledge encoded in PML.
DCO-DS LogoLinking Open Government Data (LOGD)
Principal Investigator: Jim Hendler and Deborah L. McGuinness
Description: The LOGD project investigates the role of Semantic Web technologies, especially Linked Data, in producing, enhancing and utilizing government data published on and other websites.
SPCDIS Project LogoSemantic Provenance Capture in Data Ingest Systems (SPCDIS)
Principal Investigator: Peter Fox
Co Investigator: Deborah L. McGuinness
Description: The goal of this project is to develop at the RPI Tetherless World Constellation, based within the NCAR High Altitude Observatory and in collaboration with the University of Texas at El Paso, the University of Michigan and McGuinness Associates a semantically-enabled data ingest capability.
TW LogoSemantic Workflow and Management of Provenance (SWaMP)
Principal Investigator: Peter Fox
Description: A joint effort between the Tetherless World Constellation at Rensselaer Polytechnic Institute and the The Commonwealth Scientific and Industrial Research Organisation (CSIRO).
SeSF Project LogoSemantic eScience Framework (SeSF)
Principal Investigator: Peter Fox
Co Investigator: Jim Hendler and Deborah L. McGuinness
Description: Over the past few years, semantic technologies have evolved and new tools are appearing. Part of the effort in this project will be to accommodate these advances in the new framework and lay out a sustainable software path for the (certain) technical advances. In addition to a generalization of the current data science interface, we will include an upper-level interface suitable for use by clearinghouses, and/or educational portals, digital libraries, and other disciplines.
DCO-DS LogoTheory and Practice of Accountable Systems (TPAS)
Principal Investigator: Jim Hendler
Description: The TPAS Project investigates computational and social properties of information networks necessary to provide reliable assessments of compliance with rules and policies governing the use of information.

Related Research Areas:

Data Frameworks
Lead Professor: Peter Fox
Description: None.
Data Science
Lead Professor: Peter Fox
Description: Science has fully entered a new mode of operation. Data science is advancing inductive conduct of science driven by the greater volumes, complexity and heterogeneity of data being made available over the Internet. Data science combines of aspects of data management, library science, computer science, and physical science using supporting cyberinfrastructure and information technology. As such it is changing the way all of these disciplines do both their individual and collaborative work.

Data science is helping scienists face new global problems of a magnitude, complexity and interdisciplinary nature whose progress is presently limited by lack of available tools and a fully trained and agile workforce.

At present, there is a lack formal training in the key cognitive and skill areas that would enable graduates to become key participants in escience collaborations. The need is to teach key methodologies in application areas based on real research experience and build a skill-set.

At the heart of this new way of doing science, especially experimental and observational science but also increasingly computational science, is the generation of data.

Inference And Trust
Lead Professor: Deborah L. McGuinness
Description: Inference And Trust
Concepts: Semantic Web
Knowledge Provenance
Lead Professor: Deborah L. McGuinness
Description: Knowledge Provenance
Concepts: Provenance, Semantic Web
Lead Professor: Peter Fox
Description: In the last 2-3 years, Informatics has attained greater visibility across a broad range of disciplines, especially in light of great successes in bio- and biomedical-informatics and significant challenges in the explosion of data and information resources. Xinformatics is intended to provide both the common informatics knowledge as well as how it is implemented in specific disciplines, e.g. X=astro, geo, chem, etc. Informatics' theoretical basis arises from information science, cognitive science, social science, library science as well as computer science. As such, it aggregates these studies and adds both the practice of information processing, and the engineering of information systems.
Concepts: Semantic Web,