In analyzing the needs of instrument data providers, several challenges are clear:
Our conclusion is that these statements point to the lack of a comprehensive, re-useable data ingest framework. Further, to be truly effective in an age of modern data management and dissemination we propose that such a framework must consist of a semantically rich set of annotations along the data ingest workflow and a smart storage, propagation and retrieval mechanism for the provenance and derivation information. This goal for effectively increasing the data product value includes the need to annotate and map at the source, and even prior to generation of the data, i.e. in the instrument development and observational planning stages.
Since we propose to utilize both an existing and mature data input stream from ACOS (Advanced Coronal Observing System currently installed at the Mauna Loa Solar Observatory) as well as a planned (very large volume) data stream from CoSMO (Coronal Solar Magnetism Observatory) we base our work in a very practical application of semantic web methodology and technology.
The specific tasks proposed are divided into two broad areas:
Provenance is the origin or source from which something comes, intention for use, who/what generated for, manner of manufacture, history of subsequent owners, sense of place and time of manufacture, production or discovery, documented in detail sufficient to allow reproducibility.