SPCDIS

SPCDIS Meeting Notes May 11, 2012

Welcome to TitanPad!

General Meeting Information

Agenda

  • Status and Action Items

Attendance

  • Patrick
  • Stephan
  • Naveen
  • Sapan

Past Action Items

Action Items

  • See SPCDIS trac tickets
  • PW: sftp issues from draco to or

SPCDIS Meeting Notes May 29, 2012

Welcome to TitanPad!

General Meeting Information

Agenda

  • Status

Attendance

  • Patrick

Past Action Items

Action Items

  • Sapan: kick off cron automatically every 5 minutes
  • PW: ask Leonard if we can be notified when they run the pipeline, how often is there a new raw file
  • PW: make spcdis user an ldap user, thereby giving access to or

SPCDIS Working Group - COMP Parallel Pipeline

Documented here is the parallel pipeline that TWC created of the HAO processing pipeline of COMP data. What we've done is take their mostly IDL code and add provenance capture statements. These statements generate a log file which can then be parsed and converted into RDF, ingested into a triple store, and displayed to users.

Where do we capture provenance

IDL Component

Pipeline software developed at HAO is driven by a language called IDL (Interactive Data Language).

SPCDIS Sprint May 01, 2012

Welcome to TitanPad!

General Meeting Information

Agenda

  • Running pipeline
  • Example Logs and RDF
  • Status

Attendance

  • Stephan
  • Patrick
  • Sapan
  • Naveen
  • James
  • Jay

Past Action Items

Action Items

  • JM: Create trac tickets for IDL code issues

SPCDIS Working Group - MLSO Provenance Capture Infrastructure

Overview of MLSO Data Ingest Pipeline

describe MLSO data ingest pipeline (with diagrams)

Provenance Capture Strategy

describe overall provenance capture strategy (with diagrams)

In-situ Provenance Capture

describe logging of provenance via custom IDL functions

  • describe provenance logging function calls
  • examples of logging statements added to IDL scripts
  • example log content

Provenance RDF Generation

describe generation of RDF from provenance logs

  • ontologies we using to represent provenance and science concepts in RDF
  • our translatio

SPCDIS Working Group - Visualization and User Interaction

TODO: Add description of current presentation/UI direction.

Mockup

SPCDIS Mockup 2 [Download] from June 16, 2010

SPCDIS Working Group - Domain, Process and Provenance Concept Capture

Observation and Measurement (O&M) Information Model

Continuum Observation

Source PDF available here.

Integrating O&M, SSN, and PML

Continuum Observation PML

Source PDF available of Continuum Observation PML [Download]

Domain (O&M and SSN) properties and classes are blue, PML properties and classes are dark green, resources tha

SPCDIS Working Group - CHIP GBU Processing Provenance Capture

Description of CHIP GBU Rating Process

Five spots on the solar image are used to create a time series for the day, with one spot in the center. Each is correlated with the center spot as a measure of clouds, with the assumption that all five areas will not be affected by the variability of solar activity. If the center spot is determined to have activity in it, another spot is substituted as this reference time series. This is done to find a spot time series not affected by solar activity.

The five spots on the image are fixed for all images.

Syndicate content