SPCIDS search use case 1. Search QuickLook Image

From Tetherless World Wiki

Jump to: navigation, search

back to SPCDIS

Contents

Use Case Description

DEMO link http://browser.inference-web.org/spcdissearch/ListResourceBeta2

Background

Data to be queried

Each PML file can be intuitively viewed as a transaction log record for an execution of a VSTO service.

type of data conclusion content example file
original CHIP_Image url http://iw.vsto.org/pml/CHIP_ImageCSR_1222276552188.owl
parsed process log, embed xml http://iw.vsto.org/pml/LogParserConclusion_1222276552655.owl
parsed observer log embed formatted text http://iw.vsto.org/pml/ObserverLogConclusion_1222276551770.owl
extract timestamp time e.g. http://iw.vsto.org/pml/TimestampConclusion_1222276552442.owl
eql embed xml http://iw.vsto.org/pml/extendedQLProduct_1222276574991.owl
QL GIF url http://iw.vsto.org/pml/qlGIF_1222276552339.owl

Queries

  • SearchQuery0. Find QL images generated on September 18, 2008
    • See definition of QL and EQL below.
    • There are usually many quick look images generated on a single day, one of them is posted per day on the mlso.hao.ucar.edu website
    • September 18, 2008 needs to be converted to xsd datetime and note that time is recorded in UTC (universal time) so that images may 'span' two days in UTC but are part of a single day, i.e. local solar time.
  • Test search:
    • Goto http://browser.inference-web.org/spcdissearch/ListResourceBeta2
      • 1. Select "any" image type.
      • 2. Select "XML with defined DTD" format.
      • 3. Set time duration to "unknown".
      • 4. Leave source of "any".
      • 5. Click "GO".
      • 6. The search result will be sent to ProbeIt as PML Query document and ProbeIt will be launched on your desk top.


  • SearchQuery1. Find CHIP images
    • See definitions of CHIP below. The word CHIP is an acronym that may not appear in documents and decribes the instrument and not what the image represents, i.e. this search actually means "Find images taken by CHIP"
    • Is intended (scientist) to return science data but may also return QL images (scientists and general use
    • An inaccurate but legitimate return could be a picture/image of the instrument itself
  • SearchQuery1a. Find images (1)which is a CHIP image (2)generated on September 18, 2008 (i.e. 0 + 1)
    • Test search 1:
      • Goto http://browser.inference-web.org/spcdissearch/ListResource
        • 1. Select format of "CHIP Binary Image Format"
        • 2. Set time duration from 2008-09-18T00:00:00 to 2008-09-18T23:59:59.
        • 3. Click "GO".
        • 4. From the second frame, select about 10 content URLs.
        • 5. Select "How The Result was Obtained and Support Information".
        • 6. Click "GO".
        • 7. Click any number from the "Result" list.
        • 8. Results are presented as PML Query/Answers. Select a viewer to view the PML document the queried image is in.
    • Test search 2:
      • Goto http://browser.inference-web.org/spcdissearch/ListResourceBeta2
        • 1. Select "raw" image type.
        • 2. Select "CHIP Binary Image Format" format.
        • 3. Set time duration from 2008-09-18T00:00:00 to 2008-09-18T23:59:59.
        • 4. Leave source of "any".
        • 5. Click "GO".
        • 6. The search result will be sent to ProbeIt as PML Query document and ProbeIt will be launched on your desk top.
    • Add expansion of the use case here

Note:

  • We feel that SearchQuery1 is the most interesting case

Answers (functional requirements)

  • SearchQuery0.
    • link to the table html source
    • A table such as this (perhaps more visual, could we infer that?)

Returned Results

Query: Find QL images generated on March 21, 2008

Format
Description
 Link Rendered Link Explain
JPG Daily quick look image for March 21, 2008, taken at the ... filename.fits filename.jpg
?
FITS CHIP Image for March 21, 2008 shows.. filename200803211900.fits filename200803211900.jpg
?

Terms

JPG = etc.

  • SearchQuery1.
    • link to the table html source
    • Perhaps a table such as:

Returned Results

Query: Find CHIP images

Format
Description
 Link Rendered Link Explain
FITS Best daily image for March 22, 2008, taken at the ... filenamebest.fits filenamebest.jpg
?
JPG Daily quick look image for March 22, 2008, taken at the ... filename.fits filename.jpg
?
FITS Image for March 22, 2008, taken at the ... filename200803221900.fits filename200803221900.jpg
?

Terms

FITS = Flexible Image Transport System (e.g. link to a tool to open/view)

JPG = etc.


  • SearchQuery1a.
    • Ditto

Non-functional requirements

Definitions

  • QL = Quick Look - a graphical representation of a qualitative image of the Sun. This means the image is not (or not fully consistently) calibrated and the 'data' in the image is not of science quality. The image is used for many purposes: to determine what is going on the Sun for observers, scientists at HAO, and end-users (more to come here), to determine that the instrument is functioning, the sky/ weather conditions are suitable for obtaining data, and as a guide for users to then request the science quality image.
  • CHIP = Chromospheric Helium I Imaging Photometer (see http://mlso.hao.ucar.edu/about.html) is an instrument that observes a particular layer of the solar atmosphere. It is one of the instruments that operates at the Mauna Loa Solar Observatory in Hawaii
  • CHIP image = a science quality image derived from processing (using calibration and corrections) from images generated by an instrument whose name is exactly "CHIP". The instrument can generate a number of data products (images). The usual product generated is the one made available on the MLSO web site: http://mlso.hao.ucar.edu
  • QL image = a QL image obtained using a script (IDL) using input images from any of the MLSO instruments, whose name is exactly "QuickLook" (as noted above, it is not intended for science use), usually these are GIF or JPG format
  • EQL = Enhanced QL is our markup of the QL with PML. EQL/PML schematic for CHIP 20080306
  • VSTO = Virtual Solar-Terrestrial Observatory http://vsto.hao.ucar.edu and http://www.vsto.org - provides guided query workflow to find and retrieve data for science quality images (only). These data in in the form of FITS or JPG, or other data product types (details are in the VSTO ontology (http://dataportal.ucar.edu/schemas/vsto_all.owl). VSTO also provides web service end-points (e.g. http://www.vsto.org/data/queryInstrument.htm) for the same guided workflow functions (byInstrument, byParameter, byDateTime). VSTO is *fully* structured query implementation. At present, it does not have a pure search interface (but that is planned).
  • FITS = Flexible Image Transport Standard is a file format with APIs in C, C++, Java and IDL

Use Case Data

Science data

(note this is NOT a quick look)

QL

  • E.g. QL (latest)

http://download.hao.ucar.edu/d5/www/fullres/latest/latest.chip.gif

  • Note, we will have to cache/save quick look images with dates, etc.

PML

In Progress

Tasks

  • Peter Fox will update the use case definitions - started Sep. 19, 2008
  • Li Ding will continue suggest a solution to each of query
  • Li Ding fix wiki login time out
  • Li Ding need a set of PML document as test case. we may choose two approaches
    • (1) use some inference to generate additional text description to QL images, and run text search. bag of word model is simple but also limited.
    • (2) use a sparql which also support time range and regular expression see http://www.w3.org/TR/rdf-sparql-query/#OperatorMapping. this will let use query the semantic structure.
Retrieved from "http://tw.rpi.edu/wiki/SPCIDS_search_use_case_1._Search_QuickLook_Image"
Personal tools