Recognizing a web of events
From Tetherless World Wiki
Contents |
Resources
Systems
Organization
- W3C Media Annotations Working Group - http://www.w3.org/2008/WebVideo/Annotations/ (week of July 6)
- W3C Multimedia Semantics Incubator Group - http://www.w3.org/2005/Incubator/mmsem/
- http://www.w3.org/2005/Incubator/mmsem/XGR-image-annotation/ -- provides guidelines for Semantic Web-based image annotation
- http://www.w3.org/2005/Incubator/mmsem/XGR-vocabularies/ -- Multimedia Vocabularies on the Semantic Web
- http://www.w3.org/2005/Incubator/mmsem/XGR-mpeg7/ -- provide standardized tools for describing multimedia
- http://www.w3.org/2005/Incubator/mmsem/meetings/f2f-athens/
- http://www.w3.org/2005/Incubator/mmsem/meetings/f2f-athens/2006-12-08-Semantic-Multimedia-Authoring.pdf -- what is lost and need in multimedia
- http://www.w3.org/2005/Incubator/mmsem/meetings/f2f-amsterdam/
- http://www.w3.org/2005/Incubator/mmsem/meetings/f2f-amsterdam/IVML.background.2006.06.ppt -- useful background information
- W3C SWBPD MM Task Force, http://www.w3.org/2001/sw/BestPractices/MM/
- Common Multimedia Ontology Framework, http://www.acemedia.org/acemedia/reference/multimedia_ontology/
People
- Raphaël Troncy - http://homepages.cwi.nl/~troncy/Publications/index.html (week of june 30)
- Talk: Multimedia Semantics XG: Challenges and Opportunities (2007) (week of june 30)
- Steffen Staab - http://www.uni-koblenz.de/~staab/ (check his talks)
Papers
- Richard Arndt,Raphaël Troncy,Steffen Staab,Lynda Hardman,Miroslav Vacura. (2007) COMM: Designing a Well-Founded Multimedia Ontology for the Web. In ISWC/ASWC, pp. 30-43, 2007. (Download) (july 1)
- System: http://comm.semanticweb.org/Ontology (july 1)
- Book: Multimedia Ontologies
Events
- W3C Video on the Web Workshop - http://www.w3.org/2007/08/video/ (july 6)
- Semantics And digital Media Technologies (SAMT): 2006 2007 2008 2009 (july 6)
- ACM MultiMedia: 2006 2007 2008 2009 (july 6)
- Workshop on Data Semantics for Multimedia Systems and Applications (DSMSA2008), http://zimmer.csufresno.edu/~yucao/Service/Archive/DSMSA2008/DSMSA2008.htm
- MAReSO 2007, http://mklab.iti.gr/mareso/
- SSMS 2006, http://mkg.iti.gr/ssms2006/
- EWIMT 2005, http://www.acemedia.org/ewimt2005/
- MSW 2005, http://www.acemedia.org/ESWC2005_MSW/
Project
- aceMedia, http://acemedia.org/
- K-Space NoE, http://www.k-space.eu/
- X-Media IP, http://www.x-media-project.org/
- MESH IP, http://www.mesh-ip.eu/
- MUSCLE NoE, http://www.muscle-noe.org/
- BOEMIE STREP, http://www.boemie.org/
- Knowledge Web NoE, http://knowledgeweb.semanticweb.org/
Ontologies
A list from Raphaël Troncy
- the F model: http://tinyurl.com/mb3oms and http://events.semantic-multimedia.org/ontology/2008/12/15/model.owl
- the event ontology: http://purl.org/NET/c4dm/event.owl#
- the CIDOC CRM model: http://cidoc.ics.forth.gr/OWL/cidoc_v4.2.owl
- the ABC Ontology: http://metadata.net/harmony/ABC/ABC.owl
- EventsML-G2: http://www.iptc.org/EventsML/
- the DOLCE+DnS Ultralite: http://www.loa-cnr.it/ontologies/DUL.owl
- the OpenCYC Ontology: http://www.opencyc.org/
to do
Zhengj3 13:08, 30 June 2009 (EDT) [to meet with Jim]
- the understanding of the problem: the general problem and the specific problem you will solve this summer
- existing proposals and their limitations
- read comm paper.
- check Troncy's publication list, list all related work.
- follow the citations to find more paper.
17:42, 14 July 2009 (EDT)
- foaf, semantic rss
- event ontology
Zhengj3 14:50, 16 July 2009 (EDT)
- print ontologies, categorize classes, compare models: important concepts, unneccessary concepts.
- draft an ontology.
14:29, 30 June 2009 (EDT)Zhengj3
For still image:
| Format | Capabilities | Limitations | Comments |
| VRA Core | consists of a metadata element set (units of information such as title, location, date, etc.), as well as an initial blueprint for how those elements can be hierarchically structured. The element set provides a categorical organization for the description of works of visual culture as well as the images that document them. | http://www.vraweb.org/projects/vracore4/VRA_Core4_Outline.pdf | |
| EXIF | covers metadata related to the capture of the image and the context situation of the capturing, image data structure, capturing information, general tags, recording offset, image data characteristics, maybe GPS information | ||
| NISO | basic image parameters, image creation, imaging performance assessment, history. intended to facilitate the development of applications to validate, manage, migrate, and otherwise process images of enduring value | ||
| DIG35 | "standard set of metadata for digital images" which promotes interoperability and extensibility, as well as a "uniform underlying construct to support interoperability of metadata between various digital imaging devices.", Basic Image Parameter, Image Creation, Content Description, History, Intellectual Property Rights, Funcamental Metadata Types and Fields | ||
| PhotoRDF | three different schemas, a Dublin Core, a technical schema and a content schema. it covers only a small set of properties, creator, editor, title, date of publishing, etc. the content schema defines a very small set of keywords that shall be used in the "subject" field of the Dublin Core schema. | less properties than exif |
Audio Content
| Format | Capabilities | Limitations | Comments |
| ID3 | metadata container used and embedded with an MP3 audio file format. It allows to state information about the title, artist, album, etc. about a song. | ||
| MusicBrainz Metadata Initiative 2.1 | The core set is capable of expressing basic music related metadata such as artist, album, track, etc.). Instances in RDF are being made available via a query language. | ||
| MusicXML | designed as an interchange format for notation, analysis, and retrieval for music notation nd digital sheet music applications |
Audio-Visual Content
| Format | Capabilities | Limitations | Comments |
| MPEG-7 | the standard has been designed for a broad range of applications and thus employs very general and widely applicable concepts. The standard contains a large set of tools for diverse types of annotations on different semantic levels. The flexibility is very much based on the structuring tools and allows the description to be modular and on different levels of abstraction. MPEG-7 supports fine grained description, and it provides the possibility to attach descriptors to arbitrary segments on any level of detail of the description. | Two main problems arise in the practical use of MPEG 7 from its flexibility and comprehensiveness: complexity and limited interoperability. The complexity is a result of the use of generic concepts, which allow deep hierarchical structures, the high number of different descriptors and description schemes, and their flexible inner structure.The interoperability problem is a result of the ambiguities that exist because of the flexible definition of many elements in the standard (e.g. the generic structuring tools) | |
| AAF | allows the interchange of data between multimedia authoring tools. AAF supports the encapsulation of both metadata and essence, but its primary purpose involves the description of authoring information. supports storing event-related information (e.g. time-based user annotations and remarks) or specific authoring instructions. | ||
| MXF | optimized for the interchange of material for the content creation industries. allows applications to know the duration of the file, what essence codecs are required, what timeline complexity is involved and other key points to allow interchange. | ||
| SMIL | enabling simple authoring of interactive audiovisual presentations. SMIL is used to describe scenes with streaming audio, streaming video, still images, text or any other media type. SMIL can be integrated with other web technologies such as XML, DOM, SVG, CSS and XHTML. allows authors to describe documents with a very basic vocabulary (meta element; inherited from SMIL 1.0), and in its recent version the specification introduces new capabilities for describing metadata using RDF. | ||
| SVG | describing two-dimensional vector and mixed vector/raster graphics in XML. It allows for describing scenes with vector shapes (e.g. paths consisting of straight lines, curves), text, and multimedia (e.g. still images, video, audio). | ||
| NewsML-G2 | provide a single generic model for exchanging all kinds of newsworthy information, thus providing a framework for a future family of IPTC news exchange standards. | ||
| TVAnytime | They have extended the MPEG-7 vocabulary with higher-level descriptors, such as, for example, the intended audience of a program or its broadcast conditions. | ||
| MPEG-21 | The MPEG-21 standard consists of 18 parts of which the following are the most relevant for the scope of the MMSEM-XG:
Part 2, Digital Item Declaration (DID), provides an abstract model and an XML-based representation thereof which is used to define Digital Items. The DID Model defines digital items, containers, fragments or complete resources, assertions, statements, choices/selections, and annotations on digital items. Part 3, Digital Item Identification and Description (DII), is concerned with the ability to identify and refer to complete or partial Digital Items. Part 5, Rights Expression Language (REL), provides a machine-readable language to declare rights and permissions using the terms as defined in the Rights Data Dictionary. Part 17, Fragment Identification for MPEG Media Types, specifies a syntax for identifying parts (e.g., track of a CD/DVD) of MPEG resources via Uniform Resource Identifiers (URIs). |
||
| EBU P/Meta | for programme exchange in the professional broadcast industry. Metadata: Identification, Technical metadata, programme description and classification, creation and production information, rights and contract information, publication information. |
Multimedia Ontologies
| Format | Capabilities | Limitations | Comments |
| VRA - RDF/OWL | mapping from VRA Core to RDF/OWL | ||
| Exif - RDF/OWL | to represent the Exif metadata tags in an RDF-S ontology. | ||
| DIG35 - RDF/OWL | provides an OWL Schema covering the entire DIG35 specification | ||
| MPEG-7 - RDF/OWL | MPEG-7 Upper MDS Ontology: available in OWL-Full. The ontology covers the upper part of the Multimedia Description Scheme (MDS) part of the MPEG-7 standard. It comprises about 60 classes and 40 properties. MPEG-7 MDS Ontology: this MPEG-7 ontology covers the full Multimedia Description Scheme (MDS) part of the MPEG-7 standard. It contains 420 classes and 175 properties. This is an OWL DL ontology. MPEG-7 Ontology: This ontology aims to cover the whole standard and it thus the most complete one (with respect to the previous mentioned). It contains finally 2372 classes and 975 properties. This is an OWL Full ontology. Core Ontology for Multimedia: COMM is an OWL DL ontology. It is composed of multimedia patterns specializing the DOLCE design patterns for Descriptions & Situations and Information Objects. The ontology covers a very large part of the MPEG-7 standard. The explicit representation of algorithms in the multimedia patterns allows also to describe the multimedia analysis steps, something that is not possible in MPEG-7. |
no commonly agreed upon mapping to RDF/OWL | |
| Mindswap Image Region Ontology | The ontology defines concepts including image, video, video frame, region, as well as relations such as depicts, regionOf, etc. Using these concepts and their associated properties, it is therefore possible to assert that an image/imageRegion depicts some instance, etc. |
12:21, 3 July 2009 (EDT)
- Papers from Raphaël Troncy - http://homepages.cwi.nl/~troncy/Publications/index.html
- Issues on Semantic Multimedia This paper describes several issues/research fields on semantic multimedia: Content Understanding and Structuring, Semantic Classification of Visual Content, Leveraging the Power of Ontologies in Multimedia Search, etc.
- Semantic Multimedia This paper has more detailed description of MPEG-7 and COMM.
- DESCRIBING LOW-LEVEL IMAGE FEATURES USING THE COMM ONTOLOGY Another paper describes the usage of COMM.
- Enabling Multimedia Metadata Interoperability by Defining Formal Semantics of MPEG-7 Profiles propose an approach for expressing semantics explicitly by formalizing the semantic constraints of a profile using ontologies and rules, thus enabling interoperability and automatic use for MPEG-7 based applications. (check overview of the propose in the paper)
- MPEG-7 based Multimedia Ontologies: Interoperability Support or Interoperability Issue? Describes 4 MPEG-7 ontologies.
12:10, 6 July 2009 (EDT)Zhengj3
Steffen Staab - http://www.uni-koblenz.de/~staab/
- MPEG-7 Ontology : http://metadata.net/mpeg7/mpeg7.owl
- MPEG-7 Ontology paper: http://www.itee.uq.edu.au/~eresearch/papers/2001/swws.pdf
Comparsion of event ontology
| Name of Ontology | Advantage/What it can do | Disadvantage/What it can't do |
| F Model | ||
| the event ontology | ||
| CIDOC CRM model | ||
| ABC Ontology | ||
| DOLCE+DnS | ||
| Our Event Ontology |
