Beyond multimedia integration: corpora and annotations for cross-media decision mechanisms

TitleBeyond multimedia integration: corpora and annotations for cross-media decision mechanisms
Publication TypeConference Papers
Year of Publication2006
AuthorsPastra, K
Conference NameProceedings of the 5th Language Resources and Evaluation Conference (LREC)
Abstract

In this paper, we look into the notion of cross-media decision mechanisms, focussing on ones that work within multimedia documents for a variety of applications, such as the generation of intelligent multimedia presentations and multimedia indexing. In order for these mechanisms to go beyond the identification of semantic equivalence relations between media –-which is what integration does–- appropriate corpora and annotations are needed. Drawing from our experience in the REVEAL THIS project, we indicate the characteristics that such corpora should have, and suggest a number of annotations that would allow for training/designing such mechanisms. We conclude with a view on the suitability of two related markup languages (MPEG-7 and EMMA) for accommodating the suggested annotations.

URLhttp://www.csri.gr/files/publications/LREC06-pastra.pdf