NLP for Indexing and Retrieval of Captioned Photographs

TitleNLP for Indexing and Retrieval of Captioned Photographs
Publication TypeConference Papers
Year of Publication2003
AuthorsPastra, K, Saggion, H, Wilks, Y
Conference NameProceedings of the Tenth Conference on European Chapter of the Association for Computational Linguistics - Volume 2
PublisherAssociation for Computational Linguistics
Conference LocationStroudsburg, PA, USA
ISBN Number1-111-56789-0

In this paper we present a new approach to the automatic semantic indexing of digital  photographs  based on the extraction of logic relations from their textual descriptions. The method is based on shallow parsing and propositional analysis of the descriptions using an ontology for the domain of application. We describe the semantic representation formalism, the ontology,  and the algorithms involved in the automatic derivation of semantic indexes from texts linked to images.  The method has been integrated into the Scene of the Crime Information System, a crime management system for storing,  indexing and retrieval of crime information.