Katerina Pastra

Katerina Pastra
Director

Katerina Pastra is the Director of the Cognitive Systems Research Institute, a Senior Researcher at the Institute for Language and Speech Processing, ATHENA Research Center and a Visiting Associate Professor at the University of Plymouth, U.K. She has coordinated a number of  European and national research and development projects, including POETICON++ (FP7-ICT), its predecessor POETICON (FP7-ICT) and a distinguishing Latsis Foundation award for research on “Image-Language Dialectics”. Her research is focused on the computational integration of language, perception and action based on experimental findings from neuroscience. Among others, she has developed the first ‘Minimalist Grammar of Action’, the PRAXICON semantic memory model, the PLT affordances network and the COSMOROE image-language semantic interplay framework. 

Katerina holds a BA in Linguistics (University of Athens, Greece), an MSc in Machine Translation (UMIST, UK) and a PhD in Artificial Intelligence (University of Sheffield, U.K.) in which she explored the integration of vision and language within artificial agents engaged in everyday interaction.  She has worked on information extraction and automatic text-based image/video indexing and retrieval in a number of projects (CONCERTO/IST, SOCIS/EPSRC, REVEAL THIS/IST). She has lectured on Human-Computer/Human-Robot Interaction and the use of cognitive and psychological methods in software engineering (University of Sheffield) and has organised international workshops on image-language association with sponsorships from GOOGLE, the EU-Cognition Network and other international foundations. She is the author of a number of publications on the above topics, one of which has won a distinction by the British Computer Society. She is a Senior IEEE Member, the vice-chair of the European Network on Vision and Language Integration, and co-editor of the Language and Cognition Research Topic in Frontiers in Robotics and Artificial Intelligence.

Publications

Patents

Aloimonos, Y. , Fermueller, C. , Yang, Y. , Li, Y. , & Pastra, K. . (2015). Patent: Learning Manipulation Actions from Unconstrained Videos.

Books

Pastra, K. , Balta, E. , Dimitrakis, P. , Mpandavanou, E. , & Lada, M. . (2009). Image-Language Dialectics in Greek Caricatures. Research Studies. John Latsis Foundation. http://www.latsis-foundation.org/content/actions/action_342/inline/ell/actionInline_342_555342ebe4c24.pdf

Book Chapters

Pastra, K. . (2014). Beware..of the Label!. In Newsletter on Autonomous Mental Development (Vol. 11). IEEE Computational Intelligence Society. http://www.cse.msu.edu/amdtc/amdnl/AMDNL-V11-N1.pdf
Pastra, K. . (2013). Autonomous Acquisition of Sensorimotor Experiences: Any Role for Language?. In Newsletter on Autonomous Mental Development (Vol. 10). IEEE Computational Intelligence Society. http://www.cse.msu.edu/amdtc/amdnl/AMDNL-V11-N1.pdf
Pastra, K. . (2010). From Lexicon to PRAXICON: language-action-image semantic relations. In Conversations on Language and Action (pp. 143–172). Synapsis Publishers.
Pastra, K. . (2006). An alternative suggestion for vision-language integration in intelligent agents. In G. Antoniou, Advances in Artificial Intelligence (pp. 588–591). Springer Berlin Heidelberg. http://www.csri.gr/files/publications/SETN06-pastra.pdf

Journal Papers

Pastra, K. , & Aloimonos, Y. . (2012). The minimalist grammar of action. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 367, 103–117. http://www.csri.gr/files/publications/philoTrans-pastra.pdf
Pastra, K. , & Piperidis, S. . (2006). Video Search: New Challenges in the Pervasive Digital Video Era. Journal of Virtual Reality and Broadcasting, 3. http://www.csri.gr/files/publications/videoSearch-pastra.pdf
Pastra, K. , Saggion, H. , & Wilks, Y. . (2003). Extracting Relational Facts for Indexing and Retrieval of Crime-Scene Photographs. Knowledge-Based Systems, 16, 313–320. http://www.csri.gr/files/publications/BSAI02-pastra.pdf
Pastra, K. , Saggion, H. , & Wilks, Y. . (2003). Intelligent indexing of crime scene photographs. Intelligent Systems, IEEE, 18, 55–61. http://www.csri.gr/files/publications/IEEE-pastra.pdf

Conference Papers

Efstathiou, V. , & Pastra, K. . (2015). Early language acquisition: an enactive cognition analysis on CDI understanding scores of infants aged 8-18 months. In Workshop on Extensive and Intensive Recordings of Children's Language Environment. http://www.csri.gr/files/publications/WEIRCLE-abstract.pdf
Zlatintsi, A. , Koutras, P. , Efthymiou, N. , Maragos, P. , Potamianos, A. , & Pastra, K. . (2015). Quality Evaluation of Computational Models for Movie Summarization. In Seventh International Workshop on Quality of Multimedia Experience, QoMEX 2015. Pilos, Messinia, Greece. http://www.csri.gr/files/publications/ZlatintsiEtAl_MovieSumEval-QoMEX2015_cr.pdf
Veskos, P. , & Pastra, K. . (2014). Perspectives of Robot Action Generalisation: Challenges and Achievements. In International IEEE Workshop on Autonomous Cognitive Robotics. Stirling, UK. http://www.csri.gr/files/publications/AutonCogRob2014.cameraready.pdf
Vatakis, A. , Pastra, K. , & Dimitrakis, P. . (2014). Acquisition of object knowledge through Exploratory Acts. In 15th International Multisensory Research Forum (IMRF).
Kavouras, M. , Sotiriou, S. , Baglatzi, A. , Darra, N. , Kokla, M. , Lazoudis, A. , et al. (2014). Semantic Pathways for Geospatial Thinking. In International Conference on Learning Innovations and Learning Quality (LINQ). https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/LINQ_2014_Proceedings_final.pdf#page=100
Pastra, K. , Balta, E. , Dimitrakis, P. , & Karakatsiotis, G. . (2011). Embodied Language Processing: A New Generation of Language Technology. In Language-Action Tools for Cognitive Artificial Agents. http://www.csri.gr/files/publications/EmboLa-pastra.pdf
Wallraven, C. , Schultze, M. , Mohler, B. , Vatakis, A. , & Pastra, K. . (2011). The POETICON enacted scenario corpus –- A tool for human and computational experiments on action understanding. In IEEE International Conference on Automatic Face Gesture Recognition (FG 2011) (pp. 484–491). presented at the March, IEEE. http://poeticoncorpus.kyb.tuebingen.mpg.de/pub/fg2011.pdf
Pastra, K. , Dimitrakis, P. , Balta, E. , & Karakatsiotis, G. . (2010). PRAXICON and its language-related modules. In Proceedings of companion volume of the 6th Hellenic conference on artificial intelligence (SETN) (pp. 27–32). http://www.csri.gr/files/publications/SETN10-pastra.pdf
Wallraven, C. , Schultze, M. , Mohler, B. , Volkova, E. , Alexandrova, I. , Vatakis, A. , & Pastra, K. . (2010). Understanding Objects and Actions - A VR Experiment. In Joint Virtual Reality Conference of EuroVR - EGVE - VEC (2010). The Eurographics Association. http://www.kyb.mpg.de/fileadmin/user_upload/files/publications/2011/JVRC-2010-Wallraven.pdf
Pastra, K. , Wallraven, C. , Schultze, M. , Vatakis, A. , & Kaulard, K. . (2010). The POETICON Corpus: Capturing Language Use and Sensorimotor Experience in Everyday Interaction. In 7th International Conference on Language Resources and Evaluation (LREC). http://www.csri.gr/files/publications/lrec10.pdf
Pastra, K. , & Balta, E. . (2009). A text-based search interface for Multimedia Dialectics. In Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics: Demonstrations Session (pp. 53–56). Association for Computational Linguistics. http://www.csri.gr/files/publications/EACL09-pastra.pdf
Pastra, K. . (2008). PRAXICON: the development of a grounding resource. In Proceedings of the International Workshop on Human-Computer Conversation. Bellagio, Italy. http://www.csri.gr/files/publications/Bellagio08_pastra.pdf
Pastra, K. . (2006). Beyond multimedia integration: corpora and annotations for cross-media decision mechanisms. In Proceedings of the 5th Language Resources and Evaluation Conference (LREC) (pp. 499–504). http://www.csri.gr/files/publications/LREC06-pastra.pdf
Pastra, K. . (2006). Image-Language Association: are we looking at the right features?. In OntoImage Workshop on Language Resources for Content-based Image Retrieval, Language Resources and Evaluation Conference (LREC). http://www.csri.gr/files/publications/LREC06wsh-pastra.pdf
Piperidis, S. , Papageorgiou, H. , Pastra, K. , Netousek, T. , Gaussier, E. , Tuytelaars, T. , et al. (2006). Multimedia Content Processing and Retrieval in the REVEAL THIS Setting. In 2nd International Conference on Semantic Annotation and Multimedia Technologies (SAMT). http://www.csri.gr/files/publications/samt06.pdf
Pastra, K. , & Piperidis, S. . (2006). Crossing-Media for Video Search: enabling usability beyond traditional broadcast and TV. In Proceedings of the 4th European Interactive TV Conference (pp. 25–26). http://www.csri.gr/files/publications/EuroITV06-pastra.pdf
Pastra, K. . (2004). Viewing Vision-Language Integration as a Double-Grounding Case. In Proceedings of the AAAI Fall Symposium on "Achieving Human-Level Intelligence through Integrated Systems and Research" (pp. 62–67). http://www.csri.gr/files/publications/AAAI04-pastra.pdf
Pastra, K. , & Wilks, Y. . (2004). Vision-Language Integration in AI: a reality check. In Proceedings of the 16th European Conference in Artificial Intelligence (Vol. 16, pp. 937–941). http://www.csri.gr/files/publications/ECAI04-pastra.pdf
Pastra, K. , & Wilks, Y. . (2004). Image-Language Multimodal Corpora: needs, lacunae and an AI synergy for annotation. In Proceedings of the 4th Language Resources and Evaluation Conference (pp. 767–770). http://www.csri.gr/files/publications/LREC04-pastra.pdf
Pastra, K. , Saggion, H. , & Wilks, Y. . (2003). NLP for Indexing and Retrieval of Captioned Photographs. In Proceedings of the Tenth Conference on European Chapter of the Association for Computational Linguistics - Volume 2 (pp. 143–146). Stroudsburg, PA, USA: Association for Computational Linguistics. http://dx.doi.org/10.3115/1067737.1067769
Pastra, K. , & Saggion, H. . (2003). Colouring summaries BLEU. In Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable? (pp. 35–42). Association for Computational Linguistics. http://www.csri.gr/files/publications/EACL03wsh-pastra.pdf
Pastra, K. , Maynard, D. , Hamza, O. , Cunningham, H. , & Wilks, Y. . (2002). How feasible is the reuse of grammars for Named Entity Recognition?. In 3rd International Conference on Language Resources and Evaluation (LREC) (pp. 1412–1418). Canary Islands, Spain. http://www.csri.gr/files/publications/LREC02-pastra.pdf
Pastra, K. , & Saggion, H. . (2001). The language at the scene of the crime -Analysing Crime-Scene reports. In 5th Biennial Meeting of the International Association of Forensic Linguistics. Valetta, Malta.

Technical Reports

Pastra, K. . (2015). COSMOROE Annotation Guide. Athens, Greece: Cognitive Systems Research Institute. http://www.csri.gr/files/publications/CSRI-TRS1-20150201.pdf
Pastra, K. , Saggion, H. , & Wilks, Y. . (2001). Socis: Scene of crime information system. University of Sheffield. http://www.computing.surrey.ac.uk/ai/socis/

PhD Theses

Pastra, K. . (2005). Vision-Language Integration: a Double-Grounding Case. University of Sheffield.

Master Theses

Pastra, K. . (2000). Basic Semantic Element Extraction: the rule-writing experience. University of Manchester Institute of Science and Technology (UMIST), Manchester, U.K. http://www.csri.gr/files/publications/Dissertation_pastra_2000.pdf
Pastra, K. . (1999). The Language of Caricature: Language and Drawing interaction. Department of Greek Philology and Linguistics, University of Athens.

Audiovisual

Pastra, K. , Balta, E. , & Dimitrakis, P. . (2015). COSMOROE Language-Visual Element Parallel Corpus. Athens: Cognitive Systems Research Institute. http://csri.gr/downloads/CMR
Pastra, K. , Balta, E. , & Dimitrakis, P. . (2015). COSMOROE Annotated Data Corpus. Athens: Cognitive Systems Research Institute. http://csri.gr/downloads/CMR