In this web application, we present an experimental multimodal search engine, which allows multimedia and multi-language queries, and makes use of the total available information in a multimodal collection. All modalities are indexed and searched separately, and results can be fused with different methods depending on
Beyond fusion, we also provide 2-stage retrieval by first thresholding the results obtained by secondary modalities targeting recall, and then re-ranking them based on the primary modality. The engine demonstrates the feasibility of the proposed architecture and methods on the ImageCLEF 2010 Wikipedia collection. Its primary modality is image, consisting of 237434 items, associated with noisy and incomplete user-supplied annotations and the Wikipedia articles containing the images. Associated modalities are written in any combination of English, German, French, or any other undetermined language.
Dr. Konstantinos Zagoris (email:kzagoris@gmail.com) received the Diploma in Electrical and Computer Engineering in 2003 from Democritus University of Thrace, Greece and his phD at the same univercity in 2010. His research interests include document retrieval, color image processing and analysis, document analysis and pattern recognition. He is a member of the Technical Chamber of Greece.
Dr. Savvas Chatzichristofis (email:savvash@gmail.com) received the diploma of Electrical Engineer in 2004 from the Democritus University of Thrace (DUTH), Greece and now his PhD at the same university in the area of machine intelligent, neural networks, Fuzzy Logic and computer vision. He is also Member in Cyprus Scientific and Technical Chamber since 2005, licentiate in the fields of Electronics, Information Science and Electrical Mechanics. He is also registered in the Electro-mechanical Service of Cyprus since 2007.
Dr. Avi Arampatzis (email:avi@ee.duth.gr) graduated from the department of Computer Engineering & Informatics, University of Patras, Greece, on September 1996. Ph.D in Informatics (Information Retrieval & Information Systems group) from the Computing Science Department, University of Nijmegen, the Netherlands, on June 21, 2001. Postdoctoral Fellow at the Department of Information and Computing Sciences, Center for Geometry, Imaging and Virtual Environments, Utrecht University, the Netherlands, 2003-2005. Postdoctoral Fellow at the Department of Media Studies, Archives and Information Studies group, University of Amsterdam, the Netherlands, 2006-2009.Faculty member at the department of Electrical Engineering & Computer Engineering of Democritus University of Thrace, Greece, from November 2009.
6. Bag-of-Visual-Words vs Global Image Descriptors on Two-Stage Multimodal Retrieval. Konstantinos Zagoris, Savvas A. Chatzichristofis, and Avi Arampatzis. In: Proceedings of the 34rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, July 24-28, Beijing, China, 2011. To appear
5. The TREC Files: the (ground) truth is out there. Savvas A. Chatzichristofis, Konstantinos Zagoris, and Avi Arampatzis. In: Proceedings of the 34rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2011, July 24-28, Beijing, China, 2011. To appear
4. Fusion vs Two-Stage for Multimodal Retrieval. Avi Arampatzis, Konstantinos Zagoris, and Savvas A. Chatzichristofis. In: P. Clough et al. (Eds.): ECIR 2011, LNCS 6611, pp. 759–762, 2011.
3. Dynamic Two-Stage Image Retrieval from Large Multimodal Databases. Avi Arampatzis, Konstantinos Zagoris, and Savvas A. Chatzichristofis. In: P. Clough et al. (Eds.): ECIR 2011, LNCS 6611, pp. 326–337, 2011.
2. www.MMRetrieval.net: A Multimodal Search Engine Konstantinos Zagoris, Avi Arampatzis, and Savvas A. Chatzichristofis. In: Proceedings of the 3rd International Conference on SImilarity Search and APplications, SISAP 2010, Istanbul, Turkey, September 18-19, 2010.
1. Multimedia Search with Noisy Modalities: Fusion and Multistage Retrieval. Avi Arampatzis, Savvas A. Chatzichristofis, and Konstantinos Zagoris. In: CLEF (Notebook Papers/LABs/Workshops), 22-23 September, Padua, Italy, 2010.