Concept-based indexing of annotated images using semantic DNA

Syed Abdullah, Engku Fadzli Hasan and Setchi, Rossitza M. (2012) Concept-based indexing of annotated images using semantic DNA. Engineering Applications of Artificial Intelligence, 25 (8). pp. 1644-1655. ISSN 0952-1976

[img] Image
Concept-based indexing of annotated images using semantic DNA.jpg
Restricted to Registered users only

Download (219Kb)
[img] Text
Concept-based indexing of annotated images using semantic DNA 2.pdf
Restricted to Registered users only

Download (455Kb)
Official URL: http://www.scopus.com/record/display.url?eid=2-s2....

Abstract

One of the challenges in image retrieval is dealing with concepts which have no visual appearance in the images or are not used as keywords in their annotations. To address this problem, this paper proposes an unsupervised concept-based image indexing technique which uses a lexical ontology to extract semantic signatures called 'semantic chromosomes' from image annotations. A semantic chromosome is an information structure, which carries the semantic information of an image; it is the semantic signature of an image in a collection expressed through a set of semantic DNA (SDNA), each of them representing a concept. Central to the concept-based indexing technique discussed is the concept disambiguation algorithm developed, which identifies the most relevant 'semantic DNA' (SDNA) by measuring the semantic importance of each word/phrase in the annotation. The concept disambiguation algorithm is evaluated using crowdsourcing. The experiments show that the algorithm has better accuracy (79.4%) than the accuracy demonstrated by other unsupervised algorithms (73%) in the 2007 Semeval competition. It is also comparable with the accuracy achieved in the same competition by the supervised algorithms (82-83%) which contrary to the approach proposed in this paper have to be trained with large corpora. The approach is currently applied to the automated generation of mood boards used as an inspirational tool in concept design. © 2012 Elsevier Ltd. All rights reserved.

Item Type: Article
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Faculty / Institute: Faculty of Informatics & Computing
Depositing User: Dr Engku Fadzli Hasan Syed Abdullah
Date Deposited: 17 Aug 2015 06:38
Last Modified: 17 Aug 2015 06:38
URI: http://erep.unisza.edu.my/id/eprint/3178

Actions (login required)

View Item View Item