ECCV 2014 - LNCS 8689-8695

Image Retrieval and Ranking via Consistently Reconstructing Multi-attribute Queries

Xiaochun Cao^{1, 2}, Hua Zhang¹, Xiaojie Guo², Si Liu³, and Xiaowu Chen⁴

¹School of Computer Science and Technology, Tianjin University, Tianjin, China
caoxiaochun@iie.ac.cn
huazhang@tju.edu.cn

²State Key Laboratory of Information Security, IIE, Chinese Academy of Sciences, China
xj.max.guo@gmail.com

³Department of Electrical & Computer Engineering, National University of Singapore, Singapore
dcslius@nus.edu.sg

⁴State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University, Beijing, China
chen@buaa.edu.cn

Abstract. Image retrieval and ranking based on the multi-attribute queries is beneficial to various real world applications. Traditional methods on this problem often utilize intermediate representations generated by attribute classifiers to describe the images, and then the images in the database are sorted according to their similarities to the query. However, such a scheme has two main challenges: 1) how to exploit the correlation between query attributes and non-query attributes, and 2) how to handle noisy representations since the pre-defined attribute classifiers are probably unreliable. To overcome these challenges, we discover the correlation among attributes via expanding the query representation, and imposing the group sparsity on representations to reduce the disturbance of noisy data. Specifically, given a multi-attribute query matrix with each row corresponding to a query attribute and each column the pre-defined attribute, we firstly expand the query based on the correlation of the attributes learned from the training data. Then, the expanded query matrix is reconstructed by the images in the dataset with the _2,1 regularization. Furthermore, we introduce the ranking SVM into the objective function to guarantee the ranking consistency. Finally, we adopt a graph regularization to preserve the local visual similarity among images. Extensive experiments on LFW, CUB-200-2011, and Shoes datasets are conducted to demonstrate the effectiveness of our proposed method.

Keywords: Multi-Attribute Image, Image Retrieval & Ranking, Group Sparsity

LNCS 8689, p. 569 ff.

Full article in PDF | BibTeX