Open-set Person Re-identification Database and Evaluation v1.0

Home   |   Download   |   Contact   |   Results   |   References


Person re-identification is becoming a hot research for developing both machine learning algorithms and video surveillance applications. The task of person re-identification is to determine which person in a gallery has the same identity to a probe image. This task basically assumes that the subject of the probe image belongs to the gallery, that is, the gallery contains this person. However, in practical applications such as searching a suspect in a video, this assumption is usually not true. In this paper, we consider the open-set person re-identification problem, which includes two sub-tasks, detection and identification. The detection sub-task is to determine the presence of the probe subject in the gallery, and the identification sub-task is to determine which person in the gallery has the same identity as the accepted probe. We present a database collected from a video surveillance setting of 6 cameras, with 200 persons and 7,413 images segmented. Based on this database, we develop a benchmark protocol for evaluating the performance under the open-set person re-identification scenario. Several popular metric learning algorithms for person re-identification have been evaluated as baselines. From the baseline performance, we observe that the open-set person re-identification problem is still largely unresolved, thus further attention and effort is needed.

We provide the OPeRID v1.0 database, baseline features, and a benchmark toolkit here to further advance research in this field. For more information, please read our paper [1].

Download:

Contact:

Shengcai Liao,   scliao@nlpr.ia.ac.cn

National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences.

Results:

ROC curves at rank 1 ROC curves at rank 10
CMC curves at FAR=1% CMC curves at FAR=10%



Table 1. OPeRID Performances measured in (μ - σ) of 10 trials

Method FAR=1% FAR=10%
Rank=1 Rank=10 Rank=1 Rank=10
IDENTITY 0.84 0.91 7.36 9.21
MAHAL 1.89 1.99 10.50 11.97
KISSME 1.82 1.92 9.99 11.46
LMNN 0.41 0.41 3.97 4.58
ITML 1.18 1.21 8.39 9.27
LADF 1.53 1.74 9.11 10.82
RRDA 3.99 4.35 14.51 16.72

Download the result files and demo code for performance plot: results.zip

References:

[1] Shengcai Liao, Zhipeng Mo, Jianqing Zhu, Yang Hu, and Stan Z. Li, "Open-set Person Re-identification," arXiv:1408.0872, 2014. [pdf]
Last updated: Oct. 16, 2014