4.9 KiB
4.9 KiB
The new training/testing protocol for CUHK03 (CUHK03-NP)
The new protocol splits the CUHK03 dataset into training set and testing set similar to that of Market-1501, which consist of 767 identities and 700 identities respectively.
In testing, we randomly select one image from each camera as the query for each identity and use the rest of images to construct the gallery set. We make sure that each query identity is selected by both two cameras, so that cross-camera search can be performed.
In evaluation, true matched images captured in the same camera as the query are viewed as “junk”. Meaning that junk images is of zero influence to re-id accuracy (CMC/mAP).
The new training/testing protocol split for CUHK03 in our paper is in the "evaluation/data/CUHK03/" folder.
- cuhk03_new_protocol_config_detected.mat
- cuhk03_new_protocol_config_labeled.mat
| Labeled | detected | |
|---|---|---|
| #Training | 7,368 | 7,365 |
| #Query | 1,400 | 1,400 |
| #Gallery | 5,328 | 5,332 |
State-of-the-art
| - | Labeled | Labeled | detected | detected | |
|---|---|---|---|---|---|
| Methods | Rank@1 | mAP | Rank@1 | mAP | Reference |
| BOW+XQDA | 7.93% | 7.29% | 6.36% | 6.39% | "Scalable person re-identification: a benchmark", Zheng Liang, Shen Liyue, Tian Lu, Wang Shengjin, Wang Jingdong and Tian, Qi, ICCV 2015 [project] |
| PUL | - | - | 9.1% | 9.2% | "Unsupervised Person Re-identification: Clustering and Fine-tuning", Hehe Fan, Liang Zheng and Yi Yang, arXiv:1705.10444 [code] |
| LOMO+XQDA | 14.8% | 13.6% | 12.8% | 11.5% | "Person Re-identification by Local Maximal Occurrence Representation and Metric Learning", Liao Shengcai, Hu Yang, Zhu Xiangyu and Li Stan Z, CVPR 2015 [project] |
| IDE | 22.2% | 21.0% | 21.3% | 19.7% | "Person Re-identification: Past, Present and Future", Zheng Liang, Yi Yang, and Alexander G. Hauptmann, arXiv:1610.02984 [code] |
| IDE+DaF | 27.5% | 31.5% | 26.4% | 30.0 | "Divide and Fuse: A Re-ranking Approach for Person Re-identification", Rui Yu, Zhichao Zhou, Song Bai, Xiang Bai, BMVC 2017 |
| IDE+XQ.+re-ranking | 38.1% | 40.3% | 34.7% | 37.4% | "Re-ranking Person Re-identification with k-reciprocal Encoding", Zhun Zhong, Liang Zheng, Donglin Cao,Shaozi Li, CVPR 2017 [code] |
| PAN | 36.9% | 35.0% | 36.3% | 34.0% | "Pedestrian Alignment Network for Person Re-identification", Zhedong Zheng, Liang Zheng, Yi Yang, arXiv:1707.00408 [code] |
| DPFL | 43.0% | 40.5% | 40.7% | 37.0% | "Person Re-Identification by Deep Learning Multi-Scale Representations", Yanbei Chen, Xiatian Zhu, Shaogang Gong |
| SVDNet | 40.93 | 37.83 | 41.5% | 37.26% | "SVDNet for Pedestrian Retrieval", Sun Yifan, Zheng Liang, Deng Weijian, Wang Shengjin, ICCV 2017 |
| HA-CNN | 44.4% | 41.0% | 41.7% | 38.6% | "Harmonious Attention Network for Person Re-Identification", Wei Li1 Xiatian Zhu2 Shaogang Gong1, CVPR 2018 |
| HCN+XQDA+re-rank | 43.7% | 45.3% | 44.0% | 46.9% | "HIERARCHICAL CROSS NETWORK FOR PERSON RE-IDENTIFICATION", Huan-Cheng Hsu1, Ching-Hang Chen2, Hsiao-Rong Tyan3, Hong-Yuan Mark Liao, arxiv 2017 |
| MLFN | 54.7% | 49.2% | 52.8% | 47.8% | "Multi-Level Factorisation Net for Person Re-Identification", Xiaobin Chang, Timothy M. Hospedales, Tao Xiang， CVPR 2018 |
| TriNet+Random Erasing | 58.14% | 53.83% | 55.50% | 50.74% | "Random Erasing Data Augmentation", Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, Yi Yang, arXiv 2017 |
| TriNet+Random Erasing+Re. | 63.93% | 65.05% | 64.43% | 64.75% | "Random Erasing Data Augmentation", Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, Yi Yang, arXiv 2017 |
| PCB (RPP) | - | - | 63.7% | 67.5% | "Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)", Yifan Sun, Liang Zheng, Yi Yang, Qi Tian, Shengjin Wang, arXiv 2017 |