Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
SanghyukChun authored Jul 16, 2022
1 parent 587aa0d commit 1d03b41
Showing 1 changed file with 12 additions and 7 deletions.
19 changes: 12 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -87,13 +87,18 @@ python extract_rankings_coco.py ./config/coco/pcme_coco.yaml \
python evaluate_pmrp_coco.py --ranking_file <dumped_ranking_file>
```

| Method | I2T PMRP | I2T R@1 | T2I PMRP | T2I R@1 | Model file |
|----------|----------|---------|----------|---------|------------|
| PCME | 45.0 | 68.8 | 46.0 | 54.6 | [link](https://drive.google.com/file/d/1S8H8LRORL_7ZAD4KLn7hkCPs8j6Q9Beh/view?usp=sharing) |
| PVSE K=1 | 40.3 | 66.7 | 41.8 | 53.5 | - |
| PVSE K=2 | 42.8 | 69.2 | 43.6 | 55.2 | - |
| VSRN | 41.2 | 76.2 | 42.4 | 62.8 | - |
| VSRN + AOQ | 44.7 | 77.5 | 45.6 | 63.5 | - |
| Method | I2T 1K PMRP | I2T 1K R@1 | I2T ECCV mAP@R | T2I 1K PMRP | T2I 1K R@1 | T2I ECCV mAP@R | Model file |
|----------|----------|---------|----------|----------|---------|----------|------------|
| PCME | 45.0 | 68.8 | 26.2 | 46.0 | 54.6 | 48.0 | [link](https://drive.google.com/file/d/1S8H8LRORL_7ZAD4KLn7hkCPs8j6Q9Beh/view?usp=sharing) |
| PCME (CutMix-pretrained) | 46.2 | 68.3 | 28.6 | 47.1 | 56.7 | 54.9 | [link](https://drive.google.com/file/d/1K9d_NHU1wyzGsfH1hJ07k_nQ9dSHFHXK/view?usp=sharing) |
| PVSE K=1 | 40.3 | 66.7 | 23.4 | 41.8 | 53.5 | 44.6 | - |
| PVSE K=2 | 42.8 | 69.2 | 26.7 | 43.6 | 55.2 | 53.8 | - |
| VSRN | 41.2 | 76.2 | 30.8 | 42.4 | 62.8 | 53.8 | - |
| VSRN + AOQ | 44.7 | 77.5 | 30.7 | 45.6 | 63.5 | 51.2 | - |

Check [ECCV Caption dataset](https://github.com/naver-ai/eccv-caption) for more details of "ECCV mAP@R".
- Paper: [ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCO](https://arxiv.org/abs/2204.03359)
- GitHub: [naver-ai/eccv-caption](https://github.com/naver-ai/eccv-caption)

### CUB Caption

Expand Down

0 comments on commit 1d03b41

Please sign in to comment.