Results are on karpathy test split, beam size 5. Without notice, the numbers shown are not selected. The scores are just used to verify if you are getting things right. If the scores you get is close to the number I give (it could be higher or lower), then it's ok.
Collection: link
| Name | CIDEr | SPICE | Download | Note |
|---|---|---|---|---|
| FC | 0.953 | 0.1787 | model&metrics | --caption_model newfc |
| FC +self_critical |
1.045 | 0.1838 | model&metrics | --caption_model newfc |
| FC +new_self_critical |
1.053 | 0.1857 | model&metrics | --caption_model newfc |
Collection: link
| Name | CIDEr | SPICE | Download | Note |
|---|---|---|---|---|
| Att2in | 1.089 | 0.1982 | model&metrics | My replication |
| Att2in +self_critical |
1.173 | 0.2046 | model&metrics | |
| Att2in +new_self_critical |
1.195 | 0.2066 | model&metrics | |
| topdown | 1.099 | 0.1999 | model&metrics | My replication |
| topdown +self_critical |
1.227 | 0.2145 | model&metrics | |
| topdown +new_self_critical |
1.239 | 0.2154 | model&metrics | |
| Topdown +Schedule long +new_self_critical |
1.280 | 0.2200 | model&metrics | Best of 5 models schedule proposed by yangxuntu |
| Transformer | 1.113 | 0.2045 | model&metrics | |
| Transformer +self_critical |
1.266 | 0.2224 | model&metrics | |
| Transformer +new_self_critical |
1.295 | 0.2277 | model&metrics |