how do I get coco_test_karpathy.json ?

[suiyize]

I'm getting ready to do an evaluation, but how do I get coco_test_karpathy.json?

[d-ailin]

You could access one from here: https://gist.githubusercontent.com/mehdidc/0745a72acb12d3fc9bf91bda65e1ebb6/raw/6d1d31f8da09310f775905e9ea89aa42d0739f22/coco_test_karpathy.json. Thanks!

[suiyize]

Is this file any different from the official captions_val2014.json except that it's shorter?

[d-ailin]

The karpathy split is a subset of MSCOCO dataset and the information for each item would still remain unchanged.