BackdoorBench

VALUE: This phase evaluates task-agnostic algorithms on all datasets and tasks in VALUE benchmark. A submission needs to consist of results on all 11 datasets to be considered as a valid submission.
Retrieval: This phase evaluates algorithms on 4 text-to-video retrieval tasks in VALUE benchmark, including TVR, How2R, YC2R and VATEX-EN-R. A submission needs to consist of results on all 4 datasets to be considered as a valid submission.
QA: This phase evaluates algorithms on 4 video question answering tasks in VALUE benchmark, including TVQA, How2QA, VIOLIN and VLEP. A submission needs to consist of results on all 4 datasets to be considered as a valid submission.
Captioning: This phase evaluates algorithms on 3 video captioning tasks in VALUE benchmark, including TVC, YC2C and VATEX-EN-C. A submission needs to consist of results on all 3 datasets to be considered as a valid submission.

BlackboxBench

Have any questions or suggestions? Feel free to contact us at wubaoyuan@cuhk.edu.cn !