-
MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Models
ICLR 2026
Fan Zhang*, Zebang Cheng*, Chong Deng*, Haoxuan Li, Zheng Lian, Qian Chen, Huadai Liu, Wen Wang, Yi-Fan Zhang, Renrui Zhang, Ziyu Guo, Zhihong Zhu, Hao Wu, Haixin Wang, Yefeng Zheng, Xiaojiang Peng, Xian Wu, Kun Wang, Xiangang Li, Jieping Ye, Pheng-Ann Heng
* Equal contribution.
Paper
Project
-
AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Models
ICML 2025
Zheng Lian, Haoyu Chen, Lan Chen, Haiyang Sun, Licai Sun, Yong Ren, Zebang Cheng, Bin Liu, Rui Liu, Xiaojiang Peng, Jiangyan Yi, Jianhua Tao
Oral presentation.
Paper
Code
-
Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning
NeurIPS 2024
Zebang Cheng*, Zhi-Qi Cheng*, Jun-Yan He, Jingdong Sun, Kai Wang, Yuxiang Lin, Zheng Lian, Xiaojiang Peng, Alexander Hauptmann
* Equal contribution.
Paper
Project
Code
-
MIPS at SemEval-2024 Task 3: Multimodal Emotion-Cause Pair Extraction in Conversations with Multimodal Language Models
SemEval 2024
Zebang Cheng*, Fuqiang Niu*, Yuxiang Lin, Zhi-Qi Cheng, Bowen Zhang, Xiaojiang Peng
* Equal contribution. 3rd place in the Multimodal Emotion-Cause Analysis Challenge.
Paper
Code
-
SZTU-CMU at MER2024: Improving Emotion-LLaMA with Conv-Attention for Multimodal Emotion Recognition
MRAC at ACM Multimedia 2024
Zebang Cheng*, Shuyuan Tu*, Dawei Huang*, Minghan Li, Xiaojiang Peng, Zhi-Qi Cheng, Alexander G. Hauptmann
* Equal contribution. 1st place in MER-NOISE and 3rd place in the Open-Vocabulary Multimodal Emotion Recognition Challenge.
Paper
Code
-
Semi-Supervised Multimodal Emotion Recognition with Expression MAE
ACM Multimedia 2023
Zebang Cheng, Yuxiang Lin, Zhaoru Chen, Xiang Li, Shuyi Mao, Fan Zhang, Daijun Ding, Bowen Zhang, Xiaojiang Peng
2nd place in the ACM Multimedia 2023 Multimodal Emotion Recognition Challenge.
Paper