Feature-Based Dual Visual Feature Extraction Model for Compound Multimodal Emotion Recognition

1 code implementation • 21 Mar 2025 • Ran Liu, Fengyu Zhang, Cong Yu, Longjiang Yang, Zhuofan Wen, Siyuan Zhang, Hailiang Yao, Shun Chen, Zheng Lian, Bin Liu

This article presents our results for the eighth Affective Behavior Analysis in-the-wild (ABAW) competition. Multimodal emotion recognition (ER) has important applications in affective computing and human-computer interaction.

Multimodal Emotion Recognition

Ocean-OCR: Towards General OCR Application via a Vision-Language Model

1 code implementation • 26 Jan 2025 • Song Chen, Xinyu Guo, Yadong Li, Tao Zhang, MingAn Lin, Dongdong Kuang, Youwei Zhang, Lingfeng Ming, Fengyu Zhang, Yuran Wang, Jianhua Xu, Zenan Zhou, WeiPeng Chen

Despite the rapid progress made previously, insufficient OCR ability hinders MLLMs from excelling in text-related tasks.

document understanding Language Modeling +3

Baichuan-Omni-1.5 Technical Report

1 code implementation • 26 Jan 2025 • Yadong Li, Jun Liu, Tao Zhang, Song Chen, Tianpeng Li, zehuan li, Lijun Liu, Lingfeng Ming, Guosheng Dong, Da Pan, Chong Li, Yuanbo Fang, Dongdong Kuang, Mingrui Wang, Chenglin Zhu, Youwei Zhang, Hongyu Guo, Fengyu Zhang, Yuran Wang, Bowen Ding, Wei Song, Xu Li, Yuqi Huo, Zheng Liang, Shusen Zhang, Xin Wu, Shuai Zhao, Linchu Xiong, Yozhen Wu, Jiahui Ye, Wenhao Lu, Bowen Li, Yan Zhang, Yaqi Zhou, Xin Chen, Lei Su, Hongda Zhang, Fuzhong Chen, Xuezhen Dong, Na Nie, Zhiying Wu, Bin Xiao, Ting Li, Shunya Dang, Ping Zhang, Yijia Sun, Jincheng Wu, Jinjie Yang, Xionghai Lin, Zhi Ma, Kegeng Wu, Jia Li, Aiyuan Yang, Hui Liu, Jianqiang Zhang, Xiaoxi Chen, Guangwei Ai, Wentao Zhang, Yicong Chen, Xiaoqin Huang, Kun Li, Wenjing Luo, Yifei Duan, Lingling Zhu, Ran Xiao, Zhe Su, Jiani Pu, Dian Wang, Xu Jia, Tianyu Zhang, Mengyu Ai, Mang Wang, Yujing Qiao, Lei Zhang, Yanjun Shen, Fan Yang, Miao Zhen, Yijie Zhou, Mingyang Chen, Fei Li, Chenzheng Zhu, Keer Lu, Yaqi Zhao, Hao Liang, Youquan Li, Yanzhao Qin, Linzhuang Sun, Jianhua Xu, Haoze Sun, MingAn Lin, Zenan Zhou, WeiPeng Chen

We introduce Baichuan-Omni-1. 5, an omni-modal model that not only has omni-modal understanding capabilities but also provides end-to-end audio generation capabilities.

Audio Generation

LiPost: Improved Content Understanding With Effective Use of Multi-task Contrastive Learning

no code implementations • 18 May 2024 • Akanksha Bindal, Sudarshan Ramanujam, Dave Golland, TJ Hazen, Tina Jiang, Fengyu Zhang, Peng Yan

This work provides a robust foundation for vertical teams across LinkedIn to customize and fine-tune the LLM to their specific applications.

Contrastive Learning Multi-Task Learning +1

Multimodal Fusion with Pre-Trained Model Features in Affective Behaviour Analysis In-the-wild

no code implementations • 22 Mar 2024 • Zhuofan Wen, Fengyu Zhang, Siyuan Zhang, Haiyang Sun, Mingyu Xu, Licai Sun, Zheng Lian, Bin Liu, JianHua Tao

Multimodal fusion is a significant method for most multimodal tasks.

LiRank: Industrial Large Scale Ranking Models at LinkedIn

no code implementations • 10 Feb 2024 • Fedor Borisyuk, Mingzhou Zhou, Qingquan Song, Siyu Zhu, Birjodh Tiwana, Ganesh Parameswaran, Siddharth Dangi, Lars Hertel, Qiang Xiao, Xiaochen Hou, Yunbo Ouyang, Aman Gupta, Sheallika Singh, Dan Liu, Hailing Cheng, Lei Le, Jonathan Hung, Sathiya Keerthi, Ruoyan Wang, Fengyu Zhang, Mohit Kothari, Chen Zhu, Daqi Sun, Yun Dai, Xun Luan, Sirou Zhu, Zhiwei Wang, Neil Daftary, Qianqi Shen, Chengming Jiang, Haichao Wei, Maneesh Varshney, Amol Ghoting, Souvik Ghosh

We present LiRank, a large-scale ranking framework at LinkedIn that brings to production state-of-the-art modeling architectures and optimization methods.

Click-Through Rate Prediction Quantization

FsaNet: Frequency Self-attention for Semantic Segmentation

1 code implementation • 28 Nov 2022 • Fengyu Zhang, Ashkan Panahi, Guangjun Gao

By ablation study, we show that low frequency self-attention can achieve very close or better performance relative to full frequency even without retraining the network.

Instance Segmentation Semantic Segmentation