1 code implementation • 6 Nov 2024 • Yizhe Huang, Xingbo Wang, Hao liu, Fanqi Kong, Aoyang Qin, Min Tang, Song-Chun Zhu, Mingjie Bi, Siyuan Qi, Xue Feng
As agents progress, the environment adaptively generates new tasks with social structures for agents to undertake.
no code implementations • 6 Jun 2024 • Jianben He, Xingbo Wang, Shiyi Liu, Guande Wu, Claudio Silva, Huamin Qu
Large language models (LLMs) have exhibited impressive abilities for multimodal content comprehension and reasoning with proper prompting in zero- or few-shot settings.
no code implementations • 14 Dec 2023 • Chi-Hsuan Wu, Shih-Yang Liu, Xijie Huang, Xingbo Wang, Rong Zhang, Luca Minciullo, Wong Kai Yiu, Kenny Kwan, Kwang-Ting Cheng
However, a major doubt about online learning is whether students are as engaged as they are in face-to-face classes.
no code implementations • 7 Aug 2023 • Zhenhui Peng, Xingbo Wang, Qiushi Han, Junkai Zhu, Xiaojuan Ma, Huamin Qu
Vocabulary learning support tools have widely exploited existing materials, e. g., stories or video clips, as contexts to help users memorize each target word.
no code implementations • 1 Aug 2023 • Jianben He, Xingbo Wang, Kam Kwai Wong, Xijie Huang, Changjian Chen, Zixin Chen, Fengjie Wang, Min Zhu, Huamin Qu
Constructing supervised machine learning models for real-world video analysis require substantial labeled data, which is costly to acquire due to scarce domain expertise and laborious manual inspection.
no code implementations • 23 Jul 2023 • Xingbo Wang, Renfei Huang, Zhihua Jin, Tianqing Fang, Huamin Qu
Specifically, we extract relevant commonsense knowledge in inputs as references to align model behavior with human knowledge.
1 code implementation • 18 Jul 2023 • Yingchaojie Feng, Xingbo Wang, Kam Kwai Wong, Sijia Wang, Yuhong Lu, Minfeng Zhu, Baicheng Wang, Wei Chen
Generative text-to-image models have gained great popularity among the public for their powerful capability to generate high-quality images based on natural language prompts.
no code implementations • 25 Jan 2023 • Yingchaojie Feng, Xingbo Wang, Bo Pan, Kam Kwai Wong, Yi Ren, Shi Liu, Zihan Yan, Yuxin Ma, Huamin Qu, Wei Chen
Our research explores how to provide explanations for NLIs to help users locate the problems and further revise the queries.
no code implementations • 17 Aug 2022 • Zhihua Jin, Xingbo Wang, Furui Cheng, Chunhui Sun, Qun Liu, Huamin Qu
Since shortcuts vary in coverage, productivity, and semantic meaning, it is challenging for NLU experts to systematically understand and avoid them when creating benchmark datasets.
1 code implementation • 30 Jun 2022 • Paul Pu Liang, Yiwei Lyu, Gunjan Chhablani, Nihal Jain, Zihao Deng, Xingbo Wang, Louis-Philippe Morency, Ruslan Salakhutdinov
How can we visualize the internal modeling of multimodal interactions in these models?
no code implementations • 19 Apr 2022 • Haipeng Zeng, Xingbo Wang, Yong Wang, Aoyu Wu, Ting Chuen Pong, Huamin Qu
There lacks an efficient method to help users conduct gesture exploration, which is challenging due to the intrinsically temporal evolution of gestures and their complex correlation to speech content.
no code implementations • 16 Apr 2022 • Meng Xia, Qian Zhu, Xingbo Wang, Fei Nie, Huamin Qu, Xiaojuan Ma
In this paper, we derived four design goals for a tool that helps users improve the persuasiveness of arguments in online discussions through a survey with 123 online forum users and interviews with five debating experts.
1 code implementation • 13 Jan 2022 • Xingbo Wang, Furui Cheng, Yong Wang, Ke Xu, Jiang Long, Hong Lu, Huamin Qu
Natural language interfaces (NLIs) provide users with a convenient way to interactively analyze data through natural language queries.
no code implementations • 7 Sep 2021 • Zhihua Jin, Xin Jiang, Xingbo Wang, Qun Liu, Yong Wang, Xiaozhe Ren, Huamin Qu
However, those models do not consider the numerical properties of numbers and cannot perform robustly on numerical reasoning tasks (e. g., math word problems and measurement estimation).
no code implementations • 18 Jul 2021 • Xingbo Wang, Yao Ming, Tongshuang Wu, Haipeng Zeng, Yong Wang, Huamin Qu
Despite being a critical communication skill, grasping humor is challenging -- a successful use of humor requires a mixture of both engaging content build-up and an appropriate vocal delivery (e. g., pause).
no code implementations • 17 Jul 2021 • Xingbo Wang, Jianben He, Zhihua Jin, Muqiao Yang, Yong Wang, Huamin Qu
Much research focuses on modeling the complex intra- and inter-modal interactions between different communication channels.
1 code implementation • 22 Jan 2020 • Xingbo Wang, Haipeng Zeng, Yong Wang, Aoyu Wu, Zhida Sun, Xiaojuan Ma, Huamin Qu
The modulation of voice properties, such as pitch, volume, and speed, is crucial for delivering a successful public speech.
no code implementations • 29 Jul 2019 • Haipeng Zeng, Xingbo Wang, Aoyu Wu, Yong Wang, Quan Li, Alex Endert, Huamin Qu
Our visualization system features a channel coherence view and a sentence clustering view that together enable users to obtain a quick overview of emotion coherence and its temporal evolution.