Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Tasks

no code implementations • 12 Jan 2023 • Xinsong Zhang, Yan Zeng, Jipeng Zhang, Hang Li

One is to stop gradients from the vision-language training when learning the language encoder.

Generalizing Math Word Problem Solvers via Solution Diversification

1 code implementation • 1 Dec 2022 • Zhenwen Liang, Jipeng Zhang, Lei Wang, Yan Wang, Jie Shao, Xiangliang Zhang

In this paper, we design a new training framework for an MWP solver by introducing a solution buffer and a solution discriminator.

Analogical Math Word Problems Solving with Enhanced Problem-Solution Association

1 code implementation • 1 Dec 2022 • Zhenwen Liang, Jipeng Zhang, Xiangliang Zhang

In this paper, we propose to build a novel MWP solver by leveraging analogical MWPs, which advance the solver's generalization ability across different kinds of MWPs.

Association Question Answering

X$^2$-VLM: All-In-One Pre-trained Model For Vision-Language Tasks

1 code implementation • 22 Nov 2022 • Yan Zeng, Xinsong Zhang, Hang Li, Jiawei Wang, Jipeng Zhang, Wangchunshu Zhou

Moreover, we show that the modular design of X$^2$-VLM results in high transferability for X$^2$-VLM to be utilized in any language or domain.

Cross-Modal Retrieval Image Captioning +7

Execution-based Evaluation for Data Science Code Generation Models

1 code implementation • 17 Nov 2022 • JunJie Huang, Chenglong Wang, Jipeng Zhang, Cong Yan, Haotian Cui, Jeevana Priya Inala, Colin Clement, Nan Duan, Jianfeng Gao

Code generation models can benefit data scientists' productivity by automatically generating code from context and text descriptions.

Code Generation Model Selection

MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving

1 code implementation • Findings (NAACL) 2022 • Zhenwen Liang, Jipeng Zhang, Lei Wang, Wei Qin, Yunshi Lan, Jie Shao, Xiangliang Zhang

Math word problem (MWP) solving faces a dilemma in number representation learning.

Common Sense Reasoning Language Modelling +3

Graph-to-Tree Learning for Solving Math Word Problems

1 code implementation • ACL 2020 • Jipeng Zhang, Lei Wang, Roy Ka-Wei Lee, Yi Bin, Yan Wang, Jie Shao, Ee-Peng Lim

While the recent tree-based neural models have demonstrated promising results in generating solution expression for the math word problem (MWP), most of these models do not capture the relationships and order information among the quantities well.

Math Word Problem Solving

Template-based math word problem solvers with recursive neural networks

1 code implementation • AAAI 2019 • Lei Wang, Dongxiang Zhang, Jipeng Zhang, Xing Xu, Lianli Gao, Bing Tian Dai, Heng Tao Shen

Then, we design a recursive neural network to encode the quantity with Bi-LSTM and self attention, and infer the unknown operator nodes in a bottom-up manner.

Modeling Intra-Relation in Math Word Problems with Different Functional Multi-Head Attentions

1 code implementation • ACL 2019 • Jierui Li, Lei Wang, Jipeng Zhang, Yan Wang, Bing Tian Dai, Dongxiang Zhang

Several deep learning models have been proposed for solving math word problems (MWPs) automatically.

Math Word Problem Solving