Search Results for author: Haotong Yang

Found 6 papers, 4 papers with code

Case-Based or Rule-Based: How Do Transformers Do the Math?

1 code implementation27 Feb 2024 Yi Hu, Xiaojuan Tang, Haotong Yang, Muhan Zhang

Through carefully designed intervention experiments on five math tasks, we confirm that transformers are performing case-based reasoning, no matter whether scratchpad is used, which aligns with the previous observations that transformers use subgraph matching/shortcut learning to reason.

Math Systematic Generalization

Chain of Images for Intuitively Reasoning

1 code implementation9 Nov 2023 Fanxu Meng, Haotong Yang, Yiding Wang, Muhan Zhang

The human brain is naturally equipped to comprehend and interpret visual information rapidly.

Common Sense Reasoning Language Modelling +2

Parrot Mind: Towards Explaining the Complex Task Reasoning of Pretrained Large Language Models with Template-Content Structure

no code implementations9 Oct 2023 Haotong Yang, Fanxu Meng, Zhouchen Lin, Muhan Zhang

Furthermore, by generalizing this structure to the hierarchical case, we demonstrate that models can achieve task composition, further reducing the space needed to learn from linear to logarithmic, thereby effectively learning on complex reasoning involving multiple steps.

Answer Generation Language Modelling

Code Prompting: a Neural Symbolic Method for Complex Reasoning in Large Language Models

no code implementations29 May 2023 Yi Hu, Haotong Yang, Zhouchen Lin, Muhan Zhang

We also consider the ensemble of code prompting and CoT prompting to combine the strengths of both.

Arithmetic Reasoning

Neural Common Neighbor with Completion for Link Prediction

1 code implementation2 Feb 2023 Xiyuan Wang, Haotong Yang, Muhan Zhang

Despite its outstanding performance in various graph tasks, vanilla Message Passing Neural Network (MPNN) usually fails in link prediction tasks, as it only uses representations of two individual target nodes and ignores the pairwise relation between them.

Link Prediction

Rethinking Knowledge Graph Evaluation Under the Open-World Assumption

1 code implementation19 Sep 2022 Haotong Yang, Zhouchen Lin, Muhan Zhang

However, evaluation of knowledge graph completion (KGC) models often ignores the incompleteness -- facts in the test set are ranked against all unknown triplets which may contain a large number of missing facts not included in the KG yet.

Fairness

Cannot find the paper you are looking for? You can Submit a new open access paper.